-- Logs begin at Tue 2022-05-31 19:57:59 UTC, end at Tue 2022-05-31 21:16:02 UTC. -- May 31 20:37:43.918960 dv-cinder-839793-16-smb systemd[1]: Starting Devstack devstack@keystone.service... May 31 20:37:43.927692 dv-cinder-839793-16-smb devstack@keystone.service[87206]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 31 20:37:43 2022] *** May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: nodename: dv-cinder-839793-16-smb May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: machine: x86_64 May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: clock source: unix May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: pcre jit disabled May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: detected number of CPU cores: 4 May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: current working directory: / May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: detected binary path: /usr/bin/uwsgi-core May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: your processes number limit is 47680 May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: your memory page size is 4096 bytes May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: detected max file descriptor number: 2048 May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: lock engine: pthread robust mutexes May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: thunder lock: enabled May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 31 20:37:43.934233 dv-cinder-839793-16-smb devstack@keystone.service[87206]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 31 20:37:43.975148 dv-cinder-839793-16-smb devstack@keystone.service[87206]: Python main interpreter initialized at 0x560637a559c0 May 31 20:37:43.975148 dv-cinder-839793-16-smb devstack@keystone.service[87206]: python threads support enabled May 31 20:37:43.975148 dv-cinder-839793-16-smb devstack@keystone.service[87206]: your server socket listen backlog is limited to 100 connections May 31 20:37:43.975148 dv-cinder-839793-16-smb devstack@keystone.service[87206]: your mercy for graceful operations on workers is 90 seconds May 31 20:37:43.975478 dv-cinder-839793-16-smb devstack@keystone.service[87206]: mapped 403077 bytes (393 KB) for 2 cores May 31 20:37:43.975552 dv-cinder-839793-16-smb devstack@keystone.service[87206]: *** Operational MODE: preforking *** May 31 20:37:43.975830 dv-cinder-839793-16-smb devstack@keystone.service[87206]: *** uWSGI is running in multiple interpreter mode *** May 31 20:37:43.975830 dv-cinder-839793-16-smb devstack@keystone.service[87206]: spawned uWSGI master process (pid: 87206) May 31 20:37:43.976034 dv-cinder-839793-16-smb systemd[1]: Started Devstack devstack@keystone.service. May 31 20:37:43.981404 dv-cinder-839793-16-smb devstack@keystone.service[87206]: spawned uWSGI worker 1 (pid: 87215, cores: 1) May 31 20:37:43.981404 dv-cinder-839793-16-smb devstack@keystone.service[87206]: spawned uWSGI worker 2 (pid: 87216, cores: 1) May 31 20:37:43.981404 dv-cinder-839793-16-smb devstack@keystone.service[87206]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 31 20:37:49.768353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 20:37:49.768353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: from cryptography.utils import int_from_bytes May 31 20:37:49.769150 dv-cinder-839793-16-smb devstack@keystone.service[87215]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 20:37:49.769150 dv-cinder-839793-16-smb devstack@keystone.service[87215]: from cryptography.utils import int_from_bytes May 31 20:37:49.769422 dv-cinder-839793-16-smb devstack@keystone.service[87216]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 20:37:49.769422 dv-cinder-839793-16-smb devstack@keystone.service[87216]: from cryptography.utils import int_from_bytes May 31 20:37:49.769878 dv-cinder-839793-16-smb devstack@keystone.service[87216]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 20:37:49.769878 dv-cinder-839793-16-smb devstack@keystone.service[87216]: from cryptography.utils import int_from_bytes May 31 20:37:49.821106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 20:37:49.821304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 20:37:49.821503 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] command line args: [] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 20:37:49.821775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 20:37:49.821954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ================================================================================ {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 20:37:49.822209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] admin_token = **** {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.822293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 20:37:49.822460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] config_dir = [] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.822548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 20:37:49.822648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.822740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] command line args: [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 20:37:49.822816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] config_source = [] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.822953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 20:37:49.823036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] debug = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.823137 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ================================================================================ {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 20:37:49.823220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.823453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] admin_token = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.823593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.823696 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] config_dir = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.823802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.823902 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.824003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.824110 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] config_source = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.824210 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] debug = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.824308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.824403 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.824534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] list_limit = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.824630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.824727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] log_config_append = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.824826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.824925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.825024 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.825216 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] log_dir = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.825321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.825456 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.825584 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] log_file = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.825660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] log_config_append = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.825805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.825941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.826021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] log_dir = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.826142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] log_file = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.826243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.826378 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.826520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.826631 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.826866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.826947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.827119 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.827198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.827300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.827434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.827517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.827714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.827792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.827963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.828121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.828248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.828323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.828437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.828510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.828630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.828715 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.828867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.828994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.829120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.829213 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.829368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.829490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.829676 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.829760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.830182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.830285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.830368 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] publish_errors = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.830438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] publish_errors = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.830584 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.830674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.830815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.830935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.831008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.831083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.831225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.831321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.831469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.831547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.831668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] standard_threads = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.831751 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] standard_threads = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.831901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.831985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.832145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.832221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.832319 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.832405 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.832496 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] use_journal = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.832579 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] use_journal = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.832673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] use_json = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.832755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] use_json = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.832829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] use_stderr = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.832902 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] use_stderr = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.833005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] use_syslog = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.833073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] use_syslog = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.833236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.833302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:37:49.833524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.833609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.833771 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.833850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.834031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.834107 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.834271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.834387 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.834518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.834596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.834755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.834834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.835003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.835090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.835240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.835323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.835485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.835568 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.835762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.835848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.836014 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.836097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.836249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.836326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.836498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.836657 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.837004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.837086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.837234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.837312 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.837504 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.837601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.837743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.837822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.837998 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.838075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.838250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.838339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.838497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.838586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.838733 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.838817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.838987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.839072 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.839250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.839326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.839502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.839585 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.839750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.839829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.839981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.840058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.840211 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.840439 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.840523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.840673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.840749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.840919 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.840994 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.841165 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.841257 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.841395 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.841472 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.841634 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.841739 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.841880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.841997 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.842127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.842231 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.842363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.842467 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.842613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.842734 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.842876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.842959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.843071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.843149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.843305 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.843391 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.843535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.843618 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.843767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.843843 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.843995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.844078 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.844226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.844302 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.844460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.844542 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.844701 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.844790 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.844929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.845022 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.845165 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.845249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.845412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.845495 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.845697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.845800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.845868 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.845938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.846103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.846188 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.846332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.846411 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.846572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.846651 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.846810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.846900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.847048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.847127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.847282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.847365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.847516 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.847596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.847746 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.847825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.847978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.848056 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.848214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.848290 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.848451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.848531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.848681 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.848767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.848913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.849070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.849155 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.849225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.849394 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.849485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.849639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.849719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.849875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.849945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.850114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.850186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.850370 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.850437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.850615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.850693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.850856 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.850932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.851092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.851673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.851863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.851945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.852099 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.852177 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.852347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.852425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.852586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.852674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.852824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.852900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.853063 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.853148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.853301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.853418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.853562 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.853642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.853798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.853874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.854032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.854119 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.854270 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.854347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.854511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.854590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.854761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.854847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.855003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.855080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.855240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.855318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.855480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.855565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.855715 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.855792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.855949 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.856025 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.856183 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.856263 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.856412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.856480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.856641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.856719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.856870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.856956 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.857100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.857168 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.857325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.857457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.857584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.857663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.857818 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.857885 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.858133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.858290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.858375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.858533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.858611 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.858793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.858878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.859031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.859116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.859264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] auth.external = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.859342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.859494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.859576 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.external = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.859724 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.859810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.860008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.860100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.860238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] auth.password = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.860318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.860467 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] auth.token = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.860545 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.password = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.860698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.token = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.860784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.860933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.861010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.861171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.861249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.861417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.861517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.861669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.861738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.861916 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.861985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.862148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.862225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.862384 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] credential.caching = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.862453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.862622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.862689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.862867 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.863017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.863115 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.863186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.863351 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.863430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.863591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.863677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.863824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.863892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.864064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.864132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.864319 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.864395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.864555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.864625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.864796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.864863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.865052 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.865129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.865317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.865463 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.865603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.865699 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.865843 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.865931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.866099 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.866170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.866335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] federation.caching = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.866402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.866607 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.866722 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.866853 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.867504 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.867614 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.867695 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.867845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.867934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.868097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.868218 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.868335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.868428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.868588 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.868670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.868824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.868904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.869074 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.869152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.869309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.869488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.869571 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.869644 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.869809 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.caching = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.869890 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.870050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.870119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.870295 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.870362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.870533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.870602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.870770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.870851 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.871009 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.871087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.871239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.871317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.871477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.871548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.871717 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.871795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.871966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.872043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.872199 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.872280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.872432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.872517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.872664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.872743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.872907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.872988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.873152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.873230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.873416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.873500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.873670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.873751 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.873914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.873993 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.874166 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.874244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.874416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.874497 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.874656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.874736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.874887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.874966 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.875121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.875200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.875350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.875436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.875584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.875663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.875823 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.875902 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.876063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.876142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.876304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.876382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.876533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.876613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.876777 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.876855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.877021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.877111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.877275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.877366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.877526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.877610 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.877773 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.877866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.878004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.878083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.878241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.878318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.878469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.878546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.878705 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.878784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.878940 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.879017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.879179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.879265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.879415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.879493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.879651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.879730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.879891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.879977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.880137 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.880221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.880372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.880496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.880616 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.880751 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.880866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.880983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.881104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.881219 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.881343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.881550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.881671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.881789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.881914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.882036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.882152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.882271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.882350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.882947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.883061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.883140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.883343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.883469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.883593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.883709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.883842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.883962 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.884088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.884216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.884331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.884468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.884547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.884749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.884882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.884968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.885106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.885183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.885246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.885413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.885499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.885660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.885743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.885894 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.885973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.886144 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.886224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.886394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.886476 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.886637 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.886715 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.886868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.886954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.887100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.887174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.887336 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.887417 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.887572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.887652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.887808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.887890 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.888043 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.888123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.888279 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.888358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.888519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.888600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.888753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.888831 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.889003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.889081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.889231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.889311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.889497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.889569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.889735 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.889803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.889972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.890042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.890209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.890276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.890449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.890528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.890687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.890767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.890917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.890996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.891154 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.891223 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.891387 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.891456 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] resource.caching = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.891628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.891696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.891870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.891937 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.892106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.892187 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.892355 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.892435 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.892593 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.892670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.892829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.892909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.893074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.893143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.893311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.893429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.893574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.893645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.893811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] role.caching = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.893879 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.894051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.894129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] role.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.894284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.894351 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] role.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.894531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] role.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.894599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.894764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.894841 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.895009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.895077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.895254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.895322 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.895499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.895576 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.895744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.895813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.895988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.896056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.896233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.896308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.896467 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.896590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.896708 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.896825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.896945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.897078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.897190 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.897302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.897464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.897548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.897667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.897839 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.897923 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.898135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.898909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.899039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.899145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.899233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.899389 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.899470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.899638 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.899718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.899874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.899956 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.900126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.900204 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.900363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.900443 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.900600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.900680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.900833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.900913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.901065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.901144 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.901297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.901406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.901572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.901653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.901805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.901883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.902061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.902144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.902297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.902375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.902532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.902612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.902762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.902844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.902997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] token.caching = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.903077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.903232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.903311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.903469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] token.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.903555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.903702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.903784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.903949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.904028 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.904189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.904270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.904428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.904515 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.904671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.904751 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.904912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.904992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.905157 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.905274 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.905484 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.905573 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.905649 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.905711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.905879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.905958 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.906122 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.906191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.906359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.906428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.906585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.906658 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.906828 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.906907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.907064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.907144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.907312 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.907399 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.connection = **** {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.907602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.907696 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.907848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.907937 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.connection = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.908087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.908174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.908322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.908441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.908561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.908700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.908820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.908949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.909069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.909190 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.909315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.909451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.909573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.909672 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.909748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.909820 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.909950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.910043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.910182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.910297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.910420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.910542 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.910667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.910788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.910896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.911014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.911133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.911239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.911353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.911468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.911571 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.911701 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.911819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 20:37:49.911933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.912051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:37:49.912167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 20:37:49.941599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:49.941812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:49.942048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:49.942301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:49.942537 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:49.942768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:49.951421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:49.952135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:49.981601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:49.981828 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:49.982238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:49.982475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.036874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.037408 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.088239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.088467 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.088904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.089141 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.159249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.159437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.159526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.159657 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.159744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.159877 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.159960 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.160093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.160174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.160309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.160394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.160525 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.184736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.185005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.185127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.185214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.185288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.185397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.185516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.185614 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.185749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.185831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.185974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.186055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.186197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.186417 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.198277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.198739 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.211188 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.211414 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.211517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.211890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.211979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.212117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.212199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.212332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.212415 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.212546 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.212628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.212758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.212849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.213027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:37:50.230101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.230301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.230387 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 31 20:37:50.230516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 31 20:37:50.230639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.230839 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 31 20:37:50.230920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.231045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 31 20:37:50.231126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.231344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.231428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.231608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.231688 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.231869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.231948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.232125 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.243547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.243823 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.243905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.244090 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.244370 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.244458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.244706 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.244996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.252543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.253211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.255862 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.256146 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.256430 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.256545 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.256708 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.256829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.256987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.257112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.257406 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.258027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.258275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.258357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.258557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.258694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.258832 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.258971 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.259109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.259250 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.259377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.259524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.259798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.260067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.286073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.286616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.287889 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.288120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.288369 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.289282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.294096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.294386 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.294622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.294719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.294905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.295189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.302671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.302671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.302935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.302935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.308007 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.308007 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.308157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.308314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.308392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.308452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.308656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.308745 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.308907 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.308991 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.309181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.309263 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.309484 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.309568 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.309764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.310038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.327992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.328274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.328768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.329053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.332881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.333777 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.336553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.337109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.337831 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.338129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.342077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.343152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.345657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.347924 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.350867 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.351702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.351991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.352275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.352550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.352824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.353808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.354113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.354400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.354697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.354980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.355260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.372433 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.372725 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.372991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.373260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.374911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.375211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.375497 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.375765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.381234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.383522 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.383792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.384493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.386325 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.386604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.386865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.387143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.387422 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.387724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.388017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.389686 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.389982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.390267 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.390560 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.390858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.402144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.402439 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.402723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.403003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.403281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.403552 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.403828 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.405064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.405362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.405677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.405968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.406252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.406526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.406801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.422124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.424972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.425454 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.428340 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.428793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.430485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.431776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.432147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.432429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.432712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.433415 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.435073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.435355 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.435645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.440154 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.441821 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.443135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.445365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.445605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.445903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.446188 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.446463 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.448976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.449281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.449591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.449870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.455789 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.456096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.456503 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.459203 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.459513 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.459926 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.465472 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.465773 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.466056 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.466330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.466602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.466906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.467182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.467459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.467732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.467999 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.468266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.468533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.468803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.468901 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:37:50.469071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.469193 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.469507 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.469786 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.470058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.470365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.470646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.470924 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.471202 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.471474 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.471745 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.472015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.472281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.472540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:37:50.507049 dv-cinder-839793-16-smb devstack@keystone.service[87215]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560637a559c0 pid: 87215 (default app) May 31 20:37:50.511069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51840d4-8663-415e-ab2a-c2efd94bc9fa None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:37:50.511281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560637a559c0 pid: 87216 (default app) May 31 20:37:50.511369 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51840d4-8663-415e-ab2a-c2efd94bc9fa None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:37:50.511622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51840d4-8663-415e-ab2a-c2efd94bc9fa None None] PATH_INFO: `/v3` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:37:50.515987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Tue May 31 20:37:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:37:59.629123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0dd11-59c6-41ea-811d-7fc6e485f2d6 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:37:59.629691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0dd11-59c6-41ea-811d-7fc6e485f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:37:59.629691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0dd11-59c6-41ea-811d-7fc6e485f2d6 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:37:59.634458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:37:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:37:59.639821 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04a3cf-6920-48dd-90fd-82a943fc7eed None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:37:59.640255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04a3cf-6920-48dd-90fd-82a943fc7eed None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:37:59.640355 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04a3cf-6920-48dd-90fd-82a943fc7eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:37:59.708432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: INFO dbcounter [None req-1f04a3cf-6920-48dd-90fd-82a943fc7eed None None] Registered counter for database keystone May 31 20:37:59.730962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG oslo_db.sqlalchemy.engines [None req-1f04a3cf-6920-48dd-90fd-82a943fc7eed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 20:37:59.737428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writer thread running {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 20:38:00.020447 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG passlib.handlers.bcrypt [None req-1f04a3cf-6920-48dd-90fd-82a943fc7eed None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87215) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 31 20:38:00.020860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG passlib.handlers.bcrypt [None req-1f04a3cf-6920-48dd-90fd-82a943fc7eed None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87215) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 31 20:38:00.077761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-1f04a3cf-6920-48dd-90fd-82a943fc7eed None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:00.079377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1f04a3cf-6920-48dd-90fd-82a943fc7eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:00.205432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:37:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 566 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 31 20:38:00.354249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0dd11-59c6-41ea-811d-7fc6e485f2d6 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:00.423031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: INFO dbcounter [None req-23d0dd11-59c6-41ea-811d-7fc6e485f2d6 None None] Registered counter for database keystone May 31 20:38:00.442851 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG oslo_db.sqlalchemy.engines [None req-23d0dd11-59c6-41ea-811d-7fc6e485f2d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 20:38:00.449772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writer thread running {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 20:38:00.673188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0dd11-59c6-41ea-811d-7fc6e485f2d6 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:00.677700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5db89a-1397-49ab-afae-77ebf8d7e78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:00.679084 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db89a-1397-49ab-afae-77ebf8d7e78e admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:00.679373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db89a-1397-49ab-afae-77ebf8d7e78e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:00.679651 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db89a-1397-49ab-afae-77ebf8d7e78e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:00.688335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5db89a-1397-49ab-afae-77ebf8d7e78e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:00.739601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bc5db89a-1397-49ab-afae-77ebf8d7e78e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 31 20:38:00.739929 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5db89a-1397-49ab-afae-77ebf8d7e78e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:00.750307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Tue May 31 20:38:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 31 20:38:00.756980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04a3cf-6920-48dd-90fd-82a943fc7eed None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:00.772259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04a3cf-6920-48dd-90fd-82a943fc7eed None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:00.776792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8696d-238b-4911-8f98-bd67c72b3f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:00.777992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8696d-238b-4911-8f98-bd67c72b3f10 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:00.778283 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8696d-238b-4911-8f98-bd67c72b3f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:00.778595 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8696d-238b-4911-8f98-bd67c72b3f10 admin admin] PATH_INFO: `/v3/projects/8f897b27191b44a4b4a76e83f6d0aaaa` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:00.780132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8696d-238b-4911-8f98-bd67c72b3f10 admin admin] RBAC: Authorizing `identity:get_project(project_id=8f897b27191b44a4b4a76e83f6d0aaaa)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:00.832056 dv-cinder-839793-16-smb devstack@keystone.service[87215]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e3b8696d-238b-4911-8f98-bd67c72b3f10 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 31 20:38:00.832399 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8696d-238b-4911-8f98-bd67c72b3f10 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:00.837446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Tue May 31 20:38:00 2022] GET /identity/v3/projects/8f897b27191b44a4b4a76e83f6d0aaaa => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:03.061501 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d8de5-bc2f-43d3-ab26-9ea2392fbf8e None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:03.062024 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d8de5-bc2f-43d3-ab26-9ea2392fbf8e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:03.062190 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d8de5-bc2f-43d3-ab26-9ea2392fbf8e None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:03.066174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:03.071756 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69785cef-20a9-4cf8-b43b-eb540d63e6ef None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:03.072181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69785cef-20a9-4cf8-b43b-eb540d63e6ef None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:03.072290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69785cef-20a9-4cf8-b43b-eb540d63e6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:03.090867 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-69785cef-20a9-4cf8-b43b-eb540d63e6ef None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:03.092353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-69785cef-20a9-4cf8-b43b-eb540d63e6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:03.100608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 31 20:38:03.123274 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d8de5-bc2f-43d3-ab26-9ea2392fbf8e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:03.135566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d8de5-bc2f-43d3-ab26-9ea2392fbf8e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:03.139792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e13e4-ed41-4e35-b43a-6a88613b1b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:03.140424 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e13e4-ed41-4e35-b43a-6a88613b1b6c admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:03.140710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e13e4-ed41-4e35-b43a-6a88613b1b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:03.140987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e13e4-ed41-4e35-b43a-6a88613b1b6c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:03.149757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e13e4-ed41-4e35-b43a-6a88613b1b6c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:03.151580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e13e4-ed41-4e35-b43a-6a88613b1b6c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:03.161477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Tue May 31 20:38:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 20:38:03.167811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69785cef-20a9-4cf8-b43b-eb540d63e6ef None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:03.177031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69785cef-20a9-4cf8-b43b-eb540d63e6ef None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:03.182035 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64120f4-d208-44bc-bf5d-40e40e384092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:03.182911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64120f4-d208-44bc-bf5d-40e40e384092 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:03.183195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64120f4-d208-44bc-bf5d-40e40e384092 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:03.183471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64120f4-d208-44bc-bf5d-40e40e384092 admin admin] PATH_INFO: `/v3/users/d4d342095f994d388541563ef9df90e3` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:03.184853 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64120f4-d208-44bc-bf5d-40e40e384092 admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d342095f994d388541563ef9df90e3)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:03.186723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64120f4-d208-44bc-bf5d-40e40e384092 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:03.188333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Tue May 31 20:38:03 2022] GET /identity/v3/users/d4d342095f994d388541563ef9df90e3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:05.491901 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664167ab-0ad0-497f-acdf-1f387b1eee99 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:05.492433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664167ab-0ad0-497f-acdf-1f387b1eee99 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:05.492548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664167ab-0ad0-497f-acdf-1f387b1eee99 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:05.493833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:38:05.499102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79eb57-1256-457d-812e-740437b173f8 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:05.499530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79eb57-1256-457d-812e-740437b173f8 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:05.499744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79eb57-1256-457d-812e-740437b173f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:05.516925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-3e79eb57-1256-457d-812e-740437b173f8 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:05.518145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3e79eb57-1256-457d-812e-740437b173f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:05.523568 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0972bb-0684-4a1e-b804-1798e46be707 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:05.523859 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0972bb-0684-4a1e-b804-1798e46be707 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:05.524143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0972bb-0684-4a1e-b804-1798e46be707 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:05.525511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:38:05.530892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cac556-d81f-40d7-9c61-f06c350dbd7f None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:05.531182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cac556-d81f-40d7-9c61-f06c350dbd7f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:05.531459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cac556-d81f-40d7-9c61-f06c350dbd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:05.572849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG passlib.handlers.bcrypt [None req-14cac556-d81f-40d7-9c61-f06c350dbd7f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87216) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 31 20:38:05.573203 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG passlib.handlers.bcrypt [None req-14cac556-d81f-40d7-9c61-f06c350dbd7f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87216) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 31 20:38:05.602631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:05.620514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-14cac556-d81f-40d7-9c61-f06c350dbd7f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:05.622155 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-14cac556-d81f-40d7-9c61-f06c350dbd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:05.625944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79eb57-1256-457d-812e-740437b173f8 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:05.651230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:05.724091 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:05.734937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79eb57-1256-457d-812e-740437b173f8 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:05.746837 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cac556-d81f-40d7-9c61-f06c350dbd7f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:05.768807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8a7d5-6d15-43d8-98e7-bf5ab69202d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:05.769725 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8a7d5-6d15-43d8-98e7-bf5ab69202d7 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:05.770019 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8a7d5-6d15-43d8-98e7-bf5ab69202d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:05.770315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8a7d5-6d15-43d8-98e7-bf5ab69202d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:05.782388 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8a7d5-6d15-43d8-98e7-bf5ab69202d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-a9b8a7d5-6d15-43d8-98e7-bf5ab69202d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:05.794189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:05.795149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:05.796062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:05.796062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:05.796062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:05.796062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:05.796062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:05.796062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:05.796062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:05.796062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:05.796062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:05.796062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:05.796062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:05.796062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:05.796062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:38:05.801306 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8a7d5-6d15-43d8-98e7-bf5ab69202d7 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:05.850005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cac556-d81f-40d7-9c61-f06c350dbd7f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:05.853056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:05.892896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:05.898345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec18a3-678f-4659-947d-4edef961ac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:05.899249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec18a3-678f-4659-947d-4edef961ac00 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:05.899533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec18a3-678f-4659-947d-4edef961ac00 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:05.899806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec18a3-678f-4659-947d-4edef961ac00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:05.910722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8a7d5-6d15-43d8-98e7-bf5ab69202d7 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:05.946585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506bf5c-0d6e-4248-821d-da3a11622251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:05.947256 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506bf5c-0d6e-4248-821d-da3a11622251 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:05.947583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506bf5c-0d6e-4248-821d-da3a11622251 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:05.947826 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506bf5c-0d6e-4248-821d-da3a11622251 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:05.948581 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506bf5c-0d6e-4248-821d-da3a11622251 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:05.948889 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506bf5c-0d6e-4248-821d-da3a11622251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:05.950334 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506bf5c-0d6e-4248-821d-da3a11622251 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:05.964216 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:05.969752 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506bf5c-0d6e-4248-821d-da3a11622251 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:05.970113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec18a3-678f-4659-947d-4edef961ac00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:05.971633 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec18a3-678f-4659-947d-4edef961ac00 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:06.081678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506bf5c-0d6e-4248-821d-da3a11622251 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:06.086666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:38:06.092309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec18a3-678f-4659-947d-4edef961ac00 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:06.095315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:06.117526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2354a-e604-46db-bf82-0ae45d1ff666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:06.118326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2354a-e604-46db-bf82-0ae45d1ff666 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:06.118606 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2354a-e604-46db-bf82-0ae45d1ff666 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:06.118881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2354a-e604-46db-bf82-0ae45d1ff666 None admin] PATH_INFO: `/v3/users/d4d342095f994d388541563ef9df90e3` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:06.120083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2354a-e604-46db-bf82-0ae45d1ff666 None admin] RBAC: Authorizing `identity:get_user(user_id=d4d342095f994d388541563ef9df90e3)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:06.121567 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2354a-e604-46db-bf82-0ae45d1ff666 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:06.123162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:05 2022] GET /identity/v3/users/d4d342095f994d388541563ef9df90e3 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:06.129243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2354a-e604-46db-bf82-0ae45d1ff666 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:06.143651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:06.194590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec18a3-678f-4659-947d-4edef961ac00 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:06.228799 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cf365-e65b-4450-8296-7fc0de3c5245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:06.229237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2354a-e604-46db-bf82-0ae45d1ff666 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:06.229616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cf365-e65b-4450-8296-7fc0de3c5245 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:06.229904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cf365-e65b-4450-8296-7fc0de3c5245 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:06.230181 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cf365-e65b-4450-8296-7fc0de3c5245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:06.249046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cf365-e65b-4450-8296-7fc0de3c5245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:06.250589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cf365-e65b-4450-8296-7fc0de3c5245 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:06.264620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e5534-9619-4f25-9386-aa0c83cd5d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:06.265442 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e5534-9619-4f25-9386-aa0c83cd5d6f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:06.265731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e5534-9619-4f25-9386-aa0c83cd5d6f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:06.266007 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e5534-9619-4f25-9386-aa0c83cd5d6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:06.267182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e5534-9619-4f25-9386-aa0c83cd5d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:06.268649 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e5534-9619-4f25-9386-aa0c83cd5d6f None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:06.270309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 10/18] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-f26cf365-e65b-4450-8296-7fc0de3c5245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:38:06.272410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:06.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:06.274230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:38:06.274230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:38:06.274230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:38:06.274230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:06.274230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 9/19] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:38:06.276557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e5534-9619-4f25-9386-aa0c83cd5d6f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:06.280358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cf365-e65b-4450-8296-7fc0de3c5245 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:06.341726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:06.362740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:06.385743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e5534-9619-4f25-9386-aa0c83cd5d6f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:06.386028 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cf365-e65b-4450-8296-7fc0de3c5245 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:06.416043 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9e415-73e4-466e-80e0-05c73b836e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:06.416700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9e415-73e4-466e-80e0-05c73b836e2b None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:06.416984 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9e415-73e4-466e-80e0-05c73b836e2b None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:06.417260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9e415-73e4-466e-80e0-05c73b836e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:06.418117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9e415-73e4-466e-80e0-05c73b836e2b None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.domain.id=default, user.id=d4d342095f994d388541563ef9df90e3) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:06.418431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9e415-73e4-466e-80e0-05c73b836e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:06.419716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdca05-19fe-4d36-a414-73218ceb6a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:06.419882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9e415-73e4-466e-80e0-05c73b836e2b None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:06.420376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdca05-19fe-4d36-a414-73218ceb6a3d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:06.420666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdca05-19fe-4d36-a414-73218ceb6a3d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:06.420948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdca05-19fe-4d36-a414-73218ceb6a3d None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:06.421718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdca05-19fe-4d36-a414-73218ceb6a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:06.422029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdca05-19fe-4d36-a414-73218ceb6a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:06.423427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdca05-19fe-4d36-a414-73218ceb6a3d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:06.426865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 11/20] 10.222.0.39 () {56 vars in 1322 bytes} [Tue May 31 20:38:06 2022] GET /identity/v3/role_assignments?user.id=d4d342095f994d388541563ef9df90e3&scope.domain.id=default&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:06.443907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 10/21] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:08.869682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4a7c-1ecd-4ec3-a546-b7b745ddf5c5 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:08.870714 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4a7c-1ecd-4ec3-a546-b7b745ddf5c5 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:08.871227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4a7c-1ecd-4ec3-a546-b7b745ddf5c5 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:08.872801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 12/22] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:08.878231 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5980406-1bcb-4eb9-8b2f-c874f16534d1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:08.879102 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5980406-1bcb-4eb9-8b2f-c874f16534d1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:08.879634 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5980406-1bcb-4eb9-8b2f-c874f16534d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:08.906414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e5980406-1bcb-4eb9-8b2f-c874f16534d1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:08.907926 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e5980406-1bcb-4eb9-8b2f-c874f16534d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:09.007072 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 11/23] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:09.041170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f4a7c-1ecd-4ec3-a546-b7b745ddf5c5 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:09.059235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3570db-5ff2-4e4a-9a03-12b07de59b4d None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:09.059521 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3570db-5ff2-4e4a-9a03-12b07de59b4d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:09.060014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3570db-5ff2-4e4a-9a03-12b07de59b4d None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:09.061994 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:09.071433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f9814-6f2f-4154-a704-54eb63bbcaf4 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:09.072355 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f9814-6f2f-4154-a704-54eb63bbcaf4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:09.072857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f9814-6f2f-4154-a704-54eb63bbcaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:09.104048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7c5f9814-6f2f-4154-a704-54eb63bbcaf4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:09.105612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7c5f9814-6f2f-4154-a704-54eb63bbcaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:09.193750 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:09.242252 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f4a7c-1ecd-4ec3-a546-b7b745ddf5c5 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:09.251985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 13/25] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:09.308380 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f9814-6f2f-4154-a704-54eb63bbcaf4 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:09.308939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd2964-6e2b-4dd5-a3dc-543bc9a69809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:09.313420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd2964-6e2b-4dd5-a3dc-543bc9a69809 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:09.313420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd2964-6e2b-4dd5-a3dc-543bc9a69809 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:09.313420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd2964-6e2b-4dd5-a3dc-543bc9a69809 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:09.346778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd2964-6e2b-4dd5-a3dc-543bc9a69809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-edcd2964-6e2b-4dd5-a3dc-543bc9a69809 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:09.355431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:09.356382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:09.357135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:09.357135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:09.357135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:09.357135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:09.357135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:09.357135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:09.357135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:09.357135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:09.357135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:09.357135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:09.357135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:09.357135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:09.366238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 13/26] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:38:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:09.367892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbe10e-24ea-4864-883c-0275c03e31ef None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:09.368477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbe10e-24ea-4864-883c-0275c03e31ef None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:09.368904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbe10e-24ea-4864-883c-0275c03e31ef None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:09.370613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 14/27] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:09.374597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbe10e-24ea-4864-883c-0275c03e31ef None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:09.380704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:09.458779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f9814-6f2f-4154-a704-54eb63bbcaf4 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:09.499974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21fd9f-7975-412b-8f6c-3b12e55ca2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:09.500774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21fd9f-7975-412b-8f6c-3b12e55ca2ed None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:09.501067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21fd9f-7975-412b-8f6c-3b12e55ca2ed None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:09.501350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21fd9f-7975-412b-8f6c-3b12e55ca2ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:09.528357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21fd9f-7975-412b-8f6c-3b12e55ca2ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:09.530000 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21fd9f-7975-412b-8f6c-3b12e55ca2ed None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-1a21fd9f-7975-412b-8f6c-3b12e55ca2ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:38:09.560096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:09.560977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:09.561825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:38:09.561825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:38:09.561825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:38:09.561825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:09.561825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 14/28] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:09.562796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68beca27-178a-47fa-9f80-98c2c573aa53 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:09.563252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68beca27-178a-47fa-9f80-98c2c573aa53 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:09.563730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68beca27-178a-47fa-9f80-98c2c573aa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:09.600370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-68beca27-178a-47fa-9f80-98c2c573aa53 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:09.602907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-68beca27-178a-47fa-9f80-98c2c573aa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:09.608676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbe10e-24ea-4864-883c-0275c03e31ef None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:09.657743 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:09.658574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f9645-d3c6-4a9f-a9a2-96c7970421a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:09.659209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f9645-d3c6-4a9f-a9a2-96c7970421a2 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:09.659502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f9645-d3c6-4a9f-a9a2-96c7970421a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:09.659787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f9645-d3c6-4a9f-a9a2-96c7970421a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:09.660553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f9645-d3c6-4a9f-a9a2-96c7970421a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:09.660866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f9645-d3c6-4a9f-a9a2-96c7970421a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:09.662318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f9645-d3c6-4a9f-a9a2-96c7970421a2 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:09.684288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 15/29] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:09.685168 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f9645-d3c6-4a9f-a9a2-96c7970421a2 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:09.744497 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 15/30] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:09.745271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68beca27-178a-47fa-9f80-98c2c573aa53 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:09.820583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:09.866995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f9645-d3c6-4a9f-a9a2-96c7970421a2 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:09.907746 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e54bb-d355-4878-99e1-94218b756f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:09.909953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e54bb-d355-4878-99e1-94218b756f17 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:09.910657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e54bb-d355-4878-99e1-94218b756f17 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:09.913120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e54bb-d355-4878-99e1-94218b756f17 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:09.914081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e54bb-d355-4878-99e1-94218b756f17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:09.914633 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e54bb-d355-4878-99e1-94218b756f17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:09.918123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e54bb-d355-4878-99e1-94218b756f17 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:09.946332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68beca27-178a-47fa-9f80-98c2c573aa53 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:09.952572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 16/31] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:09.958141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e54bb-d355-4878-99e1-94218b756f17 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:10.009138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba8e5d-6b07-420e-b51b-fc2d57e0f4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:10.010397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba8e5d-6b07-420e-b51b-fc2d57e0f4f5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:10.010852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba8e5d-6b07-420e-b51b-fc2d57e0f4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:10.011272 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba8e5d-6b07-420e-b51b-fc2d57e0f4f5 None admin] PATH_INFO: `/v3/users/d4d342095f994d388541563ef9df90e3` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:10.013194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba8e5d-6b07-420e-b51b-fc2d57e0f4f5 None admin] RBAC: Authorizing `identity:get_user(user_id=d4d342095f994d388541563ef9df90e3)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:10.015002 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba8e5d-6b07-420e-b51b-fc2d57e0f4f5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:10.016998 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 16/32] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:09 2022] GET /identity/v3/users/d4d342095f994d388541563ef9df90e3 => generated 247 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:10.018104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba8e5d-6b07-420e-b51b-fc2d57e0f4f5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:10.048989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:10.073744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e54bb-d355-4878-99e1-94218b756f17 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:10.104966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:10.115464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac2d1d-7f88-4e0a-9001-00efbcd6fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:10.116595 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac2d1d-7f88-4e0a-9001-00efbcd6fe5e None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:10.117096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac2d1d-7f88-4e0a-9001-00efbcd6fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:10.117604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac2d1d-7f88-4e0a-9001-00efbcd6fe5e None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:10.118581 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac2d1d-7f88-4e0a-9001-00efbcd6fe5e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:10.120202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac2d1d-7f88-4e0a-9001-00efbcd6fe5e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:10.133767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba8e5d-6b07-420e-b51b-fc2d57e0f4f5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:10.171332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247f254-39c0-4389-b634-e3f4611dde70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:10.172157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247f254-39c0-4389-b634-e3f4611dde70 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:10.172447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247f254-39c0-4389-b634-e3f4611dde70 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:10.172827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247f254-39c0-4389-b634-e3f4611dde70 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:10.173585 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247f254-39c0-4389-b634-e3f4611dde70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:10.175060 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247f254-39c0-4389-b634-e3f4611dde70 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:10.337322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 17/33] 10.222.0.39 () {60 vars in 1131 bytes} [Tue May 31 20:38:09 2022] POST /identity/v3/roles => generated 219 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:38:10.339067 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d519ef-6644-4433-97f5-0552cad0ee9d None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:10.339460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d519ef-6644-4433-97f5-0552cad0ee9d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:10.339899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d519ef-6644-4433-97f5-0552cad0ee9d None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:10.341337 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 18/34] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:10.342315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d519ef-6644-4433-97f5-0552cad0ee9d None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:10.413583 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 17/35] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:38:10 2022] POST /identity/v3/projects => generated 301 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:38:10.416949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67327a-edc4-4d97-9266-b9d5a81e9eae None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:10.417240 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67327a-edc4-4d97-9266-b9d5a81e9eae None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:10.418739 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67327a-edc4-4d97-9266-b9d5a81e9eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:10.467340 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-cb67327a-edc4-4d97-9266-b9d5a81e9eae None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:10.469132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cb67327a-edc4-4d97-9266-b9d5a81e9eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:10.558491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d519ef-6644-4433-97f5-0552cad0ee9d None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:10.625704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80028e-d1e6-4986-b101-99a269e6f3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:10.626450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80028e-d1e6-4986-b101-99a269e6f3a9 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:10.626740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80028e-d1e6-4986-b101-99a269e6f3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:10.627023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80028e-d1e6-4986-b101-99a269e6f3a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:10.630444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80028e-d1e6-4986-b101-99a269e6f3a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:10.632162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80028e-d1e6-4986-b101-99a269e6f3a9 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:10.633980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 19/36] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:10.640139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80028e-d1e6-4986-b101-99a269e6f3a9 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:10.651927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 18/37] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:10.686833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67327a-edc4-4d97-9266-b9d5a81e9eae None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:10.708508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:10.743179 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:10.823183 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80028e-d1e6-4986-b101-99a269e6f3a9 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:10.856183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67327a-edc4-4d97-9266-b9d5a81e9eae None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:10.867849 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf926c7-5001-41cc-b14d-7326c30bb4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:10.869121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf926c7-5001-41cc-b14d-7326c30bb4cd None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:10.869646 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf926c7-5001-41cc-b14d-7326c30bb4cd None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:10.870158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf926c7-5001-41cc-b14d-7326c30bb4cd None admin] PATH_INFO: `/v3/domains/default/users/d4d342095f994d388541563ef9df90e3/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:10.872635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf926c7-5001-41cc-b14d-7326c30bb4cd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d4d342095f994d388541563ef9df90e3, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:10.874589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf926c7-5001-41cc-b14d-7326c30bb4cd None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:10.907688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79cd5a-e1a0-4084-acc4-a84ff2cd3c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:10.908407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79cd5a-e1a0-4084-acc4-a84ff2cd3c7b None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:10.908577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79cd5a-e1a0-4084-acc4-a84ff2cd3c7b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:10.908854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79cd5a-e1a0-4084-acc4-a84ff2cd3c7b None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:10.909709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79cd5a-e1a0-4084-acc4-a84ff2cd3c7b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:10.911314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79cd5a-e1a0-4084-acc4-a84ff2cd3c7b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:10.958920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 20/38] 10.222.0.39 () {58 vars in 1361 bytes} [Tue May 31 20:38:10 2022] PUT /identity/v3/domains/default/users/d4d342095f994d388541563ef9df90e3/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:38:10.960527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6340820-199b-4e12-8924-424290e4404a None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:10.960825 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6340820-199b-4e12-8924-424290e4404a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:10.961112 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6340820-199b-4e12-8924-424290e4404a None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:10.962471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 21/39] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:10.963621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0b528-f456-448c-bc2a-79837ba78171 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:10.963913 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0b528-f456-448c-bc2a-79837ba78171 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:10.964265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0b528-f456-448c-bc2a-79837ba78171 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:10.965831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 22/40] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:10.971136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0621d2-20e0-40d7-8836-7a55b368b59f None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:10.971421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0621d2-20e0-40d7-8836-7a55b368b59f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:10.971700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0621d2-20e0-40d7-8836-7a55b368b59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:10.991512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 19/41] 10.222.0.39 () {60 vars in 1131 bytes} [Tue May 31 20:38:10 2022] POST /identity/v3/roles => generated 225 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:38:10.992880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65224e5f-574c-4cb8-a75e-2811535172f5 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:10.993175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65224e5f-574c-4cb8-a75e-2811535172f5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:10.993492 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65224e5f-574c-4cb8-a75e-2811535172f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:10.999576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-2f0621d2-20e0-40d7-8836-7a55b368b59f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:11.001322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2f0621d2-20e0-40d7-8836-7a55b368b59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:11.024317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-65224e5f-574c-4cb8-a75e-2811535172f5 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:11.025670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-65224e5f-574c-4cb8-a75e-2811535172f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:11.129515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 23/42] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:11.136029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:11.145834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 20/43] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:11.161749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0621d2-20e0-40d7-8836-7a55b368b59f None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:11.170953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65224e5f-574c-4cb8-a75e-2811535172f5 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:11.239758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:11.324722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0621d2-20e0-40d7-8836-7a55b368b59f None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:11.337785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65224e5f-574c-4cb8-a75e-2811535172f5 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:11.362806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956912b-0386-4c49-9afc-77fe1adb004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:11.363725 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956912b-0386-4c49-9afc-77fe1adb004c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:11.364636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956912b-0386-4c49-9afc-77fe1adb004c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:11.364984 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956912b-0386-4c49-9afc-77fe1adb004c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:11.366712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956912b-0386-4c49-9afc-77fe1adb004c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:11.368314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956912b-0386-4c49-9afc-77fe1adb004c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:11.370212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 24/44] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:11.375468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956912b-0386-4c49-9afc-77fe1adb004c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:11.382858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec095b6-34ad-4284-b26a-7dbe8869935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:11.383549 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec095b6-34ad-4284-b26a-7dbe8869935d None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:11.383835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec095b6-34ad-4284-b26a-7dbe8869935d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:11.384118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec095b6-34ad-4284-b26a-7dbe8869935d None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:11.384903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec095b6-34ad-4284-b26a-7dbe8869935d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:11.386349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec095b6-34ad-4284-b26a-7dbe8869935d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:11.475064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 21/45] 10.222.0.39 () {60 vars in 1131 bytes} [Tue May 31 20:38:11 2022] POST /identity/v3/roles => generated 223 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:38:11.502979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956912b-0386-4c49-9afc-77fe1adb004c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:11.526907 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:11.554541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734aac6-5309-4039-90f6-efb9e4af0f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:11.555237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734aac6-5309-4039-90f6-efb9e4af0f1e None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:11.555524 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734aac6-5309-4039-90f6-efb9e4af0f1e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:11.555808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734aac6-5309-4039-90f6-efb9e4af0f1e None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:11.556543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734aac6-5309-4039-90f6-efb9e4af0f1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:11.558112 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734aac6-5309-4039-90f6-efb9e4af0f1e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:11.662043 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 25/46] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:38:11 2022] POST /identity/v3/projects => generated 312 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:38:13.290378 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfeeb1-846c-40b5-9003-d203f1241c0f None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:13.290895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfeeb1-846c-40b5-9003-d203f1241c0f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:13.291005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfeeb1-846c-40b5-9003-d203f1241c0f None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:13.292318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 22/47] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:13.297822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074047f-b181-4c32-87bf-b17941d7e702 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:13.298387 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074047f-b181-4c32-87bf-b17941d7e702 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:13.298485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074047f-b181-4c32-87bf-b17941d7e702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:13.318828 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-1074047f-b181-4c32-87bf-b17941d7e702 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:13.320038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1074047f-b181-4c32-87bf-b17941d7e702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:13.390682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 26/48] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:13.413839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfeeb1-846c-40b5-9003-d203f1241c0f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:13.474574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:13.518468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfeeb1-846c-40b5-9003-d203f1241c0f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:13.565686 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fe23a-94ba-42ae-ad1a-111a72b0667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:13.566394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fe23a-94ba-42ae-ad1a-111a72b0667b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:13.566700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fe23a-94ba-42ae-ad1a-111a72b0667b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:13.566977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fe23a-94ba-42ae-ad1a-111a72b0667b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:13.578495 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fe23a-94ba-42ae-ad1a-111a72b0667b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-b49fe23a-94ba-42ae-ad1a-111a72b0667b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:13.587414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:13.589330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:13.591247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:13.591247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:13.591247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:13.591247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:13.591247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:13.591247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:13.591247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:13.591247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:13.591247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:13.591247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:13.591247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:13.591247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:13.591247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 23/49] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:38:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:13.595362 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074047f-b181-4c32-87bf-b17941d7e702 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:13.702223 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:13.709760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074047f-b181-4c32-87bf-b17941d7e702 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:13.745925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6e7f3-3e6a-4b21-9442-db9a2d78f33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:13.746602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6e7f3-3e6a-4b21-9442-db9a2d78f33e None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:13.746888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6e7f3-3e6a-4b21-9442-db9a2d78f33e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:13.747169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6e7f3-3e6a-4b21-9442-db9a2d78f33e None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:13.747931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6e7f3-3e6a-4b21-9442-db9a2d78f33e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:13.748242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6e7f3-3e6a-4b21-9442-db9a2d78f33e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:13.749676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6e7f3-3e6a-4b21-9442-db9a2d78f33e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:13.758964 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 27/50] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:13.764442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fe23a-94ba-42ae-ad1a-111a72b0667b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:13.878002 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fe23a-94ba-42ae-ad1a-111a72b0667b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:13.897296 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:13.916326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6f0bc-778b-44ef-a4b7-de0e3edb7a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:13.917359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6f0bc-778b-44ef-a4b7-de0e3edb7a8c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:13.917866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6f0bc-778b-44ef-a4b7-de0e3edb7a8c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:13.918349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6f0bc-778b-44ef-a4b7-de0e3edb7a8c None admin] PATH_INFO: `/v3/users/d4d342095f994d388541563ef9df90e3` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:13.920464 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6f0bc-778b-44ef-a4b7-de0e3edb7a8c None admin] RBAC: Authorizing `identity:get_user(user_id=d4d342095f994d388541563ef9df90e3)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:13.923310 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6f0bc-778b-44ef-a4b7-de0e3edb7a8c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:13.927235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 24/51] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:13 2022] GET /identity/v3/users/d4d342095f994d388541563ef9df90e3 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:13.934765 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6e7f3-3e6a-4b21-9442-db9a2d78f33e None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:13.989046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b362c-3ed1-4dfb-a2e9-2d382e1a5fe4 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:13.989342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b362c-3ed1-4dfb-a2e9-2d382e1a5fe4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:13.989675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b362c-3ed1-4dfb-a2e9-2d382e1a5fe4 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:13.991059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 25/52] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:13.996332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bba037-5a47-4424-a771-30e4b463db25 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:13.996627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bba037-5a47-4424-a771-30e4b463db25 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:13.996913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bba037-5a47-4424-a771-30e4b463db25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:14.018043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-61bba037-5a47-4424-a771-30e4b463db25 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:14.019266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-61bba037-5a47-4424-a771-30e4b463db25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:14.052182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6e7f3-3e6a-4b21-9442-db9a2d78f33e None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:14.089436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab80a4-c6da-46aa-bc29-0b1ffe0d34dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:14.090323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab80a4-c6da-46aa-bc29-0b1ffe0d34dc None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:14.090639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab80a4-c6da-46aa-bc29-0b1ffe0d34dc None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:14.090920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab80a4-c6da-46aa-bc29-0b1ffe0d34dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:14.092102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab80a4-c6da-46aa-bc29-0b1ffe0d34dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:14.093604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab80a4-c6da-46aa-bc29-0b1ffe0d34dc None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:14.095219 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 28/53] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:14.095650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 26/54] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:14.101661 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab80a4-c6da-46aa-bc29-0b1ffe0d34dc None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:14.119235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bba037-5a47-4424-a771-30e4b463db25 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:14.129343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:14.219661 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab80a4-c6da-46aa-bc29-0b1ffe0d34dc None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:14.222908 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bba037-5a47-4424-a771-30e4b463db25 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:14.241037 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:14.259921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2ae37-9dea-490e-82f5-f792ff7731a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:14.260590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2ae37-9dea-490e-82f5-f792ff7731a5 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:14.260713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2552ed-a55c-49b8-ab9c-a81d4bf62bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:14.260880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2ae37-9dea-490e-82f5-f792ff7731a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:14.261202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2ae37-9dea-490e-82f5-f792ff7731a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:14.261971 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2552ed-a55c-49b8-ab9c-a81d4bf62bc9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:14.262100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2ae37-9dea-490e-82f5-f792ff7731a5 None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.domain.id=default, user.id=d4d342095f994d388541563ef9df90e3) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:14.262454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2552ed-a55c-49b8-ab9c-a81d4bf62bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:14.262545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2ae37-9dea-490e-82f5-f792ff7731a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:14.262897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2552ed-a55c-49b8-ab9c-a81d4bf62bc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:14.264036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2ae37-9dea-490e-82f5-f792ff7731a5 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:14.264488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2552ed-a55c-49b8-ab9c-a81d4bf62bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:14.266339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2552ed-a55c-49b8-ab9c-a81d4bf62bc9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:14.268817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:14.270184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 29/56] 10.222.0.39 () {56 vars in 1322 bytes} [Tue May 31 20:38:14 2022] GET /identity/v3/role_assignments?user.id=d4d342095f994d388541563ef9df90e3&scope.domain.id=default&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 530 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:14.277461 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2552ed-a55c-49b8-ab9c-a81d4bf62bc9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:14.400000 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2552ed-a55c-49b8-ab9c-a81d4bf62bc9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:14.435822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10cbb5-2ac8-42ca-804c-b4b20243bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:14.436502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10cbb5-2ac8-42ca-804c-b4b20243bcf5 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:14.436789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10cbb5-2ac8-42ca-804c-b4b20243bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:14.437069 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10cbb5-2ac8-42ca-804c-b4b20243bcf5 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:14.437833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10cbb5-2ac8-42ca-804c-b4b20243bcf5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:14.439308 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10cbb5-2ac8-42ca-804c-b4b20243bcf5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:14.538821 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 28/57] 10.222.0.39 () {60 vars in 1140 bytes} [Tue May 31 20:38:14 2022] POST /identity/v3/projects => generated 298 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:38:16.758851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1565-6fc9-4e4e-913b-d5e458f7a475 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:16.759402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1565-6fc9-4e4e-913b-d5e458f7a475 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:16.759402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1565-6fc9-4e4e-913b-d5e458f7a475 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:16.760794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 30/58] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:16.765842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97434f4-32b5-4c97-9702-dfb4ffee240d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:16.766236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97434f4-32b5-4c97-9702-dfb4ffee240d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:16.766406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97434f4-32b5-4c97-9702-dfb4ffee240d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:16.782954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b97434f4-32b5-4c97-9702-dfb4ffee240d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:16.784135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b97434f4-32b5-4c97-9702-dfb4ffee240d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:16.813165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:16.852012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 29/59] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:16.876290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc1565-6fc9-4e4e-913b-d5e458f7a475 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:16.966743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:16.979050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc1565-6fc9-4e4e-913b-d5e458f7a475 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:17.013130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4e488-dfc0-430b-b57e-e9132a797034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:17.013879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e488-dfc0-430b-b57e-e9132a797034 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:17.014160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e488-dfc0-430b-b57e-e9132a797034 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:17.014432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e488-dfc0-430b-b57e-e9132a797034 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:17.015604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4e488-dfc0-430b-b57e-e9132a797034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:17.017042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4e488-dfc0-430b-b57e-e9132a797034 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:17.018666 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 31/60] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:17.024851 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97434f4-32b5-4c97-9702-dfb4ffee240d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:17.123813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97434f4-32b5-4c97-9702-dfb4ffee240d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:17.158791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca25e8-bbb6-4f3b-b88c-6c558195d983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:17.159471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca25e8-bbb6-4f3b-b88c-6c558195d983 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:17.159760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca25e8-bbb6-4f3b-b88c-6c558195d983 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:17.160099 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca25e8-bbb6-4f3b-b88c-6c558195d983 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:17.160830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca25e8-bbb6-4f3b-b88c-6c558195d983 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:17.162430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca25e8-bbb6-4f3b-b88c-6c558195d983 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:17.318215 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 30/61] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:38:17 2022] POST /identity/v3/users => generated 275 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:38:20.786537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9fd1b-5abe-41c6-ba1e-79fa59eb602b None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:20.787048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9fd1b-5abe-41c6-ba1e-79fa59eb602b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:20.787120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9fd1b-5abe-41c6-ba1e-79fa59eb602b None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:20.788477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 32/62] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:20.793959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ef909-3447-4522-89a8-a34105e8f93c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:20.794557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ef909-3447-4522-89a8-a34105e8f93c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:20.794557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ef909-3447-4522-89a8-a34105e8f93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:20.822512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-313ef909-3447-4522-89a8-a34105e8f93c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:20.823749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-313ef909-3447-4522-89a8-a34105e8f93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:20.848826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:20.922796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 31/63] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:20.963668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9fd1b-5abe-41c6-ba1e-79fa59eb602b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:20.987191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3752424-8637-4b03-8f89-1df74dcb2c86 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:20.988116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3752424-8637-4b03-8f89-1df74dcb2c86 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:20.988639 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3752424-8637-4b03-8f89-1df74dcb2c86 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:20.990802 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 32/64] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:20.995130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4af55-1ec6-4770-9715-c9a5f7ee5ae0 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:20.995666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4af55-1ec6-4770-9715-c9a5f7ee5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:20.996316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4af55-1ec6-4770-9715-c9a5f7ee5ae0 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:20.998395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 33/65] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:38:21.001235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795e253-15bc-4e99-a623-a454c4c02299 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.002121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795e253-15bc-4e99-a623-a454c4c02299 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.002762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795e253-15bc-4e99-a623-a454c4c02299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.023437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-6795e253-15bc-4e99-a623-a454c4c02299 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:21.024904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6795e253-15bc-4e99-a623-a454c4c02299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:21.087270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9fd1b-5abe-41c6-ba1e-79fa59eb602b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:21.104495 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 34/66] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:21.112123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8157572-0d0d-4e50-a730-2bdfc1bbf24a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.113516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8157572-0d0d-4e50-a730-2bdfc1bbf24a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.114062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8157572-0d0d-4e50-a730-2bdfc1bbf24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.131398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf2071-0e24-4eab-8474-d96070438ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:21.132086 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf2071-0e24-4eab-8474-d96070438ed5 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.132375 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf2071-0e24-4eab-8474-d96070438ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.132653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf2071-0e24-4eab-8474-d96070438ed5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.147531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d8157572-0d0d-4e50-a730-2bdfc1bbf24a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:21.148669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf2071-0e24-4eab-8474-d96070438ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:21.149304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d8157572-0d0d-4e50-a730-2bdfc1bbf24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-1ddf2071-0e24-4eab-8474-d96070438ed5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:21.156434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:21.157359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 33/67] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:21.158610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf2071-0e24-4eab-8474-d96070438ed5 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:21.179075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:21.231023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 35/68] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:21.231917 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8157572-0d0d-4e50-a730-2bdfc1bbf24a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:21.246936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:21.276164 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf2071-0e24-4eab-8474-d96070438ed5 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:21.314550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad7682-261b-4e63-b742-dbedd830ce43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:21.315361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad7682-261b-4e63-b742-dbedd830ce43 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.315676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad7682-261b-4e63-b742-dbedd830ce43 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.315948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad7682-261b-4e63-b742-dbedd830ce43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.326282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad7682-261b-4e63-b742-dbedd830ce43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-02ad7682-261b-4e63-b742-dbedd830ce43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:21.334462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:21.335453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:21.336267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:21.336267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:21.336267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:21.336267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:21.336267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:21.336267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:21.336267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:21.336267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:21.336267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:21.336267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:21.336267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:21.336267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:21.336842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8157572-0d0d-4e50-a730-2bdfc1bbf24a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:21.336910 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:38:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:21.336910 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134b93a-d572-48ab-a6e0-ab4e4fe79f69 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.337147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134b93a-d572-48ab-a6e0-ab4e4fe79f69 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.337489 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134b93a-d572-48ab-a6e0-ab4e4fe79f69 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.338638 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 35/70] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:21.339332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134b93a-d572-48ab-a6e0-ab4e4fe79f69 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:21.373787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6ad4f-0b88-4c00-8a69-714ed9faec3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:21.374461 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6ad4f-0b88-4c00-8a69-714ed9faec3c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.374751 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6ad4f-0b88-4c00-8a69-714ed9faec3c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.375032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6ad4f-0b88-4c00-8a69-714ed9faec3c None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.375784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6ad4f-0b88-4c00-8a69-714ed9faec3c None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:21.376095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6ad4f-0b88-4c00-8a69-714ed9faec3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:21.377519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6ad4f-0b88-4c00-8a69-714ed9faec3c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:21.388980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 36/71] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:21.390530 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1b9d2-3d94-4940-b0bc-ca6abcea38bf None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.390813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1b9d2-3d94-4940-b0bc-ca6abcea38bf None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.391118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1b9d2-3d94-4940-b0bc-ca6abcea38bf None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.392366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 37/72] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:21.393506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1b9d2-3d94-4940-b0bc-ca6abcea38bf None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:21.427531 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:21.451994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134b93a-d572-48ab-a6e0-ab4e4fe79f69 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:21.470506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:21.485835 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838872ac-9575-4e15-8a86-c2f3227fa199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:21.486632 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838872ac-9575-4e15-8a86-c2f3227fa199 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.486920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838872ac-9575-4e15-8a86-c2f3227fa199 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.487201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838872ac-9575-4e15-8a86-c2f3227fa199 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.497248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1b9d2-3d94-4940-b0bc-ca6abcea38bf None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:21.498293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838872ac-9575-4e15-8a86-c2f3227fa199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-838872ac-9575-4e15-8a86-c2f3227fa199 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:21.506635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:21.507539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:21.508294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:21.508294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:21.508294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:21.508294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:21.508294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:21.508294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:21.508294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:21.508294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:21.508294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:21.508294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:21.508294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:21.508294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:21.508294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 36/73] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:38:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:21.509129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7ee70-df24-4721-84c1-372bfc68fd9c None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.509502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7ee70-df24-4721-84c1-372bfc68fd9c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.509686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7ee70-df24-4721-84c1-372bfc68fd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.526758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-f1d7ee70-df24-4721-84c1-372bfc68fd9c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:21.527972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-f1d7ee70-df24-4721-84c1-372bfc68fd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:21.535274 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197759b1-0f8b-46dd-8eee-d47028ba1a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:21.535940 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197759b1-0f8b-46dd-8eee-d47028ba1a40 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.536222 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197759b1-0f8b-46dd-8eee-d47028ba1a40 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.536497 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197759b1-0f8b-46dd-8eee-d47028ba1a40 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.537248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197759b1-0f8b-46dd-8eee-d47028ba1a40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:21.537590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197759b1-0f8b-46dd-8eee-d47028ba1a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:21.538987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197759b1-0f8b-46dd-8eee-d47028ba1a40 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:21.547277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 38/74] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:38:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:21.548061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197759b1-0f8b-46dd-8eee-d47028ba1a40 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:21.598874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 37/75] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:21.600350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d574a-f907-4329-904e-84bea7369c93 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.600640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d574a-f907-4329-904e-84bea7369c93 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.600917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d574a-f907-4329-904e-84bea7369c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.625433 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-177d574a-f907-4329-904e-84bea7369c93 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:21.626638 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-177d574a-f907-4329-904e-84bea7369c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:21.654838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197759b1-0f8b-46dd-8eee-d47028ba1a40 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:21.685744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:21.687962 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdf414-b10e-4f42-a8b4-0a845851dda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:21.688842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdf414-b10e-4f42-a8b4-0a845851dda8 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.689133 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdf414-b10e-4f42-a8b4-0a845851dda8 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.689431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdf414-b10e-4f42-a8b4-0a845851dda8 None admin] PATH_INFO: `/v3/users/f181777203f94db981ca69cf76ab0e44` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.692780 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:21.693695 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 38/76] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:21.694393 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d574a-f907-4329-904e-84bea7369c93 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:21.705989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdf414-b10e-4f42-a8b4-0a845851dda8 None admin] RBAC: Authorizing `identity:get_user(user_id=f181777203f94db981ca69cf76ab0e44)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:21.708463 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdf414-b10e-4f42-a8b4-0a845851dda8 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:21.714732 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 39/77] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:21 2022] GET /identity/v3/users/f181777203f94db981ca69cf76ab0e44 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:21.714732 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdf414-b10e-4f42-a8b4-0a845851dda8 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:21.801162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d574a-f907-4329-904e-84bea7369c93 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:21.814251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdf414-b10e-4f42-a8b4-0a845851dda8 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:21.837684 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff851a9-9e33-4771-ac0d-bdd15011b988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:21.838369 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff851a9-9e33-4771-ac0d-bdd15011b988 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.838658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff851a9-9e33-4771-ac0d-bdd15011b988 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.838943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff851a9-9e33-4771-ac0d-bdd15011b988 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.839709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff851a9-9e33-4771-ac0d-bdd15011b988 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:21.840021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff851a9-9e33-4771-ac0d-bdd15011b988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:21.841486 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff851a9-9e33-4771-ac0d-bdd15011b988 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:21.850573 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61136e9c-df4e-40db-9cfd-577684508db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:21.851056 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 39/78] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:21.851380 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61136e9c-df4e-40db-9cfd-577684508db5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.851662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61136e9c-df4e-40db-9cfd-577684508db5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.851924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff851a9-9e33-4771-ac0d-bdd15011b988 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:21.852035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61136e9c-df4e-40db-9cfd-577684508db5 None admin] PATH_INFO: `/v3/users/f181777203f94db981ca69cf76ab0e44` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.853268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61136e9c-df4e-40db-9cfd-577684508db5 None admin] RBAC: Authorizing `identity:get_user(user_id=f181777203f94db981ca69cf76ab0e44)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:21.854779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61136e9c-df4e-40db-9cfd-577684508db5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:21.856627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 40/79] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:21 2022] GET /identity/v3/users/f181777203f94db981ca69cf76ab0e44 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:21.857492 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61136e9c-df4e-40db-9cfd-577684508db5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:21.910974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:21.918464 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:21.952705 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff851a9-9e33-4771-ac0d-bdd15011b988 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:21.956842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61136e9c-df4e-40db-9cfd-577684508db5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:21.996326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94419526-66e0-45d2-a886-2f83f7f544c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:21.996709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3395587-eaea-4070-beff-d008ca45f228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:21.996983 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94419526-66e0-45d2-a886-2f83f7f544c9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.997274 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94419526-66e0-45d2-a886-2f83f7f544c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.997537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3395587-eaea-4070-beff-d008ca45f228 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:21.997630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94419526-66e0-45d2-a886-2f83f7f544c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.997824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3395587-eaea-4070-beff-d008ca45f228 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:21.998102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3395587-eaea-4070-beff-d008ca45f228 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:21.999289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3395587-eaea-4070-beff-d008ca45f228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:22.000766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3395587-eaea-4070-beff-d008ca45f228 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:22.002419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 40/80] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:22.003180 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3395587-eaea-4070-beff-d008ca45f228 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:22.067530 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94419526-66e0-45d2-a886-2f83f7f544c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:22.069008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94419526-66e0-45d2-a886-2f83f7f544c9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:22.103184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3395587-eaea-4070-beff-d008ca45f228 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:22.127069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:22.127520 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:22.136121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaf378-3439-42d1-aa7c-590779001605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:22.136919 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaf378-3439-42d1-aa7c-590779001605 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:22.137200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaf378-3439-42d1-aa7c-590779001605 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:22.137512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaf378-3439-42d1-aa7c-590779001605 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:22.148603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaf378-3439-42d1-aa7c-590779001605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-addaf378-3439-42d1-aa7c-590779001605 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:22.156170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:22.157042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:22.157921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:22.157921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:22.157921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:22.157921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:22.157921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:22.157921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:22.157921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:22.157921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:22.157921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:22.157921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:22.157921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:22.157921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:22.157921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 41/81] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:22.158562 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaf378-3439-42d1-aa7c-590779001605 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:22.169509 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 41/82] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:22.170364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94419526-66e0-45d2-a886-2f83f7f544c9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:22.262074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaf378-3439-42d1-aa7c-590779001605 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:22.270460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94419526-66e0-45d2-a886-2f83f7f544c9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:22.296199 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4609ff-77ff-4153-bedc-405148fd82f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:22.297076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4609ff-77ff-4153-bedc-405148fd82f1 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:22.297363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4609ff-77ff-4153-bedc-405148fd82f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:22.297691 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4609ff-77ff-4153-bedc-405148fd82f1 None admin] PATH_INFO: `/v3/users/d4d342095f994d388541563ef9df90e3` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:22.298881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4609ff-77ff-4153-bedc-405148fd82f1 None admin] RBAC: Authorizing `identity:get_user(user_id=d4d342095f994d388541563ef9df90e3)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:22.300886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4609ff-77ff-4153-bedc-405148fd82f1 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:22.302556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 42/83] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:22 2022] GET /identity/v3/users/d4d342095f994d388541563ef9df90e3 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:22.303316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4609ff-77ff-4153-bedc-405148fd82f1 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:22.311135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62646ef-61d7-465a-84fa-1c95d7d8d297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:22.311891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62646ef-61d7-465a-84fa-1c95d7d8d297 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:22.312190 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62646ef-61d7-465a-84fa-1c95d7d8d297 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:22.312605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62646ef-61d7-465a-84fa-1c95d7d8d297 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:22.344028 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:22.363833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:22.382278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62646ef-61d7-465a-84fa-1c95d7d8d297 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:22.383784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62646ef-61d7-465a-84fa-1c95d7d8d297 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:22.406383 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4609ff-77ff-4153-bedc-405148fd82f1 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:22.441429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2a25a-79e7-48ef-adfd-6f585a174f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:22.442106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a25a-79e7-48ef-adfd-6f585a174f77 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:22.442393 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a25a-79e7-48ef-adfd-6f585a174f77 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:22.442672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a25a-79e7-48ef-adfd-6f585a174f77 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:22.443379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2a25a-79e7-48ef-adfd-6f585a174f77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:22.444831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2a25a-79e7-48ef-adfd-6f585a174f77 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:22.480262 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 42/84] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:22.481184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62646ef-61d7-465a-84fa-1c95d7d8d297 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:22.540154 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:22.567632 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 43/85] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:38:22 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:38:22.568487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2a25a-79e7-48ef-adfd-6f585a174f77 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:22.579028 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62646ef-61d7-465a-84fa-1c95d7d8d297 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:22.621255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099a582-45cd-453f-b0f9-108a19a08363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:22.622212 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099a582-45cd-453f-b0f9-108a19a08363 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:22.622505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099a582-45cd-453f-b0f9-108a19a08363 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:22.622787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099a582-45cd-453f-b0f9-108a19a08363 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:22.623557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099a582-45cd-453f-b0f9-108a19a08363 None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:22.623875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099a582-45cd-453f-b0f9-108a19a08363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:22.625338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099a582-45cd-453f-b0f9-108a19a08363 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:22.640969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 43/86] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:22.640969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099a582-45cd-453f-b0f9-108a19a08363 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:22.692395 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2a25a-79e7-48ef-adfd-6f585a174f77 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:22.704184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:22.731092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9f770-9059-4251-9720-c890f5b46511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:22.731977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9f770-9059-4251-9720-c890f5b46511 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:22.732273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9f770-9059-4251-9720-c890f5b46511 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:22.732539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9f770-9059-4251-9720-c890f5b46511 None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:22.733828 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9f770-9059-4251-9720-c890f5b46511 None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:22.735320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9f770-9059-4251-9720-c890f5b46511 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:22.737120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 44/87] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:22 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:22.737951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9f770-9059-4251-9720-c890f5b46511 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:22.762471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099a582-45cd-453f-b0f9-108a19a08363 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:22.790494 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:22.805344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fe9eb-20b4-4873-a3a8-6c6e235e9c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:22.806086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fe9eb-20b4-4873-a3a8-6c6e235e9c33 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:22.806375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fe9eb-20b4-4873-a3a8-6c6e235e9c33 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:22.806659 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fe9eb-20b4-4873-a3a8-6c6e235e9c33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:22.908460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9f770-9059-4251-9720-c890f5b46511 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:22.950149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fe9eb-20b4-4873-a3a8-6c6e235e9c33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:22.951686 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fe9eb-20b4-4873-a3a8-6c6e235e9c33 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:22.956754 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6102-cec0-4717-a141-7f38e8485d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:22.957975 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6102-cec0-4717-a141-7f38e8485d0a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:22.958303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6102-cec0-4717-a141-7f38e8485d0a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:22.958589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6102-cec0-4717-a141-7f38e8485d0a None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:22.959876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d6102-cec0-4717-a141-7f38e8485d0a None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:22.961966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d6102-cec0-4717-a141-7f38e8485d0a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:22.964779 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 45/88] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:22 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:22.965684 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6102-cec0-4717-a141-7f38e8485d0a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:23.028816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:23.060527 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 44/89] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:23.061329 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fe9eb-20b4-4873-a3a8-6c6e235e9c33 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:23.091628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:23.109778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6102-cec0-4717-a141-7f38e8485d0a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:23.150423 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99150eb-9ff0-4605-95c1-0acb4397b152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:23.151701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99150eb-9ff0-4605-95c1-0acb4397b152 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:23.152212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99150eb-9ff0-4605-95c1-0acb4397b152 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:23.152722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99150eb-9ff0-4605-95c1-0acb4397b152 None admin] PATH_INFO: `/v3/users/f181777203f94db981ca69cf76ab0e44` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:23.154162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99150eb-9ff0-4605-95c1-0acb4397b152 None admin] RBAC: Authorizing `identity:get_user(user_id=f181777203f94db981ca69cf76ab0e44)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:23.155823 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99150eb-9ff0-4605-95c1-0acb4397b152 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:23.157775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 46/90] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:22 2022] GET /identity/v3/users/f181777203f94db981ca69cf76ab0e44 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:23.158873 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99150eb-9ff0-4605-95c1-0acb4397b152 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:23.171778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fe9eb-20b4-4873-a3a8-6c6e235e9c33 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:23.210038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41fcb0-7202-46c9-9740-fb4a1e4aaa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:23.210728 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41fcb0-7202-46c9-9740-fb4a1e4aaa81 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:23.211015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41fcb0-7202-46c9-9740-fb4a1e4aaa81 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:23.211293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41fcb0-7202-46c9-9740-fb4a1e4aaa81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:23.212126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41fcb0-7202-46c9-9740-fb4a1e4aaa81 None admin] RBAC: Adding query filter params (role.id=32086f06b98341f09220be9a203efcb7, scope.project.id=c9ce5e803e154d27aaf0235fa210da97, user.id=f181777203f94db981ca69cf76ab0e44) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:23.212437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41fcb0-7202-46c9-9740-fb4a1e4aaa81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:23.213910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41fcb0-7202-46c9-9740-fb4a1e4aaa81 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:23.223138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 45/91] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:23 2022] GET /identity/v3/role_assignments?user.id=f181777203f94db981ca69cf76ab0e44&scope.project.id=c9ce5e803e154d27aaf0235fa210da97&role.id=32086f06b98341f09220be9a203efcb7 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:23.224046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41fcb0-7202-46c9-9740-fb4a1e4aaa81 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:23.292759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99150eb-9ff0-4605-95c1-0acb4397b152 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:23.324690 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:23.333760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:23.338531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41fcb0-7202-46c9-9740-fb4a1e4aaa81 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:23.357410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431dfa6-7aa8-4459-a898-d259eb9f694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:23.362823 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431dfa6-7aa8-4459-a898-d259eb9f694d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:23.363123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431dfa6-7aa8-4459-a898-d259eb9f694d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:23.363391 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431dfa6-7aa8-4459-a898-d259eb9f694d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:23.364242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431dfa6-7aa8-4459-a898-d259eb9f694d None admin] RBAC: Adding query filter params (role.id=cf5f891b636947e0840ddfa871027fed, scope.project.id=c9ce5e803e154d27aaf0235fa210da97, user.id=f181777203f94db981ca69cf76ab0e44) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:23.364557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431dfa6-7aa8-4459-a898-d259eb9f694d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:23.366083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431dfa6-7aa8-4459-a898-d259eb9f694d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:23.372083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 47/92] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:23 2022] GET /identity/v3/role_assignments?user.id=f181777203f94db981ca69cf76ab0e44&scope.project.id=c9ce5e803e154d27aaf0235fa210da97&role.id=cf5f891b636947e0840ddfa871027fed => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:23.379373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431dfa6-7aa8-4459-a898-d259eb9f694d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:23.405472 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056400e4-8003-44ef-a465-001d4b5f8066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:23.406363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056400e4-8003-44ef-a465-001d4b5f8066 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:23.406650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056400e4-8003-44ef-a465-001d4b5f8066 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:23.406926 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056400e4-8003-44ef-a465-001d4b5f8066 None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:23.414445 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056400e4-8003-44ef-a465-001d4b5f8066 None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:23.415855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056400e4-8003-44ef-a465-001d4b5f8066 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:23.418158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 46/93] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:23 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:23.424859 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056400e4-8003-44ef-a465-001d4b5f8066 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:23.591564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431dfa6-7aa8-4459-a898-d259eb9f694d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:23.600530 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056400e4-8003-44ef-a465-001d4b5f8066 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:23.648651 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9f042-643e-4328-aee1-5dcace3fae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:23.649733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9f042-643e-4328-aee1-5dcace3fae52 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:23.650238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9f042-643e-4328-aee1-5dcace3fae52 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:23.650785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9f042-643e-4328-aee1-5dcace3fae52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:23.651870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9f042-643e-4328-aee1-5dcace3fae52 None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=c9ce5e803e154d27aaf0235fa210da97, user.id=d4d342095f994d388541563ef9df90e3) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:23.652461 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9f042-643e-4328-aee1-5dcace3fae52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:23.654218 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9f042-643e-4328-aee1-5dcace3fae52 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:23.661518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 47/94] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:23 2022] GET /identity/v3/role_assignments?user.id=d4d342095f994d388541563ef9df90e3&scope.project.id=c9ce5e803e154d27aaf0235fa210da97&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:23.704352 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e6967-2c3b-43bc-983b-ed7bb0d9c0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:23.704954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e6967-2c3b-43bc-983b-ed7bb0d9c0bd None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:23.705330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e6967-2c3b-43bc-983b-ed7bb0d9c0bd None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:23.705699 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e6967-2c3b-43bc-983b-ed7bb0d9c0bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:23.764137 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:23.788279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e6967-2c3b-43bc-983b-ed7bb0d9c0bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:23.789802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e6967-2c3b-43bc-983b-ed7bb0d9c0bd None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:23.914296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 48/95] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:23.920081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9f042-643e-4328-aee1-5dcace3fae52 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:23.964058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:24.073781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9f042-643e-4328-aee1-5dcace3fae52 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:24.115522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2b4e7-aca3-4557-b33f-5e77680621a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:24.116770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2b4e7-aca3-4557-b33f-5e77680621a7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:24.117260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2b4e7-aca3-4557-b33f-5e77680621a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:24.117762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2b4e7-aca3-4557-b33f-5e77680621a7 None admin] PATH_INFO: `/v3/projects/97b09e1d27844288ae3c4df4e4e4a721` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:24.119197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2b4e7-aca3-4557-b33f-5e77680621a7 None admin] RBAC: Authorizing `identity:get_project(project_id=97b09e1d27844288ae3c4df4e4e4a721)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:24.120850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2b4e7-aca3-4557-b33f-5e77680621a7 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:24.122842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 48/96] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:23 2022] GET /identity/v3/projects/97b09e1d27844288ae3c4df4e4e4a721 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:24.128804 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e6967-2c3b-43bc-983b-ed7bb0d9c0bd None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:24.228848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:24.260264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e6967-2c3b-43bc-983b-ed7bb0d9c0bd None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:24.344744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56847764-40c5-4ed3-8916-bd7c5ba403b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:24.345432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56847764-40c5-4ed3-8916-bd7c5ba403b2 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:24.345865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56847764-40c5-4ed3-8916-bd7c5ba403b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:24.346148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56847764-40c5-4ed3-8916-bd7c5ba403b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:24.347018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56847764-40c5-4ed3-8916-bd7c5ba403b2 None admin] RBAC: Adding query filter params (role.id=32086f06b98341f09220be9a203efcb7, scope.project.id=97b09e1d27844288ae3c4df4e4e4a721, user.id=f181777203f94db981ca69cf76ab0e44) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:24.347332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56847764-40c5-4ed3-8916-bd7c5ba403b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:24.348774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56847764-40c5-4ed3-8916-bd7c5ba403b2 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:24.357677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 49/97] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:24 2022] GET /identity/v3/role_assignments?user.id=f181777203f94db981ca69cf76ab0e44&scope.project.id=97b09e1d27844288ae3c4df4e4e4a721&role.id=32086f06b98341f09220be9a203efcb7 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:25.673948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361e2b-4912-4daf-867c-0059ac72e745 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:25.674994 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361e2b-4912-4daf-867c-0059ac72e745 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:25.675517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361e2b-4912-4daf-867c-0059ac72e745 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:25.677423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 49/98] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:25.682747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eeb7e-6116-467b-8c20-acbbbb080664 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:25.683586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eeb7e-6116-467b-8c20-acbbbb080664 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:25.684078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eeb7e-6116-467b-8c20-acbbbb080664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:25.708266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-c10eeb7e-6116-467b-8c20-acbbbb080664 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:25.709805 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c10eeb7e-6116-467b-8c20-acbbbb080664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:25.727026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b645d3-afcd-469f-80e6-1c3ff8e12d04 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:25.727634 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b645d3-afcd-469f-80e6-1c3ff8e12d04 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:25.728110 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b645d3-afcd-469f-80e6-1c3ff8e12d04 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:25.729744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 50/99] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:38:25.735175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ac181-cbf2-4691-89da-c28421b865f5 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:25.735713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ac181-cbf2-4691-89da-c28421b865f5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:25.736189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ac181-cbf2-4691-89da-c28421b865f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:25.753800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-1a7ac181-cbf2-4691-89da-c28421b865f5 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:25.755315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1a7ac181-cbf2-4691-89da-c28421b865f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:25.812647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 50/100] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:25.826150 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 51/101] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:25.850307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ac181-cbf2-4691-89da-c28421b865f5 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:25.852768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10eeb7e-6116-467b-8c20-acbbbb080664 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:25.904243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:25.975801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:26.014210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10eeb7e-6116-467b-8c20-acbbbb080664 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:26.059819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b702a-2e47-425e-b65c-4b55fa85b976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:26.060693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b702a-2e47-425e-b65c-4b55fa85b976 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:26.060992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b702a-2e47-425e-b65c-4b55fa85b976 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:26.061278 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b702a-2e47-425e-b65c-4b55fa85b976 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:26.078952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ac181-cbf2-4691-89da-c28421b865f5 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:26.098353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b702a-2e47-425e-b65c-4b55fa85b976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-279b702a-2e47-425e-b65c-4b55fa85b976 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:26.114309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:26.115209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:26.116458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:26.116458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:26.116458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:26.116458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:26.116458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:26.116458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:26.116458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:26.116458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:26.116458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:26.116458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:26.116458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:26.116458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:26.116458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 51/102] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:26.125170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b702a-2e47-425e-b65c-4b55fa85b976 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:26.165553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705df649-085e-450a-b3df-710be75fa6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:26.166385 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df649-085e-450a-b3df-710be75fa6fc None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:26.166672 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df649-085e-450a-b3df-710be75fa6fc None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:26.166955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df649-085e-450a-b3df-710be75fa6fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:26.168232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705df649-085e-450a-b3df-710be75fa6fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:26.169803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705df649-085e-450a-b3df-710be75fa6fc None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:26.171544 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 52/103] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:26.178094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705df649-085e-450a-b3df-710be75fa6fc None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:26.384033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705df649-085e-450a-b3df-710be75fa6fc None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:26.391675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:26.399829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b702a-2e47-425e-b65c-4b55fa85b976 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:26.445781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25889ef1-3caa-44bc-b579-24a854be4b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:26.446799 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25889ef1-3caa-44bc-b579-24a854be4b7f None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:26.447304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25889ef1-3caa-44bc-b579-24a854be4b7f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:26.447771 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25889ef1-3caa-44bc-b579-24a854be4b7f None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:26.448684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25889ef1-3caa-44bc-b579-24a854be4b7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:26.450393 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25889ef1-3caa-44bc-b579-24a854be4b7f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:26.475535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:26.484554 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a778df3-fa1a-4ff3-91ac-f3ca254e868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:26.485394 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a778df3-fa1a-4ff3-91ac-f3ca254e868a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:26.485743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a778df3-fa1a-4ff3-91ac-f3ca254e868a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:26.486179 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a778df3-fa1a-4ff3-91ac-f3ca254e868a None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:26.487247 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a778df3-fa1a-4ff3-91ac-f3ca254e868a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:26.487683 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a778df3-fa1a-4ff3-91ac-f3ca254e868a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:26.489166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a778df3-fa1a-4ff3-91ac-f3ca254e868a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:26.500541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 52/104] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:26.506778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a778df3-fa1a-4ff3-91ac-f3ca254e868a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:26.625409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a778df3-fa1a-4ff3-91ac-f3ca254e868a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:26.645427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 53/105] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:38:26 2022] POST /identity/v3/projects => generated 302 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:38:26.677939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481380f8-4669-4abd-9ede-1baf8ce80b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:26.678850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481380f8-4669-4abd-9ede-1baf8ce80b3d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:26.679139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481380f8-4669-4abd-9ede-1baf8ce80b3d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:26.679424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481380f8-4669-4abd-9ede-1baf8ce80b3d None admin] PATH_INFO: `/v3/users/d0da1d125d574419bd4df682c853c871` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:26.702339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481380f8-4669-4abd-9ede-1baf8ce80b3d None admin] RBAC: Authorizing `identity:get_user(user_id=d0da1d125d574419bd4df682c853c871)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:26.702969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe84377-eee7-4a3a-a860-866e2f0ba2fb None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:26.702969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe84377-eee7-4a3a-a860-866e2f0ba2fb None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:26.703365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe84377-eee7-4a3a-a860-866e2f0ba2fb None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:26.703863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481380f8-4669-4abd-9ede-1baf8ce80b3d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:26.704414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 54/106] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:26.706426 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 53/107] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:26 2022] GET /identity/v3/users/d0da1d125d574419bd4df682c853c871 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:26.712297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481380f8-4669-4abd-9ede-1baf8ce80b3d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:26.712772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee036-a309-41c0-820a-446a79d3511b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:26.713066 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee036-a309-41c0-820a-446a79d3511b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:26.713349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee036-a309-41c0-820a-446a79d3511b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:26.748229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d91ee036-a309-41c0-820a-446a79d3511b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:26.749709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d91ee036-a309-41c0-820a-446a79d3511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:26.821825 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:26.937983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481380f8-4669-4abd-9ede-1baf8ce80b3d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:26.941323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 55/108] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:26.943135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c6eaa-d7cd-4471-9f49-634d8479a973 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:26.943645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c6eaa-d7cd-4471-9f49-634d8479a973 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:26.944130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c6eaa-d7cd-4471-9f49-634d8479a973 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:26.945647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 56/109] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:26.951248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485403b-28a5-4a8b-a47f-0a46adf0e802 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:26.951806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485403b-28a5-4a8b-a47f-0a46adf0e802 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:26.952306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485403b-28a5-4a8b-a47f-0a46adf0e802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:26.974060 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-0485403b-28a5-4a8b-a47f-0a46adf0e802 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:26.975648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0485403b-28a5-4a8b-a47f-0a46adf0e802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:27.000268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9c860-132e-4adf-b480-9b372dd49e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:27.000998 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9c860-132e-4adf-b480-9b372dd49e81 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:27.002947 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9c860-132e-4adf-b480-9b372dd49e81 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:27.002947 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9c860-132e-4adf-b480-9b372dd49e81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:27.069778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:27.077612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 57/110] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:27.085496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485403b-28a5-4a8b-a47f-0a46adf0e802 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:27.093801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9c860-132e-4adf-b480-9b372dd49e81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:27.095419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9c860-132e-4adf-b480-9b372dd49e81 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:27.211925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:27.280403 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485403b-28a5-4a8b-a47f-0a46adf0e802 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:27.286128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 54/111] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:38:27.287077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9c860-132e-4adf-b480-9b372dd49e81 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:27.320354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0ca11-edf6-4ac2-a6f0-b8f733ac5723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:27.321353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0ca11-edf6-4ac2-a6f0-b8f733ac5723 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:27.321767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0ca11-edf6-4ac2-a6f0-b8f733ac5723 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:27.322149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0ca11-edf6-4ac2-a6f0-b8f733ac5723 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:27.334703 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0ca11-edf6-4ac2-a6f0-b8f733ac5723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-aee0ca11-edf6-4ac2-a6f0-b8f733ac5723 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:27.342698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:27.343757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:27.344547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:27.344547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:27.344547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:27.344547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:27.344547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:27.344547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:27.344547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:27.344547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:27.344547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:27.344547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:27.344547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:27.344547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:27.344547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 58/112] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:27.348933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0ca11-edf6-4ac2-a6f0-b8f733ac5723 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:27.421211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:27.426015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9c860-132e-4adf-b480-9b372dd49e81 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:27.467732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc8f40-16ce-4951-8848-82960dc1e0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:27.468824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc8f40-16ce-4951-8848-82960dc1e0d3 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:27.469315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc8f40-16ce-4951-8848-82960dc1e0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:27.469818 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc8f40-16ce-4951-8848-82960dc1e0d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:27.480622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0ca11-edf6-4ac2-a6f0-b8f733ac5723 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:27.483684 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc8f40-16ce-4951-8848-82960dc1e0d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-05cc8f40-16ce-4951-8848-82960dc1e0d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:27.493608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:27.494631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:27.495416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:27.495416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:27.495416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:27.495416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:27.495416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:27.495416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:27.495416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:27.495416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:27.495416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:27.495416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:27.495416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:27.495416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:27.498057 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 55/113] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:38:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:27.499314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc8f40-16ce-4951-8848-82960dc1e0d3 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:27.525239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:27.526054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85266b0-0425-433b-97c8-25c593f9dabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:27.527297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85266b0-0425-433b-97c8-25c593f9dabe None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:27.527944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85266b0-0425-433b-97c8-25c593f9dabe None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:27.528437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85266b0-0425-433b-97c8-25c593f9dabe None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:27.530194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85266b0-0425-433b-97c8-25c593f9dabe None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:27.532017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85266b0-0425-433b-97c8-25c593f9dabe None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:27.534381 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 59/114] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:27 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:27.535831 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f14a3-7891-4638-b095-c5e7b8d2481f None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:27.536293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f14a3-7891-4638-b095-c5e7b8d2481f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:27.536741 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f14a3-7891-4638-b095-c5e7b8d2481f None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:27.538277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 60/115] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:27.541066 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f14a3-7891-4638-b095-c5e7b8d2481f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:27.631105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc8f40-16ce-4951-8848-82960dc1e0d3 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:27.667864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb33f71-8e8f-4d85-879c-0c1419b647e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:27.668900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb33f71-8e8f-4d85-879c-0c1419b647e4 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:27.669481 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb33f71-8e8f-4d85-879c-0c1419b647e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:27.669989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb33f71-8e8f-4d85-879c-0c1419b647e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:27.670765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f14a3-7891-4638-b095-c5e7b8d2481f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:27.671256 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb33f71-8e8f-4d85-879c-0c1419b647e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:27.671834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb33f71-8e8f-4d85-879c-0c1419b647e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:27.673564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb33f71-8e8f-4d85-879c-0c1419b647e4 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:27.683786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 56/116] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:27.689619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb33f71-8e8f-4d85-879c-0c1419b647e4 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:27.702259 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:27.711516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7486413-3137-4fdb-a969-9e05e7de31f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:27.718008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7486413-3137-4fdb-a969-9e05e7de31f8 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:27.718008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7486413-3137-4fdb-a969-9e05e7de31f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:27.718008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7486413-3137-4fdb-a969-9e05e7de31f8 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:27.718008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7486413-3137-4fdb-a969-9e05e7de31f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:27.718008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7486413-3137-4fdb-a969-9e05e7de31f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:27.718008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7486413-3137-4fdb-a969-9e05e7de31f8 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:27.723264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 61/117] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:38:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:27.727271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37acb7-601a-407b-be1d-6365a833dded None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:27.727802 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37acb7-601a-407b-be1d-6365a833dded None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:27.728073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37acb7-601a-407b-be1d-6365a833dded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:27.744864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ef37acb7-601a-407b-be1d-6365a833dded None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:27.746714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ef37acb7-601a-407b-be1d-6365a833dded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:27.777813 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:27.805784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb33f71-8e8f-4d85-879c-0c1419b647e4 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:27.824642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 62/118] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:27.825580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37acb7-601a-407b-be1d-6365a833dded None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:27.851602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0406478-6075-40e7-8dfe-344fdc375cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:27.852348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0406478-6075-40e7-8dfe-344fdc375cad None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:27.852639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0406478-6075-40e7-8dfe-344fdc375cad None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:27.852918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0406478-6075-40e7-8dfe-344fdc375cad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:27.853898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0406478-6075-40e7-8dfe-344fdc375cad None admin] RBAC: Adding query filter params (role.id=595c6e7915fd49fba493261855a5f6b8, scope.project.id=c9ce5e803e154d27aaf0235fa210da97, user.id=d0da1d125d574419bd4df682c853c871) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:27.854211 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0406478-6075-40e7-8dfe-344fdc375cad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:27.855657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0406478-6075-40e7-8dfe-344fdc375cad None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:27.862342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 57/119] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:27 2022] GET /identity/v3/role_assignments?user.id=d0da1d125d574419bd4df682c853c871&scope.project.id=c9ce5e803e154d27aaf0235fa210da97&role.id=595c6e7915fd49fba493261855a5f6b8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:27.863671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe72a4-7131-4198-9b21-fb6833cea985 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:27.864009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe72a4-7131-4198-9b21-fb6833cea985 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:27.864288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe72a4-7131-4198-9b21-fb6833cea985 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:27.866435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 58/120] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:27.867139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe72a4-7131-4198-9b21-fb6833cea985 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:27.980048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37acb7-601a-407b-be1d-6365a833dded None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:28.005725 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe72a4-7131-4198-9b21-fb6833cea985 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:28.006586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:28.032126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a89bcd-7585-41df-8052-94e8bec83e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:28.033116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a89bcd-7585-41df-8052-94e8bec83e31 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:28.034130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a89bcd-7585-41df-8052-94e8bec83e31 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:28.034236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a89bcd-7585-41df-8052-94e8bec83e31 None admin] PATH_INFO: `/v3/users/f181777203f94db981ca69cf76ab0e44` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:28.036033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a89bcd-7585-41df-8052-94e8bec83e31 None admin] RBAC: Authorizing `identity:get_user(user_id=f181777203f94db981ca69cf76ab0e44)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:28.037711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a89bcd-7585-41df-8052-94e8bec83e31 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:28.044539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 63/121] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:27 2022] GET /identity/v3/users/f181777203f94db981ca69cf76ab0e44 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:28.045841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a89bcd-7585-41df-8052-94e8bec83e31 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:28.055292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c421132-6006-4c00-9fe9-eccc96007901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:28.056961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c421132-6006-4c00-9fe9-eccc96007901 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:28.057262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c421132-6006-4c00-9fe9-eccc96007901 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:28.057575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c421132-6006-4c00-9fe9-eccc96007901 None admin] PATH_INFO: `/v3/users/f181777203f94db981ca69cf76ab0e44` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:28.058947 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c421132-6006-4c00-9fe9-eccc96007901 None admin] RBAC: Authorizing `identity:get_user(user_id=f181777203f94db981ca69cf76ab0e44)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:28.061177 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c421132-6006-4c00-9fe9-eccc96007901 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:28.063595 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 59/122] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:27 2022] GET /identity/v3/users/f181777203f94db981ca69cf76ab0e44 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:28.066892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ff77f-4363-4c4b-898a-0edbfcfee57b None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:28.067585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ff77f-4363-4c4b-898a-0edbfcfee57b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:28.067872 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ff77f-4363-4c4b-898a-0edbfcfee57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:28.081327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:28.088004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-8b5ff77f-4363-4c4b-898a-0edbfcfee57b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:28.088366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8b5ff77f-4363-4c4b-898a-0edbfcfee57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:28.186741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 60/123] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:28.187628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ff77f-4363-4c4b-898a-0edbfcfee57b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:28.235782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a89bcd-7585-41df-8052-94e8bec83e31 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:28.287221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c37b02-8823-40a6-a620-7df43edf5871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:28.288206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c37b02-8823-40a6-a620-7df43edf5871 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:28.288564 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c37b02-8823-40a6-a620-7df43edf5871 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:28.288918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c37b02-8823-40a6-a620-7df43edf5871 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:28.311947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c37b02-8823-40a6-a620-7df43edf5871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-16c37b02-8823-40a6-a620-7df43edf5871 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:28.330880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:28.332046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:28.332811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:28.332811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:28.332811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:28.332811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:28.332811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:28.332811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:28.332811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:28.332811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:28.332811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:28.332811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:28.332811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:28.332811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:28.332811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 64/124] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:38:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:28.338747 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c37b02-8823-40a6-a620-7df43edf5871 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:28.356750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ff77f-4363-4c4b-898a-0edbfcfee57b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:28.426344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:28.435162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f73e97-d712-40b3-9b3f-98c743681e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:28.436042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f73e97-d712-40b3-9b3f-98c743681e82 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:28.436328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f73e97-d712-40b3-9b3f-98c743681e82 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:28.436609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f73e97-d712-40b3-9b3f-98c743681e82 None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:28.438824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f73e97-d712-40b3-9b3f-98c743681e82 None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:28.440933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f73e97-d712-40b3-9b3f-98c743681e82 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:28.442874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 61/125] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:28 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:28.443464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f73e97-d712-40b3-9b3f-98c743681e82 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:28.452860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:28.534854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c37b02-8823-40a6-a620-7df43edf5871 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:28.589935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10724c74-b648-4a0f-b1bb-58542a7daae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:28.592402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10724c74-b648-4a0f-b1bb-58542a7daae9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:28.592697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10724c74-b648-4a0f-b1bb-58542a7daae9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:28.592974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10724c74-b648-4a0f-b1bb-58542a7daae9 None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:28.598976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10724c74-b648-4a0f-b1bb-58542a7daae9 None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:28.600456 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10724c74-b648-4a0f-b1bb-58542a7daae9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:28.604948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 65/126] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:28 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:28.605799 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10724c74-b648-4a0f-b1bb-58542a7daae9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:28.646278 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f73e97-d712-40b3-9b3f-98c743681e82 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:28.697130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d62b5-d474-4543-9ec9-dd62086e9103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:28.697994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d62b5-d474-4543-9ec9-dd62086e9103 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:28.698284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d62b5-d474-4543-9ec9-dd62086e9103 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:28.698553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d62b5-d474-4543-9ec9-dd62086e9103 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:28.721077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d62b5-d474-4543-9ec9-dd62086e9103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-0a6d62b5-d474-4543-9ec9-dd62086e9103 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:28.731798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:28.732793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:28.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:28.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:28.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:28.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:28.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:28.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:28.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:28.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:28.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:28.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:28.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:28.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:28.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 62/127] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:28.734255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d62b5-d474-4543-9ec9-dd62086e9103 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:28.781300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10724c74-b648-4a0f-b1bb-58542a7daae9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:28.798875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:28.820553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dc0d9-a280-4e39-bdcc-cd3ed4314e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:28.828652 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:28.829103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dc0d9-a280-4e39-bdcc-cd3ed4314e6b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:28.829103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dc0d9-a280-4e39-bdcc-cd3ed4314e6b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:28.829103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dc0d9-a280-4e39-bdcc-cd3ed4314e6b None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:28.829103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dc0d9-a280-4e39-bdcc-cd3ed4314e6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:28.829103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dc0d9-a280-4e39-bdcc-cd3ed4314e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:28.829103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dc0d9-a280-4e39-bdcc-cd3ed4314e6b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:28.838180 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 66/128] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:28.843845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dc0d9-a280-4e39-bdcc-cd3ed4314e6b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:28.867291 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d62b5-d474-4543-9ec9-dd62086e9103 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:28.912457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5f883-6747-42d7-bcab-16ccdd3fcc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:28.913569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5f883-6747-42d7-bcab-16ccdd3fcc09 None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:28.913875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5f883-6747-42d7-bcab-16ccdd3fcc09 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:28.914163 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5f883-6747-42d7-bcab-16ccdd3fcc09 None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97/users/f181777203f94db981ca69cf76ab0e44/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:28.916921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5f883-6747-42d7-bcab-16ccdd3fcc09 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9ce5e803e154d27aaf0235fa210da97, user_id=f181777203f94db981ca69cf76ab0e44, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:28.918522 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5f883-6747-42d7-bcab-16ccdd3fcc09 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:28.960035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dc0d9-a280-4e39-bdcc-cd3ed4314e6b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:28.996595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db07a1-a478-4f73-9469-9facf787ea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:28.997877 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db07a1-a478-4f73-9469-9facf787ea23 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:28.998275 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db07a1-a478-4f73-9469-9facf787ea23 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:28.998660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db07a1-a478-4f73-9469-9facf787ea23 None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97/users/f181777203f94db981ca69cf76ab0e44/roles/cf5f891b636947e0840ddfa871027fed` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:29.000987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db07a1-a478-4f73-9469-9facf787ea23 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9ce5e803e154d27aaf0235fa210da97, user_id=f181777203f94db981ca69cf76ab0e44, role_id=cf5f891b636947e0840ddfa871027fed)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:29.002896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db07a1-a478-4f73-9469-9facf787ea23 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:29.019008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 63/129] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:38:28 2022] PUT /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97/users/f181777203f94db981ca69cf76ab0e44/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:38:29.022122 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5f883-6747-42d7-bcab-16ccdd3fcc09 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:29.076233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 67/130] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:38:28 2022] PUT /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97/users/f181777203f94db981ca69cf76ab0e44/roles/cf5f891b636947e0840ddfa871027fed => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:38:29.077187 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db07a1-a478-4f73-9469-9facf787ea23 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:29.161129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:29.268062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db07a1-a478-4f73-9469-9facf787ea23 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:29.270685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5f883-6747-42d7-bcab-16ccdd3fcc09 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:29.331383 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa024f72-29a6-4039-bf2c-0d10a94dce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:29.332208 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:29.332457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa024f72-29a6-4039-bf2c-0d10a94dce3c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:29.332743 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa024f72-29a6-4039-bf2c-0d10a94dce3c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:29.333297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa024f72-29a6-4039-bf2c-0d10a94dce3c None admin] PATH_INFO: `/v3/users/d4d342095f994d388541563ef9df90e3` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:29.334391 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa024f72-29a6-4039-bf2c-0d10a94dce3c None admin] RBAC: Authorizing `identity:get_user(user_id=d4d342095f994d388541563ef9df90e3)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:29.335805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa024f72-29a6-4039-bf2c-0d10a94dce3c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:29.341899 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 68/131] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:29 2022] GET /identity/v3/users/d4d342095f994d388541563ef9df90e3 => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:29.343694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7c5fe-0de9-4a3b-8d33-493d6db2c0be None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:29.344165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7c5fe-0de9-4a3b-8d33-493d6db2c0be None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:29.344615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7c5fe-0de9-4a3b-8d33-493d6db2c0be None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:29.348491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cddf70-74d4-4b75-8e02-1bd7e8779efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:29.362372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cddf70-74d4-4b75-8e02-1bd7e8779efa None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:29.362372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cddf70-74d4-4b75-8e02-1bd7e8779efa None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:29.362564 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 69/132] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:29.362634 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cddf70-74d4-4b75-8e02-1bd7e8779efa None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:29.362634 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cddf70-74d4-4b75-8e02-1bd7e8779efa None admin] RBAC: Adding query filter params (name=member) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:29.362634 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cddf70-74d4-4b75-8e02-1bd7e8779efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:29.362634 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cddf70-74d4-4b75-8e02-1bd7e8779efa None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:29.362875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7c5fe-0de9-4a3b-8d33-493d6db2c0be None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:29.364937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 64/133] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:29.366532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9121ae3-e409-4328-a85a-ec5ccb0d4ba4 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:29.367074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9121ae3-e409-4328-a85a-ec5ccb0d4ba4 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:29.367751 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9121ae3-e409-4328-a85a-ec5ccb0d4ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:29.399229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-c9121ae3-e409-4328-a85a-ec5ccb0d4ba4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:29.400566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c9121ae3-e409-4328-a85a-ec5ccb0d4ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:29.489416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 65/134] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:29.490598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9121ae3-e409-4328-a85a-ec5ccb0d4ba4 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:29.531614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7c5fe-0de9-4a3b-8d33-493d6db2c0be None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:29.536913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:29.637899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9121ae3-e409-4328-a85a-ec5ccb0d4ba4 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:29.650128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b4c2c-5a41-451f-a856-adfcbe5f77fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:29.651025 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b4c2c-5a41-451f-a856-adfcbe5f77fc None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:29.651319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b4c2c-5a41-451f-a856-adfcbe5f77fc None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:29.651607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b4c2c-5a41-451f-a856-adfcbe5f77fc None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:29.656093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:29.656701 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b4c2c-5a41-451f-a856-adfcbe5f77fc None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:29.658274 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b4c2c-5a41-451f-a856-adfcbe5f77fc None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:29.660045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 70/135] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:29 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:29.660825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b4c2c-5a41-451f-a856-adfcbe5f77fc None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:29.684246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783cbfa-1bca-4c00-a15b-aaa5d4a05fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:29.686788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783cbfa-1bca-4c00-a15b-aaa5d4a05fa1 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:29.687084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783cbfa-1bca-4c00-a15b-aaa5d4a05fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:29.687371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783cbfa-1bca-4c00-a15b-aaa5d4a05fa1 None admin] PATH_INFO: `/v3/users/f181777203f94db981ca69cf76ab0e44` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:29.691414 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783cbfa-1bca-4c00-a15b-aaa5d4a05fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=f181777203f94db981ca69cf76ab0e44)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:29.694980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783cbfa-1bca-4c00-a15b-aaa5d4a05fa1 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:29.701509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 66/136] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:29 2022] GET /identity/v3/users/f181777203f94db981ca69cf76ab0e44 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:29.702284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783cbfa-1bca-4c00-a15b-aaa5d4a05fa1 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:29.829566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783cbfa-1bca-4c00-a15b-aaa5d4a05fa1 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:29.882725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b4c2c-5a41-451f-a856-adfcbe5f77fc None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:29.896770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e2ab4-4fd8-40d4-9cfc-fda40ded06fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:29.897697 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e2ab4-4fd8-40d4-9cfc-fda40ded06fc None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:29.897986 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e2ab4-4fd8-40d4-9cfc-fda40ded06fc None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:29.898267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e2ab4-4fd8-40d4-9cfc-fda40ded06fc None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97/users/d4d342095f994d388541563ef9df90e3/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:29.901843 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e2ab4-4fd8-40d4-9cfc-fda40ded06fc None admin] RBAC: Authorizing `identity:create_grant(project_id=c9ce5e803e154d27aaf0235fa210da97, user_id=d4d342095f994d388541563ef9df90e3, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:29.903719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e2ab4-4fd8-40d4-9cfc-fda40ded06fc None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:29.930569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa685-a039-4def-be42-d10400936ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:29.933048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa685-a039-4def-be42-d10400936ac5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:29.933048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa685-a039-4def-be42-d10400936ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:29.933048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa685-a039-4def-be42-d10400936ac5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:29.933270 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7aa685-a039-4def-be42-d10400936ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:29.934898 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7aa685-a039-4def-be42-d10400936ac5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:29.936647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 71/137] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:29.937427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa685-a039-4def-be42-d10400936ac5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:29.983257 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:29.991830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 67/138] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:38:29 2022] PUT /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97/users/d4d342095f994d388541563ef9df90e3/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:38:29.992770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e2ab4-4fd8-40d4-9cfc-fda40ded06fc None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:30.095329 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:30.136330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa685-a039-4def-be42-d10400936ac5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:30.214685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e2ab4-4fd8-40d4-9cfc-fda40ded06fc None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:30.227228 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff306f-30c1-42b7-94d9-9ed58bcdb1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:30.228128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff306f-30c1-42b7-94d9-9ed58bcdb1bd None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:30.228421 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff306f-30c1-42b7-94d9-9ed58bcdb1bd None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:30.228708 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff306f-30c1-42b7-94d9-9ed58bcdb1bd None admin] PATH_INFO: `/v3/projects/97b09e1d27844288ae3c4df4e4e4a721` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:30.230038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff306f-30c1-42b7-94d9-9ed58bcdb1bd None admin] RBAC: Authorizing `identity:get_project(project_id=97b09e1d27844288ae3c4df4e4e4a721)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:30.231527 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff306f-30c1-42b7-94d9-9ed58bcdb1bd None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:30.236191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 72/139] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:29 2022] GET /identity/v3/projects/97b09e1d27844288ae3c4df4e4e4a721 => generated 312 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:30.239434 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff306f-30c1-42b7-94d9-9ed58bcdb1bd None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:30.294692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bf573-50ea-4791-8d08-58b523800f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:30.295446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bf573-50ea-4791-8d08-58b523800f56 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:30.295784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bf573-50ea-4791-8d08-58b523800f56 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:30.296073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bf573-50ea-4791-8d08-58b523800f56 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:30.296804 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bf573-50ea-4791-8d08-58b523800f56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:30.298290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bf573-50ea-4791-8d08-58b523800f56 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:30.408106 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff306f-30c1-42b7-94d9-9ed58bcdb1bd None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:30.415076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 68/140] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:38:29 2022] POST /identity/v3/users => generated 283 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:38:30.416640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3aec8-3211-4e39-ab2b-c17efc940ce3 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:30.416935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3aec8-3211-4e39-ab2b-c17efc940ce3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:30.417221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3aec8-3211-4e39-ab2b-c17efc940ce3 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:30.418577 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 69/141] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:30.424839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:30.430346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0077876-7e75-426b-b5cb-7fe87c4d55ed None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:30.430974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0077876-7e75-426b-b5cb-7fe87c4d55ed None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:30.431667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0077876-7e75-426b-b5cb-7fe87c4d55ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:30.467382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a0077876-7e75-426b-b5cb-7fe87c4d55ed None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:30.470411 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a0077876-7e75-426b-b5cb-7fe87c4d55ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:30.493667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3353a4-706b-4336-a3c4-92f7561be04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:30.495038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3353a4-706b-4336-a3c4-92f7561be04d None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:30.495528 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3353a4-706b-4336-a3c4-92f7561be04d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:30.496073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3353a4-706b-4336-a3c4-92f7561be04d None admin] PATH_INFO: `/v3/projects/97b09e1d27844288ae3c4df4e4e4a721/users/f181777203f94db981ca69cf76ab0e44/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:30.500961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3353a4-706b-4336-a3c4-92f7561be04d None admin] RBAC: Authorizing `identity:create_grant(project_id=97b09e1d27844288ae3c4df4e4e4a721, user_id=f181777203f94db981ca69cf76ab0e44, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:30.503453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3353a4-706b-4336-a3c4-92f7561be04d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:30.573602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 70/142] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:30.595756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 73/143] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:38:30 2022] PUT /identity/v3/projects/97b09e1d27844288ae3c4df4e4e4a721/users/f181777203f94db981ca69cf76ab0e44/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:38:30.608721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0077876-7e75-426b-b5cb-7fe87c4d55ed None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:30.657218 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:30.754924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0077876-7e75-426b-b5cb-7fe87c4d55ed None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:30.811834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccd219-38b6-45a0-a2cb-047dd370757b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:30.812656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccd219-38b6-45a0-a2cb-047dd370757b None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:30.812932 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccd219-38b6-45a0-a2cb-047dd370757b None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:30.813208 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccd219-38b6-45a0-a2cb-047dd370757b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:30.830904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccd219-38b6-45a0-a2cb-047dd370757b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-c5ccd219-38b6-45a0-a2cb-047dd370757b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:30.839373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:30.840285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:30.841521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:30.841521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:30.841521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:30.841521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:30.841521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:30.841521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:30.841521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:30.841521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:30.841521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:30.841521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:30.841521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:30.841521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:30.841521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 71/144] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:30.847364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3353a4-706b-4336-a3c4-92f7561be04d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:30.978400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3353a4-706b-4336-a3c4-92f7561be04d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:31.021553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e255d4-9726-4eb8-bb1e-be1b61c4c7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:31.022225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e255d4-9726-4eb8-bb1e-be1b61c4c7d4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:31.022517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e255d4-9726-4eb8-bb1e-be1b61c4c7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:31.022852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e255d4-9726-4eb8-bb1e-be1b61c4c7d4 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:31.023617 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e255d4-9726-4eb8-bb1e-be1b61c4c7d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:31.023933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e255d4-9726-4eb8-bb1e-be1b61c4c7d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:31.025345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e255d4-9726-4eb8-bb1e-be1b61c4c7d4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:31.035379 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 74/145] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:31.040966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccd219-38b6-45a0-a2cb-047dd370757b None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:31.180060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:31.190278 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccd219-38b6-45a0-a2cb-047dd370757b None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:31.226386 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24b98c-b1d6-4494-9fb8-5ade3dfb0baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:31.227267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24b98c-b1d6-4494-9fb8-5ade3dfb0baf None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:31.227545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24b98c-b1d6-4494-9fb8-5ade3dfb0baf None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:31.227816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24b98c-b1d6-4494-9fb8-5ade3dfb0baf None admin] PATH_INFO: `/v3/users/d0da1d125d574419bd4df682c853c871` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:31.229041 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24b98c-b1d6-4494-9fb8-5ade3dfb0baf None admin] RBAC: Authorizing `identity:get_user(user_id=d0da1d125d574419bd4df682c853c871)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:31.230533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24b98c-b1d6-4494-9fb8-5ade3dfb0baf None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:31.232394 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 72/146] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:31 2022] GET /identity/v3/users/d0da1d125d574419bd4df682c853c871 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:31.238218 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e255d4-9726-4eb8-bb1e-be1b61c4c7d4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:31.317867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:31.389959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e255d4-9726-4eb8-bb1e-be1b61c4c7d4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:31.436523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326f6c0-310b-4c1e-91b4-0066e64c1c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:31.437425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f6c0-310b-4c1e-91b4-0066e64c1c6c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:31.438019 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f6c0-310b-4c1e-91b4-0066e64c1c6c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:31.438303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f6c0-310b-4c1e-91b4-0066e64c1c6c None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:31.439609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326f6c0-310b-4c1e-91b4-0066e64c1c6c None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:31.441188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326f6c0-310b-4c1e-91b4-0066e64c1c6c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:31.443263 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 75/147] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:31 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:31.454487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24b98c-b1d6-4494-9fb8-5ade3dfb0baf None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:31.592101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24b98c-b1d6-4494-9fb8-5ade3dfb0baf None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:31.635517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ce56a-7a3b-45e7-ad25-b2150b3c8662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:31.636410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ce56a-7a3b-45e7-ad25-b2150b3c8662 None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:31.636689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ce56a-7a3b-45e7-ad25-b2150b3c8662 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:31.636971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ce56a-7a3b-45e7-ad25-b2150b3c8662 None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97/users/d0da1d125d574419bd4df682c853c871/roles/595c6e7915fd49fba493261855a5f6b8` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:31.643357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ce56a-7a3b-45e7-ad25-b2150b3c8662 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9ce5e803e154d27aaf0235fa210da97, user_id=d0da1d125d574419bd4df682c853c871, role_id=595c6e7915fd49fba493261855a5f6b8)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:31.644883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ce56a-7a3b-45e7-ad25-b2150b3c8662 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:31.727469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 73/148] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:38:31 2022] PUT /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97/users/d0da1d125d574419bd4df682c853c871/roles/595c6e7915fd49fba493261855a5f6b8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:38:32.234065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80251ac5-5354-43ab-9a5e-db9ce8122dce None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:32.234565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80251ac5-5354-43ab-9a5e-db9ce8122dce None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:32.234664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80251ac5-5354-43ab-9a5e-db9ce8122dce None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:32.236691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 76/149] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:32.251388 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d317f2-ea28-4cfc-b383-5c6fbd2b5285 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:32.252485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d317f2-ea28-4cfc-b383-5c6fbd2b5285 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:32.252556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d317f2-ea28-4cfc-b383-5c6fbd2b5285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:32.274836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-f4d317f2-ea28-4cfc-b383-5c6fbd2b5285 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:32.276034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-f4d317f2-ea28-4cfc-b383-5c6fbd2b5285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:32.291536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:32.375795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 74/150] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:32.419944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80251ac5-5354-43ab-9a5e-db9ce8122dce None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:32.542129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:32.547027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80251ac5-5354-43ab-9a5e-db9ce8122dce None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:32.567382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a47ce-5799-4eaa-94b3-ada835e9ecf1 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:32.567682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a47ce-5799-4eaa-94b3-ada835e9ecf1 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:32.567957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a47ce-5799-4eaa-94b3-ada835e9ecf1 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:32.569548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 75/151] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:32.574702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424a956-1bc8-46cf-9db8-3cee5eaee307 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:32.574989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424a956-1bc8-46cf-9db8-3cee5eaee307 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:32.575270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424a956-1bc8-46cf-9db8-3cee5eaee307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:32.610602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-d424a956-1bc8-46cf-9db8-3cee5eaee307 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:32.618596 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d424a956-1bc8-46cf-9db8-3cee5eaee307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:32.632654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008c707-2ffc-4f12-a4e5-5b9cd4200577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:32.633541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008c707-2ffc-4f12-a4e5-5b9cd4200577 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:32.633828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008c707-2ffc-4f12-a4e5-5b9cd4200577 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:32.634106 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008c707-2ffc-4f12-a4e5-5b9cd4200577 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:32.664707 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008c707-2ffc-4f12-a4e5-5b9cd4200577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-6008c707-2ffc-4f12-a4e5-5b9cd4200577 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:32.672482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:32.674136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:32.675090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:32.675090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:32.675090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:32.675090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:32.675090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:32.675090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:32.675090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:32.675090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:32.675090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:32.675090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:32.675090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:32.675090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:32.677443 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 77/152] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:32.686463 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008c707-2ffc-4f12-a4e5-5b9cd4200577 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:32.744008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 76/153] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:32.782230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424a956-1bc8-46cf-9db8-3cee5eaee307 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:32.925404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:32.936627 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424a956-1bc8-46cf-9db8-3cee5eaee307 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:32.973135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008c707-2ffc-4f12-a4e5-5b9cd4200577 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:32.998270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93f74a-238c-448c-a854-74bf519e9c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:32.999100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93f74a-238c-448c-a854-74bf519e9c31 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:32.999387 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93f74a-238c-448c-a854-74bf519e9c31 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:32.999648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93f74a-238c-448c-a854-74bf519e9c31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:33.014745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93f74a-238c-448c-a854-74bf519e9c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-1b93f74a-238c-448c-a854-74bf519e9c31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:33.027254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:33.028281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:33.029064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:33.029064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:33.029064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:33.029064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:33.029064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:33.029064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:33.029064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:33.029064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:33.029064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:33.029064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:33.029064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:33.029064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:33.029064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 77/154] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:38:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:33.037098 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93f74a-238c-448c-a854-74bf519e9c31 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:33.065865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27ed20-3ee4-4816-83ff-f64b3c35edff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:33.066550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27ed20-3ee4-4816-83ff-f64b3c35edff None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:33.066839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27ed20-3ee4-4816-83ff-f64b3c35edff None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:33.067121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27ed20-3ee4-4816-83ff-f64b3c35edff None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:33.067886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27ed20-3ee4-4816-83ff-f64b3c35edff None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:33.068198 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27ed20-3ee4-4816-83ff-f64b3c35edff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:33.069626 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27ed20-3ee4-4816-83ff-f64b3c35edff None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:33.092313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 78/155] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:33.097757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27ed20-3ee4-4816-83ff-f64b3c35edff None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:33.152204 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:33.279693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93f74a-238c-448c-a854-74bf519e9c31 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:33.319470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27ed20-3ee4-4816-83ff-f64b3c35edff None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:33.355051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882a11c-9234-4b9c-be4c-b3a0bc124add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:33.355734 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882a11c-9234-4b9c-be4c-b3a0bc124add None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:33.356022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882a11c-9234-4b9c-be4c-b3a0bc124add None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:33.356303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882a11c-9234-4b9c-be4c-b3a0bc124add None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:33.357062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882a11c-9234-4b9c-be4c-b3a0bc124add None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:33.357386 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882a11c-9234-4b9c-be4c-b3a0bc124add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:33.358820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882a11c-9234-4b9c-be4c-b3a0bc124add None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:33.364598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:33.373122 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 78/156] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:38:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:33.380233 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882a11c-9234-4b9c-be4c-b3a0bc124add None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:33.400224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5b981-c7f0-4675-8aec-c9f42762890e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:33.401209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5b981-c7f0-4675-8aec-c9f42762890e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:33.401523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5b981-c7f0-4675-8aec-c9f42762890e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:33.402038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5b981-c7f0-4675-8aec-c9f42762890e None admin] PATH_INFO: `/v3/users/f181777203f94db981ca69cf76ab0e44` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:33.406120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5b981-c7f0-4675-8aec-c9f42762890e None admin] RBAC: Authorizing `identity:get_user(user_id=f181777203f94db981ca69cf76ab0e44)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:33.407592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5b981-c7f0-4675-8aec-c9f42762890e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:33.409589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 79/157] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:33 2022] GET /identity/v3/users/f181777203f94db981ca69cf76ab0e44 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:33.414862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5b981-c7f0-4675-8aec-c9f42762890e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:33.508868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882a11c-9234-4b9c-be4c-b3a0bc124add None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:33.558971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614f180-bf20-40f4-b019-4b6455f572de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:33.559800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614f180-bf20-40f4-b019-4b6455f572de None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:33.560089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614f180-bf20-40f4-b019-4b6455f572de None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:33.560369 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614f180-bf20-40f4-b019-4b6455f572de None admin] PATH_INFO: `/v3/users/f181777203f94db981ca69cf76ab0e44` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:33.566630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614f180-bf20-40f4-b019-4b6455f572de None admin] RBAC: Authorizing `identity:get_user(user_id=f181777203f94db981ca69cf76ab0e44)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:33.568180 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614f180-bf20-40f4-b019-4b6455f572de None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:33.570298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 79/158] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:33 2022] GET /identity/v3/users/f181777203f94db981ca69cf76ab0e44 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:33.576379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614f180-bf20-40f4-b019-4b6455f572de None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:33.625767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:33.660102 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5b981-c7f0-4675-8aec-c9f42762890e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:33.670074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:33.711629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614f180-bf20-40f4-b019-4b6455f572de None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:33.738181 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f7bba-83f3-4bc6-903a-0c5803e7402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:33.738860 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f7bba-83f3-4bc6-903a-0c5803e7402a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:33.739146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f7bba-83f3-4bc6-903a-0c5803e7402a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:33.739426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f7bba-83f3-4bc6-903a-0c5803e7402a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:33.770706 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69b52e-53fe-4ba8-9417-f81fc70900b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:33.771382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b52e-53fe-4ba8-9417-f81fc70900b5 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:33.771672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b52e-53fe-4ba8-9417-f81fc70900b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:33.771958 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b52e-53fe-4ba8-9417-f81fc70900b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:33.849454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f7bba-83f3-4bc6-903a-0c5803e7402a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:33.850871 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f7bba-83f3-4bc6-903a-0c5803e7402a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:33.885619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69b52e-53fe-4ba8-9417-f81fc70900b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:33.887173 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69b52e-53fe-4ba8-9417-f81fc70900b5 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:33.984500 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:34.029774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:34.031088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 80/159] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:38:34.032448 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5017-f3a0-4d2f-bef7-713110df8ccb None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:34.033316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5017-f3a0-4d2f-bef7-713110df8ccb None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:34.033630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5017-f3a0-4d2f-bef7-713110df8ccb None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:34.035096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 81/160] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:34.041418 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec5017-f3a0-4d2f-bef7-713110df8ccb None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:34.052756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 80/161] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:34.054076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61910bbc-4a15-4c8c-8255-4ddd0cc9f031 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:34.054373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61910bbc-4a15-4c8c-8255-4ddd0cc9f031 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:34.054657 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61910bbc-4a15-4c8c-8255-4ddd0cc9f031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:34.094429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-61910bbc-4a15-4c8c-8255-4ddd0cc9f031 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:34.096168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-61910bbc-4a15-4c8c-8255-4ddd0cc9f031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:34.215396 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec5017-f3a0-4d2f-bef7-713110df8ccb None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:34.256573 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 81/162] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:34.257471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61910bbc-4a15-4c8c-8255-4ddd0cc9f031 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:34.302317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce83074-5509-4797-9c33-d268caf844fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:34.303236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83074-5509-4797-9c33-d268caf844fd None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:34.303517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83074-5509-4797-9c33-d268caf844fd None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:34.303794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83074-5509-4797-9c33-d268caf844fd None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:34.306364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83074-5509-4797-9c33-d268caf844fd None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:34.307861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83074-5509-4797-9c33-d268caf844fd None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:34.313416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 82/163] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:34 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:34.316009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce83074-5509-4797-9c33-d268caf844fd None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:34.383414 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:34.482735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61910bbc-4a15-4c8c-8255-4ddd0cc9f031 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:34.502229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce83074-5509-4797-9c33-d268caf844fd None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:34.537789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:34.572893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81087f5-f0c7-49ff-a744-4fa551d73424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:34.573825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81087f5-f0c7-49ff-a744-4fa551d73424 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:34.574115 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81087f5-f0c7-49ff-a744-4fa551d73424 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:34.574398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81087f5-f0c7-49ff-a744-4fa551d73424 None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:34.578420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81087f5-f0c7-49ff-a744-4fa551d73424 None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:34.580039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81087f5-f0c7-49ff-a744-4fa551d73424 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:34.582960 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 82/164] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:34 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:34.583826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81087f5-f0c7-49ff-a744-4fa551d73424 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:34.590644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052d73d-faaa-4d79-b58d-de80b7407811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:34.591687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052d73d-faaa-4d79-b58d-de80b7407811 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:34.592115 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052d73d-faaa-4d79-b58d-de80b7407811 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:34.592561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052d73d-faaa-4d79-b58d-de80b7407811 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:34.617311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052d73d-faaa-4d79-b58d-de80b7407811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-4052d73d-faaa-4d79-b58d-de80b7407811 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:34.625603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:34.627279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:34.628260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:34.628260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:34.628260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:34.628260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:34.628260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:34.628260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:34.628260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:34.628260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:34.628260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:34.628260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:34.628260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:34.628260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:34.638914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 83/165] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:38:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:34.640923 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052d73d-faaa-4d79-b58d-de80b7407811 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:34.807130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81087f5-f0c7-49ff-a744-4fa551d73424 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:34.867003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71400d-ff88-4576-9b63-d83e10c09af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:34.868014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71400d-ff88-4576-9b63-d83e10c09af9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:34.868458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71400d-ff88-4576-9b63-d83e10c09af9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:34.868884 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71400d-ff88-4576-9b63-d83e10c09af9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:34.869898 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71400d-ff88-4576-9b63-d83e10c09af9 None admin] RBAC: Adding query filter params (role.id=cf5f891b636947e0840ddfa871027fed, scope.project.id=c9ce5e803e154d27aaf0235fa210da97, user.id=f181777203f94db981ca69cf76ab0e44) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:34.870362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71400d-ff88-4576-9b63-d83e10c09af9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:34.871980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71400d-ff88-4576-9b63-d83e10c09af9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:34.882699 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 83/166] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:34 2022] GET /identity/v3/role_assignments?user.id=f181777203f94db981ca69cf76ab0e44&scope.project.id=c9ce5e803e154d27aaf0235fa210da97&role.id=cf5f891b636947e0840ddfa871027fed => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:34.883682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71400d-ff88-4576-9b63-d83e10c09af9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:34.959503 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:34.963478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052d73d-faaa-4d79-b58d-de80b7407811 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:34.980915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:35.059826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71400d-ff88-4576-9b63-d83e10c09af9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:35.061935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7276-3d1e-4061-8ed2-24383101077b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:35.062609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7276-3d1e-4061-8ed2-24383101077b None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:35.062892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7276-3d1e-4061-8ed2-24383101077b None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:35.063167 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7276-3d1e-4061-8ed2-24383101077b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:35.064072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee7276-3d1e-4061-8ed2-24383101077b None admin] RBAC: Adding query filter params (role.id=32086f06b98341f09220be9a203efcb7, scope.project.id=c9ce5e803e154d27aaf0235fa210da97, user.id=f181777203f94db981ca69cf76ab0e44) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:35.064398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee7276-3d1e-4061-8ed2-24383101077b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:35.065884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee7276-3d1e-4061-8ed2-24383101077b None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:35.087444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 84/167] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:34 2022] GET /identity/v3/role_assignments?user.id=f181777203f94db981ca69cf76ab0e44&scope.project.id=c9ce5e803e154d27aaf0235fa210da97&role.id=32086f06b98341f09220be9a203efcb7 => generated 608 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:35.127899 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c26673-9c04-401a-be8b-73ed0548d9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:35.128599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c26673-9c04-401a-be8b-73ed0548d9a8 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:35.128883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c26673-9c04-401a-be8b-73ed0548d9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:35.129158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c26673-9c04-401a-be8b-73ed0548d9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:35.129950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c26673-9c04-401a-be8b-73ed0548d9a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:35.130260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c26673-9c04-401a-be8b-73ed0548d9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:35.131660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c26673-9c04-401a-be8b-73ed0548d9a8 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:35.145770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 84/168] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:35.151573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7276-3d1e-4061-8ed2-24383101077b None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:35.318955 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7276-3d1e-4061-8ed2-24383101077b None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:35.379520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8e42e-6938-4bd4-9bb3-3910fe69adc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:35.380462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8e42e-6938-4bd4-9bb3-3910fe69adc8 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:35.380749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8e42e-6938-4bd4-9bb3-3910fe69adc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:35.381031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8e42e-6938-4bd4-9bb3-3910fe69adc8 None admin] PATH_INFO: `/v3/users/d4d342095f994d388541563ef9df90e3` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:35.386439 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8e42e-6938-4bd4-9bb3-3910fe69adc8 None admin] RBAC: Authorizing `identity:get_user(user_id=d4d342095f994d388541563ef9df90e3)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:35.387946 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8e42e-6938-4bd4-9bb3-3910fe69adc8 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:35.389731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 85/169] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:35 2022] GET /identity/v3/users/d4d342095f994d388541563ef9df90e3 => generated 247 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:35.395477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c26673-9c04-401a-be8b-73ed0548d9a8 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:35.521785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c26673-9c04-401a-be8b-73ed0548d9a8 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:35.540022 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:35.559591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d363b-03c6-49c5-8f9d-68460654afd4 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:35.559893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d363b-03c6-49c5-8f9d-68460654afd4 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:35.560148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d363b-03c6-49c5-8f9d-68460654afd4 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:35.565550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 86/170] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:35.567976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f361a-d65b-4f56-8030-a96c16eaf054 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:35.568507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f361a-d65b-4f56-8030-a96c16eaf054 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:35.568792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f361a-d65b-4f56-8030-a96c16eaf054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:35.588468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76999dc-a8f5-4fa5-8539-53c165777815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:35.589064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76999dc-a8f5-4fa5-8539-53c165777815 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:35.589348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76999dc-a8f5-4fa5-8539-53c165777815 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:35.589662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76999dc-a8f5-4fa5-8539-53c165777815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:35.601871 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-674f361a-d65b-4f56-8030-a96c16eaf054 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:35.603097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-674f361a-d65b-4f56-8030-a96c16eaf054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:35.657768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:35.690184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76999dc-a8f5-4fa5-8539-53c165777815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:35.691724 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76999dc-a8f5-4fa5-8539-53c165777815 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:35.742813 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 87/171] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:35.744406 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb833f-0430-4d1e-8413-85659ee3c0ec None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:35.744700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb833f-0430-4d1e-8413-85659ee3c0ec None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:35.744975 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb833f-0430-4d1e-8413-85659ee3c0ec None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:35.746589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 88/172] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:35.755168 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7bcc4-b09d-4606-8896-b6734326990a None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:35.755460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7bcc4-b09d-4606-8896-b6734326990a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:35.755728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7bcc4-b09d-4606-8896-b6734326990a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:35.795084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-1cf7bcc4-b09d-4606-8896-b6734326990a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:35.796279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1cf7bcc4-b09d-4606-8896-b6734326990a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:35.818874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 85/173] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:35.819749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76999dc-a8f5-4fa5-8539-53c165777815 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:35.844328 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:35.898983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 89/174] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 31 20:38:35.899875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7bcc4-b09d-4606-8896-b6734326990a None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:36.060751 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76999dc-a8f5-4fa5-8539-53c165777815 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:36.090127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:36.114843 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7bcc4-b09d-4606-8896-b6734326990a None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:36.132624 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e8e64-2d29-4381-8203-4f613c699d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:36.133498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e8e64-2d29-4381-8203-4f613c699d53 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.133731 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e8e64-2d29-4381-8203-4f613c699d53 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.134014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e8e64-2d29-4381-8203-4f613c699d53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.153825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e8e64-2d29-4381-8203-4f613c699d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-8f7e8e64-2d29-4381-8203-4f613c699d53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:36.162191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:36.163114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:36.163912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:36.163912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:36.163912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:36.163912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:36.163912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:36.163912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:36.163912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:36.163912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:36.163912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:36.163912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:36.163912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:36.163912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:36.163912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 86/175] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:36.164570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e8e64-2d29-4381-8203-4f613c699d53 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:36.187022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4d75f-a2ee-4a4d-b277-96eabff2fd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:36.187900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4d75f-a2ee-4a4d-b277-96eabff2fd7b None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.188187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4d75f-a2ee-4a4d-b277-96eabff2fd7b None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.188471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4d75f-a2ee-4a4d-b277-96eabff2fd7b None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.191408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4d75f-a2ee-4a4d-b277-96eabff2fd7b None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:36.192878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4d75f-a2ee-4a4d-b277-96eabff2fd7b None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:36.194643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 90/176] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:35 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:36.195493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4d75f-a2ee-4a4d-b277-96eabff2fd7b None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:36.300753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:36.331372 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e8e64-2d29-4381-8203-4f613c699d53 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:36.342125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4d75f-a2ee-4a4d-b277-96eabff2fd7b None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:36.366276 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5718-3ca9-4ba5-a09d-3c8fd6f54682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:36.366993 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5718-3ca9-4ba5-a09d-3c8fd6f54682 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.367281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5718-3ca9-4ba5-a09d-3c8fd6f54682 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.367565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb5718-3ca9-4ba5-a09d-3c8fd6f54682 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.376601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f22a06-bc7b-4e56-8263-408b17d59cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:36.377266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f22a06-bc7b-4e56-8263-408b17d59cdf None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.377617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f22a06-bc7b-4e56-8263-408b17d59cdf None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.377796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb5718-3ca9-4ba5-a09d-3c8fd6f54682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:36.377897 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f22a06-bc7b-4e56-8263-408b17d59cdf None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.378658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f22a06-bc7b-4e56-8263-408b17d59cdf None admin] RBAC: Adding query filter params (name=member) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:36.378966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f22a06-bc7b-4e56-8263-408b17d59cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:36.380342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f22a06-bc7b-4e56-8263-408b17d59cdf None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-7bdb5718-3ca9-4ba5-a09d-3c8fd6f54682 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:36.385397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:36.386241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:36.387042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:36.387042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:36.387042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:36.387042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:36.387042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:36.387042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:36.387042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:36.387042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:36.387042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:36.387042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:36.387042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:36.387042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:36.387042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 87/177] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:38:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:36.387704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5718-3ca9-4ba5-a09d-3c8fd6f54682 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:36.389831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 91/178] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:36.394979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303c32-45f8-4653-aa6e-50e8ba9db034 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.395277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303c32-45f8-4653-aa6e-50e8ba9db034 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.395561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303c32-45f8-4653-aa6e-50e8ba9db034 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.396864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 92/179] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:36.397959 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf882df-b1e0-44fe-9b32-93d37bf2fe22 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.398247 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf882df-b1e0-44fe-9b32-93d37bf2fe22 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.398526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf882df-b1e0-44fe-9b32-93d37bf2fe22 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.399894 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 93/180] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:36.402564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1956d-8a60-4db2-ae7c-6f53f9479a88 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.403062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1956d-8a60-4db2-ae7c-6f53f9479a88 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.403347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1956d-8a60-4db2-ae7c-6f53f9479a88 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.404731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 94/181] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:36.406160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1956d-8a60-4db2-ae7c-6f53f9479a88 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:36.426686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:36.494736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb5718-3ca9-4ba5-a09d-3c8fd6f54682 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:36.508820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1956d-8a60-4db2-ae7c-6f53f9479a88 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:36.524131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:36.528602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362bacd-808a-4479-81b8-645ec0d5cba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:36.529253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362bacd-808a-4479-81b8-645ec0d5cba3 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.529574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362bacd-808a-4479-81b8-645ec0d5cba3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.529853 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362bacd-808a-4479-81b8-645ec0d5cba3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.530674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362bacd-808a-4479-81b8-645ec0d5cba3 None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=c9ce5e803e154d27aaf0235fa210da97, user.id=d4d342095f994d388541563ef9df90e3) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:36.530990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362bacd-808a-4479-81b8-645ec0d5cba3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:36.533056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362bacd-808a-4479-81b8-645ec0d5cba3 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:36.538935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 88/182] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:36 2022] GET /identity/v3/role_assignments?user.id=d4d342095f994d388541563ef9df90e3&scope.project.id=c9ce5e803e154d27aaf0235fa210da97&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:36.543164 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6cc1c-a265-4559-afd2-299cc851ab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:36.543846 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6cc1c-a265-4559-afd2-299cc851ab63 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.544132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6cc1c-a265-4559-afd2-299cc851ab63 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.544412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6cc1c-a265-4559-afd2-299cc851ab63 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.545177 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6cc1c-a265-4559-afd2-299cc851ab63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:36.545536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6cc1c-a265-4559-afd2-299cc851ab63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:36.546381 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362bacd-808a-4479-81b8-645ec0d5cba3 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:36.547239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6cc1c-a265-4559-afd2-299cc851ab63 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:36.557639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 95/183] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:36.558975 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d603a-98b3-4c8a-b286-2925850e54ec None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.559268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d603a-98b3-4c8a-b286-2925850e54ec None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.559547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d603a-98b3-4c8a-b286-2925850e54ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.579753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-292d603a-98b3-4c8a-b286-2925850e54ec None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:36.581884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-292d603a-98b3-4c8a-b286-2925850e54ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:36.664012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362bacd-808a-4479-81b8-645ec0d5cba3 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:36.669544 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 96/184] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:36.671420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856325bc-15d3-441b-9016-7d4d0a285baf None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.671920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856325bc-15d3-441b-9016-7d4d0a285baf None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.673632 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856325bc-15d3-441b-9016-7d4d0a285baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.696539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-856325bc-15d3-441b-9016-7d4d0a285baf None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:36.697911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-856325bc-15d3-441b-9016-7d4d0a285baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:36.701244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:36.708814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e549f-fdee-44f6-b33d-21e5b16849eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:36.709767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e549f-fdee-44f6-b33d-21e5b16849eb None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.710134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e549f-fdee-44f6-b33d-21e5b16849eb None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.710329 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e549f-fdee-44f6-b33d-21e5b16849eb None admin] PATH_INFO: `/v3/users/f181777203f94db981ca69cf76ab0e44` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.712555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e549f-fdee-44f6-b33d-21e5b16849eb None admin] RBAC: Authorizing `identity:get_user(user_id=f181777203f94db981ca69cf76ab0e44)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:36.713110 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e549f-fdee-44f6-b33d-21e5b16849eb None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:36.716862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 89/185] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:36 2022] GET /identity/v3/users/f181777203f94db981ca69cf76ab0e44 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:36.719280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49acc1-316c-481a-913c-9aaa79bae8f4 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.719817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49acc1-316c-481a-913c-9aaa79bae8f4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.720328 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49acc1-316c-481a-913c-9aaa79bae8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.739301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-3d49acc1-316c-481a-913c-9aaa79bae8f4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:36.740825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-3d49acc1-316c-481a-913c-9aaa79bae8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:36.776463 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 97/186] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:36.777126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856325bc-15d3-441b-9016-7d4d0a285baf None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:36.814622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:36.823789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 90/187] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:36.827358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49acc1-316c-481a-913c-9aaa79bae8f4 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:36.894316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856325bc-15d3-441b-9016-7d4d0a285baf None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:36.926128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49acc1-316c-481a-913c-9aaa79bae8f4 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:36.928237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c465ca-4d09-4473-b4f1-cea902365f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:36.929120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c465ca-4d09-4473-b4f1-cea902365f34 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.929436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c465ca-4d09-4473-b4f1-cea902365f34 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.929712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c465ca-4d09-4473-b4f1-cea902365f34 None admin] PATH_INFO: `/v3/users/9e30de230c42464582145cb47803347c` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.939896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:36.942817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c465ca-4d09-4473-b4f1-cea902365f34 None admin] RBAC: Authorizing `identity:get_user(user_id=9e30de230c42464582145cb47803347c)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:36.944349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c465ca-4d09-4473-b4f1-cea902365f34 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:36.946077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 98/188] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:36 2022] GET /identity/v3/users/9e30de230c42464582145cb47803347c => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:36.946849 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c465ca-4d09-4473-b4f1-cea902365f34 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:36.961001 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904e10-f8db-4cfb-8e1a-329347aa0996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:36.961837 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904e10-f8db-4cfb-8e1a-329347aa0996 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:36.962115 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904e10-f8db-4cfb-8e1a-329347aa0996 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:36.962386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904e10-f8db-4cfb-8e1a-329347aa0996 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:36.973419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd904e10-f8db-4cfb-8e1a-329347aa0996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-fd904e10-f8db-4cfb-8e1a-329347aa0996 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:36.980938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:36.982018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 91/189] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:36.983011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904e10-f8db-4cfb-8e1a-329347aa0996 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:37.039945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:37.054165 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c465ca-4d09-4473-b4f1-cea902365f34 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:37.087798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904e10-f8db-4cfb-8e1a-329347aa0996 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:37.089731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6531-97e0-42fc-a32c-d03655d8f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:37.090399 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6531-97e0-42fc-a32c-d03655d8f814 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:37.090683 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6531-97e0-42fc-a32c-d03655d8f814 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:37.090958 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6531-97e0-42fc-a32c-d03655d8f814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:37.125623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13921562-c3b5-4186-a34e-d431b2d13e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:37.126544 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13921562-c3b5-4186-a34e-d431b2d13e8f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:37.126896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13921562-c3b5-4186-a34e-d431b2d13e8f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:37.127240 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13921562-c3b5-4186-a34e-d431b2d13e8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:37.138423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13921562-c3b5-4186-a34e-d431b2d13e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-13921562-c3b5-4186-a34e-d431b2d13e8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:37.147168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:37.148143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:37.148954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:37.148954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:37.148954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:37.148954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:37.148954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:37.148954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:37.148954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:37.148954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:37.148954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:37.148954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:37.148954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:37.148954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:37.148954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 92/190] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:38:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:37.149666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13921562-c3b5-4186-a34e-d431b2d13e8f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:37.166055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:37.169502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd6531-97e0-42fc-a32c-d03655d8f814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:37.171003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd6531-97e0-42fc-a32c-d03655d8f814 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:37.263088 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13921562-c3b5-4186-a34e-d431b2d13e8f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:37.277622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:37.283845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 99/191] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:37.284906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6531-97e0-42fc-a32c-d03655d8f814 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:37.307949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd236a-4f6c-46f5-9272-ece289df2fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:37.308756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd236a-4f6c-46f5-9272-ece289df2fb7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:37.309039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd236a-4f6c-46f5-9272-ece289df2fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:37.309316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd236a-4f6c-46f5-9272-ece289df2fb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:37.310532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd236a-4f6c-46f5-9272-ece289df2fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:37.311986 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd236a-4f6c-46f5-9272-ece289df2fb7 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:37.314346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 93/192] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:37.316094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd236a-4f6c-46f5-9272-ece289df2fb7 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:37.393185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:37.399296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6531-97e0-42fc-a32c-d03655d8f814 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:37.429433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd236a-4f6c-46f5-9272-ece289df2fb7 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:37.440298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a44bd-02d8-4800-8b16-80f054702d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:37.440958 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a44bd-02d8-4800-8b16-80f054702d81 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:37.441241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a44bd-02d8-4800-8b16-80f054702d81 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:37.441549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a44bd-02d8-4800-8b16-80f054702d81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:37.468516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1c7c3-61ce-42b3-90f0-7747356f745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:37.469178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1c7c3-61ce-42b3-90f0-7747356f745e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:37.469503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1c7c3-61ce-42b3-90f0-7747356f745e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:37.470495 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1c7c3-61ce-42b3-90f0-7747356f745e None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:37.471251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1c7c3-61ce-42b3-90f0-7747356f745e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:37.471580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1c7c3-61ce-42b3-90f0-7747356f745e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:37.472982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1c7c3-61ce-42b3-90f0-7747356f745e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:37.482226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 94/193] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:37.482781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1c7c3-61ce-42b3-90f0-7747356f745e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:37.516997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a44bd-02d8-4800-8b16-80f054702d81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:37.518435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a44bd-02d8-4800-8b16-80f054702d81 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:37.536188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:37.593293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1c7c3-61ce-42b3-90f0-7747356f745e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:37.624408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:37.627473 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce623f-dfa0-4a7c-8b2e-85789b0397ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:37.628136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce623f-dfa0-4a7c-8b2e-85789b0397ad None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:37.628419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce623f-dfa0-4a7c-8b2e-85789b0397ad None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:37.628692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce623f-dfa0-4a7c-8b2e-85789b0397ad None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:37.629040 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 100/194] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:37.629468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce623f-dfa0-4a7c-8b2e-85789b0397ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:37.629779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce623f-dfa0-4a7c-8b2e-85789b0397ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:37.629892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a44bd-02d8-4800-8b16-80f054702d81 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:37.631163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce623f-dfa0-4a7c-8b2e-85789b0397ad None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:37.641095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 95/195] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:38:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:37.642483 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce623f-dfa0-4a7c-8b2e-85789b0397ad None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:37.729467 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a44bd-02d8-4800-8b16-80f054702d81 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:37.744319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce623f-dfa0-4a7c-8b2e-85789b0397ad None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:37.752357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:37.762440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb563418-78fd-4111-a98d-19075797a5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:37.763288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb563418-78fd-4111-a98d-19075797a5b3 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:37.763563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb563418-78fd-4111-a98d-19075797a5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:37.763834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb563418-78fd-4111-a98d-19075797a5b3 None admin] PATH_INFO: `/v3/projects/97b09e1d27844288ae3c4df4e4e4a721` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:37.764998 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb563418-78fd-4111-a98d-19075797a5b3 None admin] RBAC: Authorizing `identity:get_project(project_id=97b09e1d27844288ae3c4df4e4e4a721)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:37.766483 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb563418-78fd-4111-a98d-19075797a5b3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:37.768747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 101/196] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:37 2022] GET /identity/v3/projects/97b09e1d27844288ae3c4df4e4e4a721 => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:37.769469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb563418-78fd-4111-a98d-19075797a5b3 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:37.779610 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f7565-5655-4dfd-b382-c880d273187e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:37.780309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f7565-5655-4dfd-b382-c880d273187e None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:37.780594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f7565-5655-4dfd-b382-c880d273187e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:37.780870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f7565-5655-4dfd-b382-c880d273187e None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:37.781621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f7565-5655-4dfd-b382-c880d273187e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:37.784015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f7565-5655-4dfd-b382-c880d273187e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:37.834945 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:37.866685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb563418-78fd-4111-a98d-19075797a5b3 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:37.898757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5b7d2-753b-4396-8783-6b928775cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:37.899607 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5b7d2-753b-4396-8783-6b928775cab5 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:37.899934 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5b7d2-753b-4396-8783-6b928775cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:37.900203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5b7d2-753b-4396-8783-6b928775cab5 None admin] PATH_INFO: `/v3/users/d0da1d125d574419bd4df682c853c871` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:37.901371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5b7d2-753b-4396-8783-6b928775cab5 None admin] RBAC: Authorizing `identity:get_user(user_id=d0da1d125d574419bd4df682c853c871)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:37.902832 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5b7d2-753b-4396-8783-6b928775cab5 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:37.904433 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 102/197] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:37 2022] GET /identity/v3/users/d0da1d125d574419bd4df682c853c871 => generated 289 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:37.905178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5b7d2-753b-4396-8783-6b928775cab5 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:37.913825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 96/198] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:38:37 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:38:37.914856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f7565-5655-4dfd-b382-c880d273187e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:38.019834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5b7d2-753b-4396-8783-6b928775cab5 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:38.034324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f7565-5655-4dfd-b382-c880d273187e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:38.058258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a0594-1561-48c6-9d33-d79fe0d63560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:38.059189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a0594-1561-48c6-9d33-d79fe0d63560 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:38.059475 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a0594-1561-48c6-9d33-d79fe0d63560 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:38.059753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a0594-1561-48c6-9d33-d79fe0d63560 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:38.061170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a0594-1561-48c6-9d33-d79fe0d63560 None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:38.062764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a0594-1561-48c6-9d33-d79fe0d63560 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:38.065412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 103/199] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:37 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:38.066280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a0594-1561-48c6-9d33-d79fe0d63560 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:38.069209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:38.081062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6c73e-bb1c-4019-8a09-de5566ee551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:38.081991 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6c73e-bb1c-4019-8a09-de5566ee551e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:38.084632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6c73e-bb1c-4019-8a09-de5566ee551e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:38.084632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6c73e-bb1c-4019-8a09-de5566ee551e None admin] PATH_INFO: `/v3/users/9e30de230c42464582145cb47803347c` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:38.084632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6c73e-bb1c-4019-8a09-de5566ee551e None admin] RBAC: Authorizing `identity:get_user(user_id=9e30de230c42464582145cb47803347c)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:38.085299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6c73e-bb1c-4019-8a09-de5566ee551e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:38.087049 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 97/200] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:37 2022] GET /identity/v3/users/9e30de230c42464582145cb47803347c => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:38.087860 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6c73e-bb1c-4019-8a09-de5566ee551e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:38.123090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:38.205762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a0594-1561-48c6-9d33-d79fe0d63560 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:38.225518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6c73e-bb1c-4019-8a09-de5566ee551e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:38.260227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63c185-9d5d-4f96-aeaa-2e58e1285305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:38.260893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c185-9d5d-4f96-aeaa-2e58e1285305 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:38.261177 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c185-9d5d-4f96-aeaa-2e58e1285305 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:38.261492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c185-9d5d-4f96-aeaa-2e58e1285305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:38.262356 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63c185-9d5d-4f96-aeaa-2e58e1285305 None admin] RBAC: Adding query filter params (role.id=32086f06b98341f09220be9a203efcb7, scope.project.id=97b09e1d27844288ae3c4df4e4e4a721, user.id=f181777203f94db981ca69cf76ab0e44) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:38.262643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63c185-9d5d-4f96-aeaa-2e58e1285305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:38.264136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63c185-9d5d-4f96-aeaa-2e58e1285305 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:38.272577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566885eb-06b8-4e9d-a2dc-95229850f82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:38.273215 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566885eb-06b8-4e9d-a2dc-95229850f82e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:38.273525 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566885eb-06b8-4e9d-a2dc-95229850f82e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:38.273811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566885eb-06b8-4e9d-a2dc-95229850f82e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:38.281454 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 104/201] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:38 2022] GET /identity/v3/role_assignments?user.id=f181777203f94db981ca69cf76ab0e44&scope.project.id=97b09e1d27844288ae3c4df4e4e4a721&role.id=32086f06b98341f09220be9a203efcb7 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:38.281454 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63c185-9d5d-4f96-aeaa-2e58e1285305 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:38.389083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566885eb-06b8-4e9d-a2dc-95229850f82e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:38.390689 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566885eb-06b8-4e9d-a2dc-95229850f82e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:38.420787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:38.493842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:38.520184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63c185-9d5d-4f96-aeaa-2e58e1285305 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:38.561322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1648d-9775-48b1-9225-1c1572ed9372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:38.561922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1648d-9775-48b1-9225-1c1572ed9372 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:38.562218 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1648d-9775-48b1-9225-1c1572ed9372 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:38.562493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1648d-9775-48b1-9225-1c1572ed9372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:38.564433 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1648d-9775-48b1-9225-1c1572ed9372 None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978, user.id=9e30de230c42464582145cb47803347c) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:38.564752 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1648d-9775-48b1-9225-1c1572ed9372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:38.566658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1648d-9775-48b1-9225-1c1572ed9372 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:38.575328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 105/202] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:38 2022] GET /identity/v3/role_assignments?user.id=9e30de230c42464582145cb47803347c&scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:38.575938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1648d-9775-48b1-9225-1c1572ed9372 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:38.623174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 98/203] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:38.629324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566885eb-06b8-4e9d-a2dc-95229850f82e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:38.717773 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1648d-9775-48b1-9225-1c1572ed9372 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:38.759162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:38.763323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566885eb-06b8-4e9d-a2dc-95229850f82e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:38.765898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77645fb6-b5dd-4695-b1de-1881eecc88f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:38.766624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77645fb6-b5dd-4695-b1de-1881eecc88f9 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:38.767917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77645fb6-b5dd-4695-b1de-1881eecc88f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:38.768208 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77645fb6-b5dd-4695-b1de-1881eecc88f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:38.815202 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:38.825253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e2f67-9c09-49a2-8e06-da62e96e980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:38.826403 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e2f67-9c09-49a2-8e06-da62e96e980f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:38.826692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e2f67-9c09-49a2-8e06-da62e96e980f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:38.826969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e2f67-9c09-49a2-8e06-da62e96e980f None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:38.828841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e2f67-9c09-49a2-8e06-da62e96e980f None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:38.831527 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e2f67-9c09-49a2-8e06-da62e96e980f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:38.834090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 99/204] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:38 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:38.841445 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e2f67-9c09-49a2-8e06-da62e96e980f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:38.874264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77645fb6-b5dd-4695-b1de-1881eecc88f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:38.877725 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77645fb6-b5dd-4695-b1de-1881eecc88f9 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:39.018740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 106/205] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:39.025152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77645fb6-b5dd-4695-b1de-1881eecc88f9 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:39.060906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e2f67-9c09-49a2-8e06-da62e96e980f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:39.086195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:39.108826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bb93d-e7bd-4d23-9cd6-90b69364a6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:39.109912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb93d-e7bd-4d23-9cd6-90b69364a6e1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:39.110946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb93d-e7bd-4d23-9cd6-90b69364a6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:39.111422 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb93d-e7bd-4d23-9cd6-90b69364a6e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:39.112913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bb93d-e7bd-4d23-9cd6-90b69364a6e1 None admin] RBAC: Adding query filter params (role.id=595c6e7915fd49fba493261855a5f6b8, scope.project.id=c9ce5e803e154d27aaf0235fa210da97, user.id=d0da1d125d574419bd4df682c853c871) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:39.113486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bb93d-e7bd-4d23-9cd6-90b69364a6e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:39.115471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bb93d-e7bd-4d23-9cd6-90b69364a6e1 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:39.123163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 100/206] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:38 2022] GET /identity/v3/role_assignments?user.id=d0da1d125d574419bd4df682c853c871&scope.project.id=c9ce5e803e154d27aaf0235fa210da97&role.id=595c6e7915fd49fba493261855a5f6b8 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:39.197847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77645fb6-b5dd-4695-b1de-1881eecc88f9 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:39.258748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bc2ce-896b-4353-8a2b-95fc37bafe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:39.259640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bc2ce-896b-4353-8a2b-95fc37bafe2c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:39.259921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bc2ce-896b-4353-8a2b-95fc37bafe2c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:39.260194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bc2ce-896b-4353-8a2b-95fc37bafe2c None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:39.261538 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bc2ce-896b-4353-8a2b-95fc37bafe2c None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:39.263041 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bc2ce-896b-4353-8a2b-95fc37bafe2c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:39.264846 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 107/207] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:39 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:39.271856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bb93d-e7bd-4d23-9cd6-90b69364a6e1 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:39.378531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:39.419923 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bb93d-e7bd-4d23-9cd6-90b69364a6e1 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:39.457293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fb295-ae15-4cf0-81fa-c46b5e57f239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:39.458005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fb295-ae15-4cf0-81fa-c46b5e57f239 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:39.458369 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fb295-ae15-4cf0-81fa-c46b5e57f239 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:39.458647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fb295-ae15-4cf0-81fa-c46b5e57f239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:39.459478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fb295-ae15-4cf0-81fa-c46b5e57f239 None admin] RBAC: Adding query filter params (role.id=cf5f891b636947e0840ddfa871027fed, scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978, user.id=9e30de230c42464582145cb47803347c) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:39.459787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fb295-ae15-4cf0-81fa-c46b5e57f239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:39.461231 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fb295-ae15-4cf0-81fa-c46b5e57f239 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:39.467204 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 101/208] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:39 2022] GET /identity/v3/role_assignments?user.id=9e30de230c42464582145cb47803347c&scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978&role.id=cf5f891b636947e0840ddfa871027fed => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:40.687113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35823d-f89f-475e-a111-cb22baba6e2d None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:40.687630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35823d-f89f-475e-a111-cb22baba6e2d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:40.687734 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35823d-f89f-475e-a111-cb22baba6e2d None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:40.689764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 108/209] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:38:40.695268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a9ac9-ff18-4373-9851-fce2a5efea2d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:40.695695 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a9ac9-ff18-4373-9851-fce2a5efea2d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:40.695888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a9ac9-ff18-4373-9851-fce2a5efea2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:40.714245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-045a9ac9-ff18-4373-9851-fce2a5efea2d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:40.715455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-045a9ac9-ff18-4373-9851-fce2a5efea2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:40.752195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e424e70-58e0-40b6-b497-bad5b7a14764 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:40.752827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e424e70-58e0-40b6-b497-bad5b7a14764 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:40.753303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e424e70-58e0-40b6-b497-bad5b7a14764 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:40.755171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 109/210] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:38:40.760492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d41e1-2397-403e-841d-103686f7c817 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:40.761042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d41e1-2397-403e-841d-103686f7c817 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:40.761566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d41e1-2397-403e-841d-103686f7c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:40.778924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-524d41e1-2397-403e-841d-103686f7c817 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:40.780449 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-524d41e1-2397-403e-841d-103686f7c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:40.790574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 102/211] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:40.816134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a9ac9-ff18-4373-9851-fce2a5efea2d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:40.854071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 110/212] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:40.878461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d41e1-2397-403e-841d-103686f7c817 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:40.881513 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:40.912265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:40.935298 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a9ac9-ff18-4373-9851-fce2a5efea2d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:40.972060 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef92ed-3344-4fc5-844f-bcad4385c4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:40.973203 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef92ed-3344-4fc5-844f-bcad4385c4bb None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:40.973710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef92ed-3344-4fc5-844f-bcad4385c4bb None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:40.974202 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef92ed-3344-4fc5-844f-bcad4385c4bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:40.975608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef92ed-3344-4fc5-844f-bcad4385c4bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:40.977252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef92ed-3344-4fc5-844f-bcad4385c4bb None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:40.979459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 103/213] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:40.989297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef92ed-3344-4fc5-844f-bcad4385c4bb None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:40.997816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d41e1-2397-403e-841d-103686f7c817 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:41.035516 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e194c-7d53-4098-b126-f855d2fc02a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:41.036324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e194c-7d53-4098-b126-f855d2fc02a0 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:41.036603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e194c-7d53-4098-b126-f855d2fc02a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:41.036881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e194c-7d53-4098-b126-f855d2fc02a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:41.048740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e194c-7d53-4098-b126-f855d2fc02a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-103e194c-7d53-4098-b126-f855d2fc02a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:41.057123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:41.058033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:41.058969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:41.058969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:41.058969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:41.058969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:41.058969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:41.058969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:41.058969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:41.058969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:41.058969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:41.058969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:41.058969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:41.058969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:41.058969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 111/214] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:41.064848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e194c-7d53-4098-b126-f855d2fc02a0 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:41.105890 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef92ed-3344-4fc5-844f-bcad4385c4bb None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:41.132791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:41.145275 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617a499-b700-461f-9bea-88f609923dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:41.146068 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617a499-b700-461f-9bea-88f609923dd6 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:41.146413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617a499-b700-461f-9bea-88f609923dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:41.146750 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617a499-b700-461f-9bea-88f609923dd6 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:41.149762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617a499-b700-461f-9bea-88f609923dd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:41.149762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617a499-b700-461f-9bea-88f609923dd6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:41.165061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:41.177493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e194c-7d53-4098-b126-f855d2fc02a0 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:41.214313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8ef28-d951-438a-ae9b-beaa709b9fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:41.215035 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ef28-d951-438a-ae9b-beaa709b9fa6 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:41.215376 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ef28-d951-438a-ae9b-beaa709b9fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:41.215655 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ef28-d951-438a-ae9b-beaa709b9fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:41.216409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8ef28-d951-438a-ae9b-beaa709b9fa6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:41.216719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8ef28-d951-438a-ae9b-beaa709b9fa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:41.218173 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8ef28-d951-438a-ae9b-beaa709b9fa6 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:41.227769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 112/215] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:41.231631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a8e02-6511-41a6-b998-de04fb35c32f None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:41.232028 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a8e02-6511-41a6-b998-de04fb35c32f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:41.232195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a8e02-6511-41a6-b998-de04fb35c32f None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:41.233598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 113/216] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:38:41.234170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a8e02-6511-41a6-b998-de04fb35c32f None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:41.253404 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 104/217] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:38:40 2022] POST /identity/v3/users => generated 297 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:38:41.253404 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76fb41-847b-4332-89e8-8579492f0adf None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:41.253404 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76fb41-847b-4332-89e8-8579492f0adf None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:41.253404 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76fb41-847b-4332-89e8-8579492f0adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:41.272072 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-4d76fb41-847b-4332-89e8-8579492f0adf None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:41.273467 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4d76fb41-847b-4332-89e8-8579492f0adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:41.361343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 105/218] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:41.370738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a8e02-6511-41a6-b998-de04fb35c32f None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:41.384448 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76fb41-847b-4332-89e8-8579492f0adf None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:41.418952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a56521-b338-4563-96c5-5616c5c935f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:41.420130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56521-b338-4563-96c5-5616c5c935f0 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:41.420422 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56521-b338-4563-96c5-5616c5c935f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:41.420940 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56521-b338-4563-96c5-5616c5c935f0 None admin] PATH_INFO: `/v3/users/7386290933cf49eebc948d05f5e5cfd6` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:41.439607 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a56521-b338-4563-96c5-5616c5c935f0 None admin] RBAC: Authorizing `identity:get_user(user_id=7386290933cf49eebc948d05f5e5cfd6)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:41.441299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a56521-b338-4563-96c5-5616c5c935f0 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:41.444129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 114/219] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:41 2022] GET /identity/v3/users/7386290933cf49eebc948d05f5e5cfd6 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:41.449668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a56521-b338-4563-96c5-5616c5c935f0 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:41.464116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:41.508480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76fb41-847b-4332-89e8-8579492f0adf None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:41.521666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:41.558940 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d6972-0706-4637-be3b-434efdc8f34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:41.559983 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6972-0706-4637-be3b-434efdc8f34c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:41.560414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6972-0706-4637-be3b-434efdc8f34c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:41.560834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6972-0706-4637-be3b-434efdc8f34c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:41.572682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d6972-0706-4637-be3b-434efdc8f34c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-fe5d6972-0706-4637-be3b-434efdc8f34c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:41.581313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:41.582227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:41.583013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:41.583013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:41.583013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:41.583013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:41.583013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:41.583013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:41.583013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:41.583013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:41.583013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:41.583013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:41.583013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:41.583013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:41.583610 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 106/220] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:38:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:38:41.590479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d6972-0706-4637-be3b-434efdc8f34c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:41.591650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a56521-b338-4563-96c5-5616c5c935f0 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:41.632227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832b13f-a688-46be-ab51-b2bbe1abb40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:41.633224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832b13f-a688-46be-ab51-b2bbe1abb40a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:41.633740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832b13f-a688-46be-ab51-b2bbe1abb40a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:41.634014 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832b13f-a688-46be-ab51-b2bbe1abb40a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:41.714120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832b13f-a688-46be-ab51-b2bbe1abb40a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:41.716385 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832b13f-a688-46be-ab51-b2bbe1abb40a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:41.725430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d6972-0706-4637-be3b-434efdc8f34c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:41.730327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:41.770669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf72ef5-b72d-4d48-8074-ef877ad536be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:41.771269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf72ef5-b72d-4d48-8074-ef877ad536be None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:41.771549 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf72ef5-b72d-4d48-8074-ef877ad536be None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:41.771825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf72ef5-b72d-4d48-8074-ef877ad536be None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:41.772576 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf72ef5-b72d-4d48-8074-ef877ad536be None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:41.772884 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf72ef5-b72d-4d48-8074-ef877ad536be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:41.774522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf72ef5-b72d-4d48-8074-ef877ad536be None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:41.792278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 107/221] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:41.793849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf72ef5-b72d-4d48-8074-ef877ad536be None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:41.834670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:41.863564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 115/222] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:38:41.870993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832b13f-a688-46be-ab51-b2bbe1abb40a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:41.934510 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf72ef5-b72d-4d48-8074-ef877ad536be None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:41.972554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3813c6b-5a3a-4f69-9c11-4a3cbc446cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:41.973499 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3813c6b-5a3a-4f69-9c11-4a3cbc446cb9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:41.973779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3813c6b-5a3a-4f69-9c11-4a3cbc446cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:41.974049 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3813c6b-5a3a-4f69-9c11-4a3cbc446cb9 None admin] PATH_INFO: `/v3/users/9e30de230c42464582145cb47803347c` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:41.975354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3813c6b-5a3a-4f69-9c11-4a3cbc446cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=9e30de230c42464582145cb47803347c)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:41.976835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3813c6b-5a3a-4f69-9c11-4a3cbc446cb9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:41.978880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 108/223] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:41 2022] GET /identity/v3/users/9e30de230c42464582145cb47803347c => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:41.980101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5ea25-91e6-42d2-83e9-e49bf14adc83 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:41.980380 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5ea25-91e6-42d2-83e9-e49bf14adc83 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:41.980647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5ea25-91e6-42d2-83e9-e49bf14adc83 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:41.982224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 109/224] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:41.984135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5ea25-91e6-42d2-83e9-e49bf14adc83 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:42.022570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832b13f-a688-46be-ab51-b2bbe1abb40a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:42.035547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:42.071505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c996cc9-a40e-4993-bd1e-243d371dc8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:42.072381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c996cc9-a40e-4993-bd1e-243d371dc8eb None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:42.072666 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c996cc9-a40e-4993-bd1e-243d371dc8eb None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:42.072943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c996cc9-a40e-4993-bd1e-243d371dc8eb None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:42.074178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c996cc9-a40e-4993-bd1e-243d371dc8eb None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:42.076185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c996cc9-a40e-4993-bd1e-243d371dc8eb None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:42.078831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 116/225] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:41 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:42.080391 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d1d07-e2a1-44d8-9825-d005222da9f4 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:42.080682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d1d07-e2a1-44d8-9825-d005222da9f4 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:42.080961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d1d07-e2a1-44d8-9825-d005222da9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:42.100225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-056d1d07-e2a1-44d8-9825-d005222da9f4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:42.101565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-056d1d07-e2a1-44d8-9825-d005222da9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:42.107483 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:42.112315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5ea25-91e6-42d2-83e9-e49bf14adc83 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:42.160322 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f33b3e-249f-457a-9212-ee85e41f8df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:42.161730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f33b3e-249f-457a-9212-ee85e41f8df4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:42.162025 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f33b3e-249f-457a-9212-ee85e41f8df4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:42.162306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f33b3e-249f-457a-9212-ee85e41f8df4 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:42.163946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f33b3e-249f-457a-9212-ee85e41f8df4 None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:42.168111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f33b3e-249f-457a-9212-ee85e41f8df4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:42.174038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 110/226] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:41 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:42.175355 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f33b3e-249f-457a-9212-ee85e41f8df4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:42.186076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 117/227] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:42.187127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d1d07-e2a1-44d8-9825-d005222da9f4 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:42.305409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d1d07-e2a1-44d8-9825-d005222da9f4 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:42.310060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:42.318536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f33b3e-249f-457a-9212-ee85e41f8df4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:42.338935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c663d-2996-4968-a995-a9b88f6f4480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:42.339857 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c663d-2996-4968-a995-a9b88f6f4480 None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:42.340214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c663d-2996-4968-a995-a9b88f6f4480 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:42.342000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c663d-2996-4968-a995-a9b88f6f4480 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978/users/9e30de230c42464582145cb47803347c/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:42.346020 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c663d-2996-4968-a995-a9b88f6f4480 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b81e28b94aa40e9a9ab61284d4c0978, user_id=9e30de230c42464582145cb47803347c, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:42.347703 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c663d-2996-4968-a995-a9b88f6f4480 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:42.362132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa6ae-27a0-43cf-bdd8-7df9c15bd7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:42.362892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa6ae-27a0-43cf-bdd8-7df9c15bd7d5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:42.363185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa6ae-27a0-43cf-bdd8-7df9c15bd7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:42.363527 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa6ae-27a0-43cf-bdd8-7df9c15bd7d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:42.364444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aa6ae-27a0-43cf-bdd8-7df9c15bd7d5 None admin] RBAC: Adding query filter params (role.id=32086f06b98341f09220be9a203efcb7, scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978, user.id=7386290933cf49eebc948d05f5e5cfd6) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:42.364765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aa6ae-27a0-43cf-bdd8-7df9c15bd7d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:42.366489 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aa6ae-27a0-43cf-bdd8-7df9c15bd7d5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:42.372914 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 111/228] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:42 2022] GET /identity/v3/role_assignments?user.id=7386290933cf49eebc948d05f5e5cfd6&scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978&role.id=32086f06b98341f09220be9a203efcb7 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:42.377532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa6ae-27a0-43cf-bdd8-7df9c15bd7d5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:42.419095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:42.437270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 118/229] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:38:42 2022] PUT /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978/users/9e30de230c42464582145cb47803347c/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:38:42.512007 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa6ae-27a0-43cf-bdd8-7df9c15bd7d5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:42.554633 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668d17b-5b5d-4a1a-a1ed-4bdfb108260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:42.555813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668d17b-5b5d-4a1a-a1ed-4bdfb108260f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:42.556269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668d17b-5b5d-4a1a-a1ed-4bdfb108260f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:42.556691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668d17b-5b5d-4a1a-a1ed-4bdfb108260f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:42.570020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668d17b-5b5d-4a1a-a1ed-4bdfb108260f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-7668d17b-5b5d-4a1a-a1ed-4bdfb108260f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:42.579442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:42.580927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:42.581947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:42.581947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:42.581947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:42.581947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:42.581947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:42.581947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:42.581947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:42.581947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:42.581947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:42.581947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:42.581947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:42.581947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:42.584462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 112/230] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:38:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:42.590575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c663d-2996-4968-a995-a9b88f6f4480 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:42.729123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c663d-2996-4968-a995-a9b88f6f4480 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:42.767821 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7ba4a-22f2-4034-ab4a-61861fa69a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:42.768502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7ba4a-22f2-4034-ab4a-61861fa69a2d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:42.768786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7ba4a-22f2-4034-ab4a-61861fa69a2d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:42.769067 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7ba4a-22f2-4034-ab4a-61861fa69a2d None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:42.769861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7ba4a-22f2-4034-ab4a-61861fa69a2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:42.770225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7ba4a-22f2-4034-ab4a-61861fa69a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:42.771550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7ba4a-22f2-4034-ab4a-61861fa69a2d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:42.780331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 119/231] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:38:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:42.786418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668d17b-5b5d-4a1a-a1ed-4bdfb108260f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:42.919031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:42.928984 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668d17b-5b5d-4a1a-a1ed-4bdfb108260f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:42.975553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38d1a3-38e2-4b4a-b7d5-7a224786ff03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:42.976498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38d1a3-38e2-4b4a-b7d5-7a224786ff03 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:42.976787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38d1a3-38e2-4b4a-b7d5-7a224786ff03 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:42.977090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38d1a3-38e2-4b4a-b7d5-7a224786ff03 None admin] PATH_INFO: `/v3/users/9e30de230c42464582145cb47803347c` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:42.978526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38d1a3-38e2-4b4a-b7d5-7a224786ff03 None admin] RBAC: Authorizing `identity:get_user(user_id=9e30de230c42464582145cb47803347c)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:42.979995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38d1a3-38e2-4b4a-b7d5-7a224786ff03 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:42.981757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 113/232] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:42 2022] GET /identity/v3/users/9e30de230c42464582145cb47803347c => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:42.987696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7ba4a-22f2-4034-ab4a-61861fa69a2d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:43.030406 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:43.191562 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7ba4a-22f2-4034-ab4a-61861fa69a2d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:43.255097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e33b6-85ba-4b5c-932f-762bc14b960b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:43.256381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e33b6-85ba-4b5c-932f-762bc14b960b None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:43.256870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e33b6-85ba-4b5c-932f-762bc14b960b None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:43.257350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e33b6-85ba-4b5c-932f-762bc14b960b None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:43.258826 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e33b6-85ba-4b5c-932f-762bc14b960b None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:43.260543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e33b6-85ba-4b5c-932f-762bc14b960b None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:43.262613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 120/233] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:42 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:43.268409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38d1a3-38e2-4b4a-b7d5-7a224786ff03 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:43.397183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38d1a3-38e2-4b4a-b7d5-7a224786ff03 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:43.438781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e987315-6115-483d-9d95-8ec26137bdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:43.439676 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e987315-6115-483d-9d95-8ec26137bdc3 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:43.439953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e987315-6115-483d-9d95-8ec26137bdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:43.440225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e987315-6115-483d-9d95-8ec26137bdc3 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978/users/9e30de230c42464582145cb47803347c/roles/cf5f891b636947e0840ddfa871027fed` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:43.447293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e987315-6115-483d-9d95-8ec26137bdc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b81e28b94aa40e9a9ab61284d4c0978, user_id=9e30de230c42464582145cb47803347c, role_id=cf5f891b636947e0840ddfa871027fed)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:43.448692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e987315-6115-483d-9d95-8ec26137bdc3 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:43.595563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 114/234] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:38:43 2022] PUT /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978/users/9e30de230c42464582145cb47803347c/roles/cf5f891b636947e0840ddfa871027fed => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:38:44.202909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234011ad-ff4d-45f4-b02d-e01ea076aa62 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:44.203506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234011ad-ff4d-45f4-b02d-e01ea076aa62 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:44.203506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234011ad-ff4d-45f4-b02d-e01ea076aa62 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:44.205455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 121/235] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:44.210778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79505d5-09c7-4269-9061-42eabbec0893 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:44.211229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79505d5-09c7-4269-9061-42eabbec0893 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:44.211319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79505d5-09c7-4269-9061-42eabbec0893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:44.228516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d79505d5-09c7-4269-9061-42eabbec0893 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:44.229723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d79505d5-09c7-4269-9061-42eabbec0893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:44.245338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:44.300067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 115/236] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:44.315150 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d724a-64ba-4b69-b55d-83011ebd95fe None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:44.315446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d724a-64ba-4b69-b55d-83011ebd95fe None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:44.315712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d724a-64ba-4b69-b55d-83011ebd95fe None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:44.317338 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 122/237] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:44.327786 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79505d5-09c7-4269-9061-42eabbec0893 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:44.338518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151ba7-5d40-4e5b-807d-841df2c06139 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:44.338822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151ba7-5d40-4e5b-807d-841df2c06139 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:44.339075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151ba7-5d40-4e5b-807d-841df2c06139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:44.367387 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-72151ba7-5d40-4e5b-807d-841df2c06139 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:44.368654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-72151ba7-5d40-4e5b-807d-841df2c06139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:44.496337 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 123/238] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:44.497057 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79505d5-09c7-4269-9061-42eabbec0893 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:44.520383 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72151ba7-5d40-4e5b-807d-841df2c06139 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:44.533261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4fb11-c2ad-4fa9-be83-b2cb35c7d1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:44.534329 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4fb11-c2ad-4fa9-be83-b2cb35c7d1f4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:44.534715 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4fb11-c2ad-4fa9-be83-b2cb35c7d1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:44.535118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4fb11-c2ad-4fa9-be83-b2cb35c7d1f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:44.546450 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4fb11-c2ad-4fa9-be83-b2cb35c7d1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:44.557457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-0df4fb11-c2ad-4fa9-be83-b2cb35c7d1f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:44.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:44.564638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:44.565462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:44.565462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:44.565462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:44.565462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:44.565462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:44.565462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:44.565462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:44.565462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:44.565462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:44.565462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:44.565462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:44.565462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:44.569681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 116/239] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:44.574961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4fb11-c2ad-4fa9-be83-b2cb35c7d1f4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:44.625812 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:44.637339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72151ba7-5d40-4e5b-807d-841df2c06139 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:44.676275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f94b0-c18d-4af1-9994-f22a3f27e105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:44.677334 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f94b0-c18d-4af1-9994-f22a3f27e105 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:44.677722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f94b0-c18d-4af1-9994-f22a3f27e105 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:44.678075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f94b0-c18d-4af1-9994-f22a3f27e105 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:44.679379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f94b0-c18d-4af1-9994-f22a3f27e105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:44.680922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f94b0-c18d-4af1-9994-f22a3f27e105 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:44.683085 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 124/240] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:44.689312 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f94b0-c18d-4af1-9994-f22a3f27e105 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:44.803675 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:44.806331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f94b0-c18d-4af1-9994-f22a3f27e105 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:44.847707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f7fc4-f9c5-4dfd-9922-8783e4d60053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:44.848519 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f7fc4-f9c5-4dfd-9922-8783e4d60053 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:44.848939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f7fc4-f9c5-4dfd-9922-8783e4d60053 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:44.849186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f7fc4-f9c5-4dfd-9922-8783e4d60053 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:44.850165 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f7fc4-f9c5-4dfd-9922-8783e4d60053 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:44.851867 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f7fc4-f9c5-4dfd-9922-8783e4d60053 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:44.862290 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4fb11-c2ad-4fa9-be83-b2cb35c7d1f4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:44.902091 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd6cbf-b1be-47ab-84f3-908eb53c806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:44.902899 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd6cbf-b1be-47ab-84f3-908eb53c806c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:44.903312 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd6cbf-b1be-47ab-84f3-908eb53c806c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:44.903608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd6cbf-b1be-47ab-84f3-908eb53c806c None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:44.904394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd6cbf-b1be-47ab-84f3-908eb53c806c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:44.904723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd6cbf-b1be-47ab-84f3-908eb53c806c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:44.906839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd6cbf-b1be-47ab-84f3-908eb53c806c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:44.917203 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 117/241] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:44.923342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd6cbf-b1be-47ab-84f3-908eb53c806c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:44.950430 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 125/242] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:38:44 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:38:45.013997 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:45.051476 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd6cbf-b1be-47ab-84f3-908eb53c806c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:45.089575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64d3aa-9351-48c4-b068-e6bd93497f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:45.090382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64d3aa-9351-48c4-b068-e6bd93497f76 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:45.090664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64d3aa-9351-48c4-b068-e6bd93497f76 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:45.090944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64d3aa-9351-48c4-b068-e6bd93497f76 None admin] PATH_INFO: `/v3/users/4350838777814489bddaa2df5bcce698` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:45.107765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64d3aa-9351-48c4-b068-e6bd93497f76 None admin] RBAC: Authorizing `identity:get_user(user_id=4350838777814489bddaa2df5bcce698)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:45.109940 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64d3aa-9351-48c4-b068-e6bd93497f76 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:45.112246 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 118/243] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:44 2022] GET /identity/v3/users/4350838777814489bddaa2df5bcce698 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:45.117888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f7fc4-f9c5-4dfd-9922-8783e4d60053 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:45.260345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f7fc4-f9c5-4dfd-9922-8783e4d60053 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:45.307326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939102bd-95ba-4fc1-9264-e59df28f1cb1 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:45.307828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939102bd-95ba-4fc1-9264-e59df28f1cb1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:45.307900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939102bd-95ba-4fc1-9264-e59df28f1cb1 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:45.309509 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 119/244] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:45.317311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c2abd-cb6e-46da-908c-c75709ebd5f2 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:45.318029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c2abd-cb6e-46da-908c-c75709ebd5f2 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:45.318514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c2abd-cb6e-46da-908c-c75709ebd5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:45.321464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d5fa1-7c56-49aa-bcc0-3c130468e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:45.322125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d5fa1-7c56-49aa-bcc0-3c130468e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:45.322407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d5fa1-7c56-49aa-bcc0-3c130468e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:45.322679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d5fa1-7c56-49aa-bcc0-3c130468e8b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:45.340646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-292c2abd-cb6e-46da-908c-c75709ebd5f2 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:45.341788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-292c2abd-cb6e-46da-908c-c75709ebd5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:45.347018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:45.398970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d5fa1-7c56-49aa-bcc0-3c130468e8b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:45.400730 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d5fa1-7c56-49aa-bcc0-3c130468e8b6 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:45.458023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 120/245] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:45.461409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9ee40-51be-4a42-9b8b-0a25da18f8f2 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:45.461409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9ee40-51be-4a42-9b8b-0a25da18f8f2 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:45.461409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9ee40-51be-4a42-9b8b-0a25da18f8f2 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:45.461409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 121/246] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:45.466508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963db5a-e5e7-4f83-9404-ff4d072b965e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:45.466792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963db5a-e5e7-4f83-9404-ff4d072b965e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:45.467073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963db5a-e5e7-4f83-9404-ff4d072b965e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:45.485833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-4963db5a-e5e7-4f83-9404-ff4d072b965e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:45.488050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4963db5a-e5e7-4f83-9404-ff4d072b965e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:45.526289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 126/247] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:45.527797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d5fa1-7c56-49aa-bcc0-3c130468e8b6 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:45.560475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:45.577026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 122/248] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:45.582158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963db5a-e5e7-4f83-9404-ff4d072b965e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:45.601990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:45.675547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d5fa1-7c56-49aa-bcc0-3c130468e8b6 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:45.716858 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12f6de-4a4f-46ad-acbf-fb3d2c565ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:45.717705 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f6de-4a4f-46ad-acbf-fb3d2c565ead None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:45.717988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f6de-4a4f-46ad-acbf-fb3d2c565ead None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:45.718261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f6de-4a4f-46ad-acbf-fb3d2c565ead None admin] PATH_INFO: `/v3/roles/member` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:45.723500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963db5a-e5e7-4f83-9404-ff4d072b965e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:45.729689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12f6de-4a4f-46ad-acbf-fb3d2c565ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-9a12f6de-4a4f-46ad-acbf-fb3d2c565ead None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:45.737878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:45.738836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:45.739653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:45.739653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:45.739653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:45.739653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:45.739653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:45.739653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:45.739653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:45.739653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:45.739653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:45.739653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:45.739653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:45.739653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:45.744081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 127/249] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:45.744901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12f6de-4a4f-46ad-acbf-fb3d2c565ead None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:45.760998 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a456c2-b01b-4162-857a-5c90d65d4f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:45.762011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a456c2-b01b-4162-857a-5c90d65d4f79 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:45.762357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a456c2-b01b-4162-857a-5c90d65d4f79 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:45.762792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a456c2-b01b-4162-857a-5c90d65d4f79 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:45.764166 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a456c2-b01b-4162-857a-5c90d65d4f79 None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:45.766278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a456c2-b01b-4162-857a-5c90d65d4f79 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:45.768275 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 123/250] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:45 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:45.769105 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a456c2-b01b-4162-857a-5c90d65d4f79 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:45.834410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:45.856148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12f6de-4a4f-46ad-acbf-fb3d2c565ead None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:45.885766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:45.914810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccb6bb-a54a-4961-92d9-0abee4c5ea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:45.915938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccb6bb-a54a-4961-92d9-0abee4c5ea61 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:45.916427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccb6bb-a54a-4961-92d9-0abee4c5ea61 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:45.916889 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccb6bb-a54a-4961-92d9-0abee4c5ea61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:45.929224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccb6bb-a54a-4961-92d9-0abee4c5ea61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-03ccb6bb-a54a-4961-92d9-0abee4c5ea61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:45.938169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:45.939276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:45.940235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:45.940235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:45.940235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:45.940235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:45.940235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:45.940235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:45.940235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:45.940235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:45.940235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:45.940235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:45.940235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:38:45.940235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:45.943132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 128/251] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:38:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:45.944221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccb6bb-a54a-4961-92d9-0abee4c5ea61 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:45.960255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a456c2-b01b-4162-857a-5c90d65d4f79 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:46.034180 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cd13b-2efd-41e7-836c-9b7d73799e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:46.034769 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cd13b-2efd-41e7-836c-9b7d73799e05 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:46.035050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cd13b-2efd-41e7-836c-9b7d73799e05 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:46.035326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cd13b-2efd-41e7-836c-9b7d73799e05 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:46.036075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cd13b-2efd-41e7-836c-9b7d73799e05 None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:46.036379 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cd13b-2efd-41e7-836c-9b7d73799e05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:46.037795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cd13b-2efd-41e7-836c-9b7d73799e05 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:46.051758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 124/252] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:46.056483 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cd13b-2efd-41e7-836c-9b7d73799e05 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:46.060359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccb6bb-a54a-4961-92d9-0abee4c5ea61 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:46.144347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb76eac-b443-4c69-9046-16e903afc39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:46.145010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb76eac-b443-4c69-9046-16e903afc39a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:46.145302 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb76eac-b443-4c69-9046-16e903afc39a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:46.145603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb76eac-b443-4c69-9046-16e903afc39a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:46.146475 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb76eac-b443-4c69-9046-16e903afc39a None admin] RBAC: Adding query filter params (role.id=595c6e7915fd49fba493261855a5f6b8, scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978, user.id=4350838777814489bddaa2df5bcce698) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:46.146795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb76eac-b443-4c69-9046-16e903afc39a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:46.148327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb76eac-b443-4c69-9046-16e903afc39a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:46.155299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 129/253] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:45 2022] GET /identity/v3/role_assignments?user.id=4350838777814489bddaa2df5bcce698&scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978&role.id=595c6e7915fd49fba493261855a5f6b8 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:46.156372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb76eac-b443-4c69-9046-16e903afc39a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:46.228083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:46.253244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cd13b-2efd-41e7-836c-9b7d73799e05 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:46.292031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:46.342268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ad459-7c7d-4616-a475-06f1c4f1f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:46.343041 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ad459-7c7d-4616-a475-06f1c4f1f66d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:46.343259 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ad459-7c7d-4616-a475-06f1c4f1f66d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:46.343566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ad459-7c7d-4616-a475-06f1c4f1f66d None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:46.344333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ad459-7c7d-4616-a475-06f1c4f1f66d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:46.344641 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ad459-7c7d-4616-a475-06f1c4f1f66d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:46.346061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ad459-7c7d-4616-a475-06f1c4f1f66d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:46.349972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb76eac-b443-4c69-9046-16e903afc39a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:46.362219 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 125/254] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:46.370445 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ad459-7c7d-4616-a475-06f1c4f1f66d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:46.435579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9a892-eeae-4124-a09f-52c064a26506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:46.436897 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9a892-eeae-4124-a09f-52c064a26506 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:46.437987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9a892-eeae-4124-a09f-52c064a26506 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:46.438472 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9a892-eeae-4124-a09f-52c064a26506 None admin] PATH_INFO: `/v3/users/7386290933cf49eebc948d05f5e5cfd6` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:46.440022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9a892-eeae-4124-a09f-52c064a26506 None admin] RBAC: Authorizing `identity:get_user(user_id=7386290933cf49eebc948d05f5e5cfd6)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:46.449979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9a892-eeae-4124-a09f-52c064a26506 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:46.452236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 130/255] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:46 2022] GET /identity/v3/users/7386290933cf49eebc948d05f5e5cfd6 => generated 297 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:46.458537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9a892-eeae-4124-a09f-52c064a26506 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:46.538310 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ad459-7c7d-4616-a475-06f1c4f1f66d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:46.605237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9a892-eeae-4124-a09f-52c064a26506 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:46.608619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:46.614513 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78113b76-17e8-4a20-92d5-0a22e6706fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:46.615410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78113b76-17e8-4a20-92d5-0a22e6706fa1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:46.615709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78113b76-17e8-4a20-92d5-0a22e6706fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:46.615998 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78113b76-17e8-4a20-92d5-0a22e6706fa1 None admin] PATH_INFO: `/v3/users/9e30de230c42464582145cb47803347c` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:46.617219 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78113b76-17e8-4a20-92d5-0a22e6706fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=9e30de230c42464582145cb47803347c)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:46.618872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78113b76-17e8-4a20-92d5-0a22e6706fa1 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:46.621268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 126/256] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:46 2022] GET /identity/v3/users/9e30de230c42464582145cb47803347c => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:46.623070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbfb30-55e2-4ef3-99bb-ea8ad6a31e64 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:46.623364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbfb30-55e2-4ef3-99bb-ea8ad6a31e64 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:46.627610 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbfb30-55e2-4ef3-99bb-ea8ad6a31e64 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:46.627610 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 127/257] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:46.630541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbfb30-55e2-4ef3-99bb-ea8ad6a31e64 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:46.676558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36aea3-d6d6-4859-b19c-c0edcce91727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:46.677455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36aea3-d6d6-4859-b19c-c0edcce91727 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:46.677740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36aea3-d6d6-4859-b19c-c0edcce91727 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:46.678015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36aea3-d6d6-4859-b19c-c0edcce91727 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:46.680541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36aea3-d6d6-4859-b19c-c0edcce91727 None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:46.682039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36aea3-d6d6-4859-b19c-c0edcce91727 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:46.686264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 131/258] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:46 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:46.687999 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015c6bc-6662-4c37-992b-f8c8f48674d1 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:46.688284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015c6bc-6662-4c37-992b-f8c8f48674d1 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:46.688558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015c6bc-6662-4c37-992b-f8c8f48674d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:46.722977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6015c6bc-6662-4c37-992b-f8c8f48674d1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:46.724180 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6015c6bc-6662-4c37-992b-f8c8f48674d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:46.740317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:46.831843 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbfb30-55e2-4ef3-99bb-ea8ad6a31e64 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:46.846927 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 132/259] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:46.854191 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015c6bc-6662-4c37-992b-f8c8f48674d1 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:46.949997 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce244508-8630-4066-b2e7-2c8956c2fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:46.950579 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244508-8630-4066-b2e7-2c8956c2fbab None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:46.950867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244508-8630-4066-b2e7-2c8956c2fbab None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:46.951150 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244508-8630-4066-b2e7-2c8956c2fbab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:47.071922 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce244508-8630-4066-b2e7-2c8956c2fbab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:47.073779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce244508-8630-4066-b2e7-2c8956c2fbab None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:47.092608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015c6bc-6662-4c37-992b-f8c8f48674d1 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:47.117744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:47.156608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8641b1-f767-4ff5-8f5e-79188c228cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:47.157543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8641b1-f767-4ff5-8f5e-79188c228cd8 None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:47.157826 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8641b1-f767-4ff5-8f5e-79188c228cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:47.158104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8641b1-f767-4ff5-8f5e-79188c228cd8 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978/users/7386290933cf49eebc948d05f5e5cfd6/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:47.162964 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8641b1-f767-4ff5-8f5e-79188c228cd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b81e28b94aa40e9a9ab61284d4c0978, user_id=7386290933cf49eebc948d05f5e5cfd6, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:47.164463 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8641b1-f767-4ff5-8f5e-79188c228cd8 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:47.172793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:47.227838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 128/260] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:47.228694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce244508-8630-4066-b2e7-2c8956c2fbab None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:47.255850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 133/261] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:38:46 2022] PUT /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978/users/7386290933cf49eebc948d05f5e5cfd6/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:38:47.256682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8641b1-f767-4ff5-8f5e-79188c228cd8 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:47.393419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce244508-8630-4066-b2e7-2c8956c2fbab None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:47.474426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8dac3-3f0a-4fd6-929b-e0a287ce1fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:47.475326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8dac3-3f0a-4fd6-929b-e0a287ce1fb0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:47.475613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8dac3-3f0a-4fd6-929b-e0a287ce1fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:47.475891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8dac3-3f0a-4fd6-929b-e0a287ce1fb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:47.486091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8641b1-f767-4ff5-8f5e-79188c228cd8 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:47.494885 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8dac3-3f0a-4fd6-929b-e0a287ce1fb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-0fc8dac3-3f0a-4fd6-929b-e0a287ce1fb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:47.506390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:47.507370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:47.508191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:47.508191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:47.508191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:47.508191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:47.508191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:47.508191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:47.508191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:47.508191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:47.508191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:47.508191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:47.508191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:47.508191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:47.513677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 129/262] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:38:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:47.522992 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8dac3-3f0a-4fd6-929b-e0a287ce1fb0 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:47.525406 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b732419-7622-461b-83a5-7c1b80dda9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:47.526350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b732419-7622-461b-83a5-7c1b80dda9a3 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:47.526640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b732419-7622-461b-83a5-7c1b80dda9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:47.526915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b732419-7622-461b-83a5-7c1b80dda9a3 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:47.528123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b732419-7622-461b-83a5-7c1b80dda9a3 None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:47.529630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b732419-7622-461b-83a5-7c1b80dda9a3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:47.531921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 134/263] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:47 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:47.537870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b732419-7622-461b-83a5-7c1b80dda9a3 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:47.551922 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:47.569767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:47.652407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b732419-7622-461b-83a5-7c1b80dda9a3 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:47.695049 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45c047-5878-4fa8-bc1e-3a61275177c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:47.695717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45c047-5878-4fa8-bc1e-3a61275177c9 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:47.696009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45c047-5878-4fa8-bc1e-3a61275177c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:47.696288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45c047-5878-4fa8-bc1e-3a61275177c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:47.697118 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45c047-5878-4fa8-bc1e-3a61275177c9 None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978, user.id=9e30de230c42464582145cb47803347c) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:47.697468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45c047-5878-4fa8-bc1e-3a61275177c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:47.698944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45c047-5878-4fa8-bc1e-3a61275177c9 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:47.706811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 135/264] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:47 2022] GET /identity/v3/role_assignments?user.id=9e30de230c42464582145cb47803347c&scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:47.779407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8dac3-3f0a-4fd6-929b-e0a287ce1fb0 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:47.819628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b566816-c66f-46c5-a308-bcbccebc0f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:47.820320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b566816-c66f-46c5-a308-bcbccebc0f3c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:47.820628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b566816-c66f-46c5-a308-bcbccebc0f3c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:47.820879 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b566816-c66f-46c5-a308-bcbccebc0f3c None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:47.821715 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b566816-c66f-46c5-a308-bcbccebc0f3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:47.822027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b566816-c66f-46c5-a308-bcbccebc0f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:47.823479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b566816-c66f-46c5-a308-bcbccebc0f3c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:47.838608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 130/265] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:38:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:47.840008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45c047-5878-4fa8-bc1e-3a61275177c9 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:47.945855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:47.956850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45c047-5878-4fa8-bc1e-3a61275177c9 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:48.003161 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d27aa-74a1-44a5-9428-5f79cbf591f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:48.004432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d27aa-74a1-44a5-9428-5f79cbf591f4 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:48.004893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d27aa-74a1-44a5-9428-5f79cbf591f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:48.005341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d27aa-74a1-44a5-9428-5f79cbf591f4 None admin] PATH_INFO: `/v3/users/9e30de230c42464582145cb47803347c` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:48.006784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d27aa-74a1-44a5-9428-5f79cbf591f4 None admin] RBAC: Authorizing `identity:get_user(user_id=9e30de230c42464582145cb47803347c)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:48.008451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d27aa-74a1-44a5-9428-5f79cbf591f4 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:48.014862 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 136/266] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:47 2022] GET /identity/v3/users/9e30de230c42464582145cb47803347c => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:48.017045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b566816-c66f-46c5-a308-bcbccebc0f3c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:48.134782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:48.169530 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b566816-c66f-46c5-a308-bcbccebc0f3c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:48.212207 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a98f1-b539-4d29-b570-a77234258cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:48.212872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a98f1-b539-4d29-b570-a77234258cbe None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:48.213157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a98f1-b539-4d29-b570-a77234258cbe None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:48.213454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a98f1-b539-4d29-b570-a77234258cbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:48.310967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a98f1-b539-4d29-b570-a77234258cbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:48.313052 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a98f1-b539-4d29-b570-a77234258cbe None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:48.411548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:48.434833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a36c0-992f-464f-9095-874b7e4d4413 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:48.435179 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a36c0-992f-464f-9095-874b7e4d4413 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:48.435446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a36c0-992f-464f-9095-874b7e4d4413 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:48.437157 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 137/267] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:48.442878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46246bba-589a-42fd-b5a0-930a4d944e6a None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:48.443165 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46246bba-589a-42fd-b5a0-930a4d944e6a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:48.443446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46246bba-589a-42fd-b5a0-930a4d944e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:48.450110 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 131/268] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:38:48.460875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a98f1-b539-4d29-b570-a77234258cbe None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:48.478163 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-46246bba-589a-42fd-b5a0-930a4d944e6a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:48.482988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-46246bba-589a-42fd-b5a0-930a4d944e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:48.620948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 138/269] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:48.652928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46246bba-589a-42fd-b5a0-930a4d944e6a None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:48.654951 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a98f1-b539-4d29-b570-a77234258cbe None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:48.714349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c5866-51aa-425d-994c-a5654b2d09de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:48.715123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5866-51aa-425d-994c-a5654b2d09de None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:48.715402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5866-51aa-425d-994c-a5654b2d09de None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:48.715673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5866-51aa-425d-994c-a5654b2d09de None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:48.718059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c5866-51aa-425d-994c-a5654b2d09de None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:48.720100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c5866-51aa-425d-994c-a5654b2d09de None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:48.725906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 132/270] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:48 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:48.730770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c5866-51aa-425d-994c-a5654b2d09de None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:48.786424 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:48.798569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:48.810986 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46246bba-589a-42fd-b5a0-930a4d944e6a None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:48.856435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eefd3-484b-425b-83d6-dd8ed87d992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:48.857326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eefd3-484b-425b-83d6-dd8ed87d992e None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:48.857622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eefd3-484b-425b-83d6-dd8ed87d992e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:48.857896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eefd3-484b-425b-83d6-dd8ed87d992e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:48.866693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c5866-51aa-425d-994c-a5654b2d09de None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:48.871890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eefd3-484b-425b-83d6-dd8ed87d992e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-149eefd3-484b-425b-83d6-dd8ed87d992e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:48.882060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:48.883178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:48.884063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:48.884063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:48.884063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:48.884063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:48.884063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:48.884063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:48.884063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:48.884063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:48.884063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:48.884063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:48.884063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:48.884063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:48.889322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 139/271] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:48.889322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322d261-a24f-4328-a861-3d4e4a83f76c None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:48.889322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322d261-a24f-4328-a861-3d4e4a83f76c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:48.889322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322d261-a24f-4328-a861-3d4e4a83f76c None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:48.889322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 140/272] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:48.894106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322d261-a24f-4328-a861-3d4e4a83f76c None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:48.920867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c755fa-3ed2-4786-a341-bd3441667e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:48.922550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c755fa-3ed2-4786-a341-bd3441667e96 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:48.923311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c755fa-3ed2-4786-a341-bd3441667e96 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:48.923790 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c755fa-3ed2-4786-a341-bd3441667e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:48.925078 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c755fa-3ed2-4786-a341-bd3441667e96 None admin] RBAC: Adding query filter params (role.id=cf5f891b636947e0840ddfa871027fed, scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978, user.id=9e30de230c42464582145cb47803347c) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:48.925825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c755fa-3ed2-4786-a341-bd3441667e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:48.927291 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c755fa-3ed2-4786-a341-bd3441667e96 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:48.935567 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 133/273] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:48 2022] GET /identity/v3/role_assignments?user.id=9e30de230c42464582145cb47803347c&scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978&role.id=cf5f891b636947e0840ddfa871027fed => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:48.938128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe14aa-2121-49b3-8131-378ef98bf7bc None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:48.938412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe14aa-2121-49b3-8131-378ef98bf7bc None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:48.938689 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe14aa-2121-49b3-8131-378ef98bf7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:48.973569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-54fe14aa-2121-49b3-8131-378ef98bf7bc None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:48.974744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-54fe14aa-2121-49b3-8131-378ef98bf7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:49.058579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322d261-a24f-4328-a861-3d4e4a83f76c None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:49.071030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 134/274] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:49.078676 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b51f9-486e-4ea3-b6c4-7714e683af24 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:49.079002 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b51f9-486e-4ea3-b6c4-7714e683af24 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:49.079507 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b51f9-486e-4ea3-b6c4-7714e683af24 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:49.081220 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 135/275] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:49.094022 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc14a29-4335-492c-bb49-ebe28e4ac8fc None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:49.094320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc14a29-4335-492c-bb49-ebe28e4ac8fc None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:49.094566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc14a29-4335-492c-bb49-ebe28e4ac8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:49.103589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5667e7-3222-4a30-ac8e-8b89dfeeab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:49.104276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5667e7-3222-4a30-ac8e-8b89dfeeab33 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:49.104590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5667e7-3222-4a30-ac8e-8b89dfeeab33 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:49.104951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5667e7-3222-4a30-ac8e-8b89dfeeab33 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:49.105894 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5667e7-3222-4a30-ac8e-8b89dfeeab33 None admin] RBAC: Adding query filter params (name=member) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:49.106212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5667e7-3222-4a30-ac8e-8b89dfeeab33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:49.107687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5667e7-3222-4a30-ac8e-8b89dfeeab33 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:49.119686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 141/276] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:49.120698 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5667e7-3222-4a30-ac8e-8b89dfeeab33 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:49.122240 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ccc14a29-4335-492c-bb49-ebe28e4ac8fc None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:49.123556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ccc14a29-4335-492c-bb49-ebe28e4ac8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:49.137563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:49.156264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:49.202602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 136/277] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:49.210253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc14a29-4335-492c-bb49-ebe28e4ac8fc None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:49.235762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5667e7-3222-4a30-ac8e-8b89dfeeab33 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:49.276448 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a88f72-cc97-4312-9b42-460634548fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:49.277240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a88f72-cc97-4312-9b42-460634548fd1 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:49.277562 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a88f72-cc97-4312-9b42-460634548fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:49.277833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a88f72-cc97-4312-9b42-460634548fd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:49.278992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a88f72-cc97-4312-9b42-460634548fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:49.280431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a88f72-cc97-4312-9b42-460634548fd1 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:49.282091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 142/278] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:49.282850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a88f72-cc97-4312-9b42-460634548fd1 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:49.350319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc14a29-4335-492c-bb49-ebe28e4ac8fc None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:49.378043 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:49.387260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c343d-fc9e-4bba-bad9-cfccbca4e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:49.388256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c343d-fc9e-4bba-bad9-cfccbca4e256 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:49.388537 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c343d-fc9e-4bba-bad9-cfccbca4e256 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:49.388907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c343d-fc9e-4bba-bad9-cfccbca4e256 None admin] PATH_INFO: `/v3/users/945d4bf08ad14121b1d393a979f56549` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:49.398713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a88f72-cc97-4312-9b42-460634548fd1 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:49.403749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c343d-fc9e-4bba-bad9-cfccbca4e256 None admin] RBAC: Authorizing `identity:get_user(user_id=945d4bf08ad14121b1d393a979f56549)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:49.405306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c343d-fc9e-4bba-bad9-cfccbca4e256 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:49.412423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 137/279] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:49 2022] GET /identity/v3/users/945d4bf08ad14121b1d393a979f56549 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:49.413067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c343d-fc9e-4bba-bad9-cfccbca4e256 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:49.437254 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:49.437594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83036c76-6640-49c6-a44f-047bfea2d6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:49.438939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83036c76-6640-49c6-a44f-047bfea2d6c8 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:49.439394 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83036c76-6640-49c6-a44f-047bfea2d6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:49.439848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83036c76-6640-49c6-a44f-047bfea2d6c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:49.450101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83036c76-6640-49c6-a44f-047bfea2d6c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-83036c76-6640-49c6-a44f-047bfea2d6c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:49.458459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:49.459398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:49.460202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:49.460202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:49.460202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:49.460202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:49.460202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:49.460202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:49.460202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:49.460202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:49.460202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:49.460202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:49.460202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:49.460202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:49.460202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 143/280] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:49.461451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83036c76-6640-49c6-a44f-047bfea2d6c8 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:49.523311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c343d-fc9e-4bba-bad9-cfccbca4e256 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:49.559698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f4b06-5a36-4333-94a8-3adfcd0dff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:49.560370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f4b06-5a36-4333-94a8-3adfcd0dff77 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:49.560644 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f4b06-5a36-4333-94a8-3adfcd0dff77 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:49.560919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f4b06-5a36-4333-94a8-3adfcd0dff77 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:49.561648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f4b06-5a36-4333-94a8-3adfcd0dff77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:49.563592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f4b06-5a36-4333-94a8-3adfcd0dff77 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:49.569682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83036c76-6640-49c6-a44f-047bfea2d6c8 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:49.603555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ce907-c8d7-4195-b278-1d442bbb6cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:49.604205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ce907-c8d7-4195-b278-1d442bbb6cb4 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:49.604490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ce907-c8d7-4195-b278-1d442bbb6cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:49.604771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ce907-c8d7-4195-b278-1d442bbb6cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:49.605619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ce907-c8d7-4195-b278-1d442bbb6cb4 None admin] RBAC: Adding query filter params (role.id=32086f06b98341f09220be9a203efcb7, user.id=945d4bf08ad14121b1d393a979f56549, scope.system=all) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:49.605932 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ce907-c8d7-4195-b278-1d442bbb6cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:49.607380 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ce907-c8d7-4195-b278-1d442bbb6cb4 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:49.612381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 144/281] 10.222.0.39 () {56 vars in 1308 bytes} [Tue May 31 20:38:49 2022] GET /identity/v3/role_assignments?user.id=945d4bf08ad14121b1d393a979f56549&scope.system=all&role.id=32086f06b98341f09220be9a203efcb7 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:49.617630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ce907-c8d7-4195-b278-1d442bbb6cb4 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:49.619010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:49.669425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 138/282] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:38:49 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:38:49.750882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ce907-c8d7-4195-b278-1d442bbb6cb4 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:49.793295 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c22f7-c43b-4301-9eba-490619c244d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:49.794293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c22f7-c43b-4301-9eba-490619c244d3 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:49.794838 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c22f7-c43b-4301-9eba-490619c244d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:49.795262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c22f7-c43b-4301-9eba-490619c244d3 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:49.796217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c22f7-c43b-4301-9eba-490619c244d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:49.799941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c22f7-c43b-4301-9eba-490619c244d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:49.799941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c22f7-c43b-4301-9eba-490619c244d3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:49.809312 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 145/283] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:49.818146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f4b06-5a36-4333-94a8-3adfcd0dff77 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:49.910524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:49.933924 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f4b06-5a36-4333-94a8-3adfcd0dff77 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:49.975856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe90bec-8815-4ccf-8317-a109da8ea024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:49.976777 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe90bec-8815-4ccf-8317-a109da8ea024 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:49.977327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe90bec-8815-4ccf-8317-a109da8ea024 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:49.977627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe90bec-8815-4ccf-8317-a109da8ea024 None admin] PATH_INFO: `/v3/users/4350838777814489bddaa2df5bcce698` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:49.979036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe90bec-8815-4ccf-8317-a109da8ea024 None admin] RBAC: Authorizing `identity:get_user(user_id=4350838777814489bddaa2df5bcce698)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:49.980596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe90bec-8815-4ccf-8317-a109da8ea024 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:49.982764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 139/284] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:49 2022] GET /identity/v3/users/4350838777814489bddaa2df5bcce698 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:49.988347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c22f7-c43b-4301-9eba-490619c244d3 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:50.063860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:50.104401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c22f7-c43b-4301-9eba-490619c244d3 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:50.144668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6e34d-c5d8-4721-b79b-9c759db3466d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:50.145937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6e34d-c5d8-4721-b79b-9c759db3466d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:50.146446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6e34d-c5d8-4721-b79b-9c759db3466d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:50.146923 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6e34d-c5d8-4721-b79b-9c759db3466d None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:50.148450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6e34d-c5d8-4721-b79b-9c759db3466d None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:50.150181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6e34d-c5d8-4721-b79b-9c759db3466d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:50.152152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 146/285] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:49 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:50.159156 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe90bec-8815-4ccf-8317-a109da8ea024 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:50.287053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe90bec-8815-4ccf-8317-a109da8ea024 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:50.301314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf80a4-2e0f-4428-9c9c-b416d679977d None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:50.301997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf80a4-2e0f-4428-9c9c-b416d679977d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:50.302493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf80a4-2e0f-4428-9c9c-b416d679977d None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:50.304098 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 147/286] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:50.319513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f452736-6316-4bc8-9854-c7dffbe1bb76 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:50.320295 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f452736-6316-4bc8-9854-c7dffbe1bb76 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:50.320893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f452736-6316-4bc8-9854-c7dffbe1bb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:50.350802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6f452736-6316-4bc8-9854-c7dffbe1bb76 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:50.352389 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6f452736-6316-4bc8-9854-c7dffbe1bb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:50.376875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce0fa1-e9b8-49b1-b1e2-a163786ead8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:50.378063 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce0fa1-e9b8-49b1-b1e2-a163786ead8b None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:50.378457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce0fa1-e9b8-49b1-b1e2-a163786ead8b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:50.378798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce0fa1-e9b8-49b1-b1e2-a163786ead8b None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978/users/4350838777814489bddaa2df5bcce698/roles/595c6e7915fd49fba493261855a5f6b8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:50.382276 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce0fa1-e9b8-49b1-b1e2-a163786ead8b None admin] RBAC: Authorizing `identity:create_grant(project_id=3b81e28b94aa40e9a9ab61284d4c0978, user_id=4350838777814489bddaa2df5bcce698, role_id=595c6e7915fd49fba493261855a5f6b8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:50.383741 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce0fa1-e9b8-49b1-b1e2-a163786ead8b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:50.448697 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 148/287] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:50.472745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f452736-6316-4bc8-9854-c7dffbe1bb76 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:50.491796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 140/288] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:38:50 2022] PUT /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978/users/4350838777814489bddaa2df5bcce698/roles/595c6e7915fd49fba493261855a5f6b8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:38:50.552059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:50.594902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f452736-6316-4bc8-9854-c7dffbe1bb76 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:50.632242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfbf69-2c33-4f66-953a-9bd65ee03122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:50.633041 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfbf69-2c33-4f66-953a-9bd65ee03122 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:50.633319 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfbf69-2c33-4f66-953a-9bd65ee03122 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:50.633619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfbf69-2c33-4f66-953a-9bd65ee03122 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:50.646317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfbf69-2c33-4f66-953a-9bd65ee03122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-b8bfbf69-2c33-4f66-953a-9bd65ee03122 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:50.654286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:50.655149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:50.656936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:50.656936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:50.656936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:50.656936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:50.656936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:50.656936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:50.656936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:50.656936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:50.656936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:50.656936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:50.656936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:50.656936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:50.656936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 149/289] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:50.661631 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce0fa1-e9b8-49b1-b1e2-a163786ead8b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:50.671844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:50.777529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce0fa1-e9b8-49b1-b1e2-a163786ead8b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:50.815633 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fe0b9-8f5f-4fb9-adb1-d09edf30434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:50.816382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe0b9-8f5f-4fb9-adb1-d09edf30434c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:50.816662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe0b9-8f5f-4fb9-adb1-d09edf30434c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:50.816936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe0b9-8f5f-4fb9-adb1-d09edf30434c None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:50.817723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fe0b9-8f5f-4fb9-adb1-d09edf30434c None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:50.818031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fe0b9-8f5f-4fb9-adb1-d09edf30434c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:50.819424 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fe0b9-8f5f-4fb9-adb1-d09edf30434c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:50.828686 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 141/290] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:50.834506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfbf69-2c33-4f66-953a-9bd65ee03122 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:50.943716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfbf69-2c33-4f66-953a-9bd65ee03122 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:50.969313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:50.980255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3959c-7803-406a-8676-fd7ef7e4f065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:50.981129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3959c-7803-406a-8676-fd7ef7e4f065 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:50.981434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3959c-7803-406a-8676-fd7ef7e4f065 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:50.981711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3959c-7803-406a-8676-fd7ef7e4f065 None admin] PATH_INFO: `/v3/users/7386290933cf49eebc948d05f5e5cfd6` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:50.989493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3959c-7803-406a-8676-fd7ef7e4f065 None admin] RBAC: Authorizing `identity:get_user(user_id=7386290933cf49eebc948d05f5e5cfd6)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:50.989493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3959c-7803-406a-8676-fd7ef7e4f065 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:50.989493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 150/291] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:50 2022] GET /identity/v3/users/7386290933cf49eebc948d05f5e5cfd6 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:50.992095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fe0b9-8f5f-4fb9-adb1-d09edf30434c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:51.064788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:51.100317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fe0b9-8f5f-4fb9-adb1-d09edf30434c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:51.135963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619de473-18c2-4d98-9463-8dc31beda36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:51.136837 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619de473-18c2-4d98-9463-8dc31beda36d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:51.137258 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619de473-18c2-4d98-9463-8dc31beda36d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:51.137693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619de473-18c2-4d98-9463-8dc31beda36d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:51.210595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619de473-18c2-4d98-9463-8dc31beda36d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:51.212255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619de473-18c2-4d98-9463-8dc31beda36d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:51.283454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:51.318891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 142/292] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:51.324455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3959c-7803-406a-8676-fd7ef7e4f065 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:51.432217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3959c-7803-406a-8676-fd7ef7e4f065 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:51.467302 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c81e8-216c-471f-981c-0f8129440856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:51.468673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c81e8-216c-471f-981c-0f8129440856 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:51.468954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c81e8-216c-471f-981c-0f8129440856 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:51.469227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c81e8-216c-471f-981c-0f8129440856 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:51.470435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c81e8-216c-471f-981c-0f8129440856 None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:51.471884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c81e8-216c-471f-981c-0f8129440856 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:51.473892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 151/293] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:51 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:51.479906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619de473-18c2-4d98-9463-8dc31beda36d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:51.583482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619de473-18c2-4d98-9463-8dc31beda36d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:51.618497 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb5e8b-ecf3-4317-a0cc-26657c5b36a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:51.619145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5e8b-ecf3-4317-a0cc-26657c5b36a8 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:51.619426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5e8b-ecf3-4317-a0cc-26657c5b36a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:51.619700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5e8b-ecf3-4317-a0cc-26657c5b36a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:51.620515 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb5e8b-ecf3-4317-a0cc-26657c5b36a8 None admin] RBAC: Adding query filter params (role.id=32086f06b98341f09220be9a203efcb7, scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978, user.id=7386290933cf49eebc948d05f5e5cfd6) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:51.620824 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb5e8b-ecf3-4317-a0cc-26657c5b36a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:51.622295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb5e8b-ecf3-4317-a0cc-26657c5b36a8 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:51.628996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 143/294] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:51 2022] GET /identity/v3/role_assignments?user.id=7386290933cf49eebc948d05f5e5cfd6&scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978&role.id=32086f06b98341f09220be9a203efcb7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:52.503349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d59d0-cee9-4f04-8ec5-d60716a847cf None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:52.503879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d59d0-cee9-4f04-8ec5-d60716a847cf None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:52.503879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d59d0-cee9-4f04-8ec5-d60716a847cf None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:52.505262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 152/295] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:52.510839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca1762-5b22-416d-8992-cf929a872eab None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:52.511123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca1762-5b22-416d-8992-cf929a872eab None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:52.511400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca1762-5b22-416d-8992-cf929a872eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:52.528348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a1ca1762-5b22-416d-8992-cf929a872eab None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:52.529597 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a1ca1762-5b22-416d-8992-cf929a872eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:52.557486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:52.600071 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 144/296] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:52.625601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d59d0-cee9-4f04-8ec5-d60716a847cf None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:52.650594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2309b3d-5cf0-46d2-9528-6ceb439e6790 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:52.650902 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2309b3d-5cf0-46d2-9528-6ceb439e6790 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:52.651157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2309b3d-5cf0-46d2-9528-6ceb439e6790 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:52.652822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 145/297] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:38:52.659045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f4376-bd5d-4166-b519-f6992d23bece None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:52.659790 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f4376-bd5d-4166-b519-f6992d23bece None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:52.660220 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f4376-bd5d-4166-b519-f6992d23bece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:52.682134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-154f4376-bd5d-4166-b519-f6992d23bece None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:52.683877 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-154f4376-bd5d-4166-b519-f6992d23bece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:52.699967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:52.738830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d59d0-cee9-4f04-8ec5-d60716a847cf None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:52.759090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 146/298] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:52.760418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c28325-70da-4da8-b6d1-bb904a8c1372 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:52.760748 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c28325-70da-4da8-b6d1-bb904a8c1372 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:52.760985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c28325-70da-4da8-b6d1-bb904a8c1372 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:52.767071 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 147/299] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:52.768357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57112f13-7f6e-4902-8af5-c8d2a57cd5d2 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:52.768650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57112f13-7f6e-4902-8af5-c8d2a57cd5d2 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:52.768929 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57112f13-7f6e-4902-8af5-c8d2a57cd5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:52.785099 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0cbe7-7c7a-409c-8912-746138034e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:52.785316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-57112f13-7f6e-4902-8af5-c8d2a57cd5d2 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:52.785927 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0cbe7-7c7a-409c-8912-746138034e24 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:52.786212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0cbe7-7c7a-409c-8912-746138034e24 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:52.786488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0cbe7-7c7a-409c-8912-746138034e24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:52.786583 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-57112f13-7f6e-4902-8af5-c8d2a57cd5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:52.799234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0cbe7-7c7a-409c-8912-746138034e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-74f0cbe7-7c7a-409c-8912-746138034e24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:52.806931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:52.807880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 153/300] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:52.810134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0cbe7-7c7a-409c-8912-746138034e24 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:52.885401 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 148/301] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:52.885401 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57112f13-7f6e-4902-8af5-c8d2a57cd5d2 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:52.911995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:52.943473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0cbe7-7c7a-409c-8912-746138034e24 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:52.965242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:52.980471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3db9a-099e-4e6e-beef-3fde4bcb816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:52.981347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3db9a-099e-4e6e-beef-3fde4bcb816f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:52.981649 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3db9a-099e-4e6e-beef-3fde4bcb816f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:52.981918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3db9a-099e-4e6e-beef-3fde4bcb816f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:52.992938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3db9a-099e-4e6e-beef-3fde4bcb816f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:52.997832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57112f13-7f6e-4902-8af5-c8d2a57cd5d2 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-aef3db9a-099e-4e6e-beef-3fde4bcb816f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:53.001585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:53.002487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 154/302] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:53.008466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3db9a-099e-4e6e-beef-3fde4bcb816f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:53.034481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cecbf-ec41-4963-b24d-2b82122a5635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:53.035152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cecbf-ec41-4963-b24d-2b82122a5635 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:53.035434 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cecbf-ec41-4963-b24d-2b82122a5635 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:53.035762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cecbf-ec41-4963-b24d-2b82122a5635 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:53.036515 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cecbf-ec41-4963-b24d-2b82122a5635 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:53.036812 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cecbf-ec41-4963-b24d-2b82122a5635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:53.038372 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cecbf-ec41-4963-b24d-2b82122a5635 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:53.047588 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 149/303] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:53.048479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cecbf-ec41-4963-b24d-2b82122a5635 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:53.121818 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3db9a-099e-4e6e-beef-3fde4bcb816f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:53.141582 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:53.156565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb350c6-d276-48aa-b0b4-7f348f455f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:53.157357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb350c6-d276-48aa-b0b4-7f348f455f6d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:53.157691 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb350c6-d276-48aa-b0b4-7f348f455f6d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:53.157942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb350c6-d276-48aa-b0b4-7f348f455f6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:53.159109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb350c6-d276-48aa-b0b4-7f348f455f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:53.160561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb350c6-d276-48aa-b0b4-7f348f455f6d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:53.161163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cecbf-ec41-4963-b24d-2b82122a5635 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:53.162203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 155/304] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:53.162977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb350c6-d276-48aa-b0b4-7f348f455f6d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:53.204976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a61547-88c4-4157-b8ab-ec81638e0b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:53.205671 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a61547-88c4-4157-b8ab-ec81638e0b95 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:53.205955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a61547-88c4-4157-b8ab-ec81638e0b95 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:53.206232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a61547-88c4-4157-b8ab-ec81638e0b95 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:53.206978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a61547-88c4-4157-b8ab-ec81638e0b95 None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:53.207285 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a61547-88c4-4157-b8ab-ec81638e0b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:53.208655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a61547-88c4-4157-b8ab-ec81638e0b95 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:53.213769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:53.217066 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 150/305] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:53.218036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a61547-88c4-4157-b8ab-ec81638e0b95 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:53.265912 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb350c6-d276-48aa-b0b4-7f348f455f6d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:53.299987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688654e7-0307-49bf-8e2e-b59b23075f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:53.300867 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688654e7-0307-49bf-8e2e-b59b23075f59 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:53.301147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688654e7-0307-49bf-8e2e-b59b23075f59 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:53.301444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688654e7-0307-49bf-8e2e-b59b23075f59 None admin] PATH_INFO: `/v3/users/1a5ef1f03659470d9b6afcf19bbf5ebe` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:53.318070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688654e7-0307-49bf-8e2e-b59b23075f59 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5ef1f03659470d9b6afcf19bbf5ebe)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:53.319519 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688654e7-0307-49bf-8e2e-b59b23075f59 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:53.321194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 156/306] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:53 2022] GET /identity/v3/users/1a5ef1f03659470d9b6afcf19bbf5ebe => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:53.321940 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a61547-88c4-4157-b8ab-ec81638e0b95 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:53.322432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b5cac-a26d-45a1-bcd8-d9e64d446c18 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:53.322716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b5cac-a26d-45a1-bcd8-d9e64d446c18 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:53.322992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b5cac-a26d-45a1-bcd8-d9e64d446c18 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:53.324816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 157/307] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:53.324924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b5cac-a26d-45a1-bcd8-d9e64d446c18 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:53.360304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace0e49-b25d-4b8f-a94a-234800ad8b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:53.360959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace0e49-b25d-4b8f-a94a-234800ad8b83 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:53.361239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace0e49-b25d-4b8f-a94a-234800ad8b83 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:53.361539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace0e49-b25d-4b8f-a94a-234800ad8b83 None admin] PATH_INFO: `/v3/groups` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:53.362214 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace0e49-b25d-4b8f-a94a-234800ad8b83 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:53.363639 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace0e49-b25d-4b8f-a94a-234800ad8b83 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:53.423732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b5cac-a26d-45a1-bcd8-d9e64d446c18 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:53.431936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:53.457789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 151/308] 10.222.0.39 () {60 vars in 1134 bytes} [Tue May 31 20:38:53 2022] POST /identity/v3/groups => generated 229 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:38:53.458648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace0e49-b25d-4b8f-a94a-234800ad8b83 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:53.460504 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdc147-0330-4149-9794-83b7a627d0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:53.461419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdc147-0330-4149-9794-83b7a627d0fc None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:53.461708 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdc147-0330-4149-9794-83b7a627d0fc None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:53.461980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdc147-0330-4149-9794-83b7a627d0fc None admin] PATH_INFO: `/v3/users/945d4bf08ad14121b1d393a979f56549` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:53.463237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdc147-0330-4149-9794-83b7a627d0fc None admin] RBAC: Authorizing `identity:get_user(user_id=945d4bf08ad14121b1d393a979f56549)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:53.464711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdc147-0330-4149-9794-83b7a627d0fc None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:53.466457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 158/309] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:53 2022] GET /identity/v3/users/945d4bf08ad14121b1d393a979f56549 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:53.467866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe128f4-e006-454b-ae3f-7339a7b8d225 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:53.468154 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe128f4-e006-454b-ae3f-7339a7b8d225 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:53.468426 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe128f4-e006-454b-ae3f-7339a7b8d225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:53.480334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:53.488614 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-afe128f4-e006-454b-ae3f-7339a7b8d225 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:53.489909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-afe128f4-e006-454b-ae3f-7339a7b8d225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:53.572551 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 159/310] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:53.572551 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe128f4-e006-454b-ae3f-7339a7b8d225 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:53.597136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace0e49-b25d-4b8f-a94a-234800ad8b83 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:53.633397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5df0-491b-4a8d-83a1-e5b638941c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:53.634058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5df0-491b-4a8d-83a1-e5b638941c38 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:53.634345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5df0-491b-4a8d-83a1-e5b638941c38 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:53.634620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5df0-491b-4a8d-83a1-e5b638941c38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:53.635463 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c5df0-491b-4a8d-83a1-e5b638941c38 None admin] RBAC: Adding query filter params (role.id=595c6e7915fd49fba493261855a5f6b8, user.id=1a5ef1f03659470d9b6afcf19bbf5ebe, scope.system=all) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:53.635836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c5df0-491b-4a8d-83a1-e5b638941c38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:53.637309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c5df0-491b-4a8d-83a1-e5b638941c38 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:53.643744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 152/311] 10.222.0.39 () {56 vars in 1308 bytes} [Tue May 31 20:38:53 2022] GET /identity/v3/role_assignments?user.id=1a5ef1f03659470d9b6afcf19bbf5ebe&scope.system=all&role.id=595c6e7915fd49fba493261855a5f6b8 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:53.650127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5df0-491b-4a8d-83a1-e5b638941c38 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:53.704178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe128f4-e006-454b-ae3f-7339a7b8d225 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:53.709492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:53.747388 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:53.760431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088fc3b-4f01-4999-bcb2-220e29f7b984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:53.761343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088fc3b-4f01-4999-bcb2-220e29f7b984 None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:53.761676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088fc3b-4f01-4999-bcb2-220e29f7b984 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:53.761959 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088fc3b-4f01-4999-bcb2-220e29f7b984 None admin] PATH_INFO: `/v3/system/users/945d4bf08ad14121b1d393a979f56549/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:53.766368 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088fc3b-4f01-4999-bcb2-220e29f7b984 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=945d4bf08ad14121b1d393a979f56549, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:53.767782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088fc3b-4f01-4999-bcb2-220e29f7b984 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:53.787175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5df0-491b-4a8d-83a1-e5b638941c38 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:53.827855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6da095-527f-4c5e-bc2d-561f1af78743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:53.829286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6da095-527f-4c5e-bc2d-561f1af78743 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:53.829770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6da095-527f-4c5e-bc2d-561f1af78743 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:53.830195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6da095-527f-4c5e-bc2d-561f1af78743 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:53.842212 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6da095-527f-4c5e-bc2d-561f1af78743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:53.846699 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 160/312] 10.222.0.39 () {58 vars in 1334 bytes} [Tue May 31 20:38:53 2022] PUT /identity/v3/system/users/945d4bf08ad14121b1d393a979f56549/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-ff6da095-527f-4c5e-bc2d-561f1af78743 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:53.851238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:53.857518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:53.859076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:53.859076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:53.859076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:53.859076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:53.859076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:53.859076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:53.859076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:53.859076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:53.859076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:53.859076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:53.859076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:53.859076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:53.859076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 153/313] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:53.862619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088fc3b-4f01-4999-bcb2-220e29f7b984 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:53.980084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088fc3b-4f01-4999-bcb2-220e29f7b984 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:54.017909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39d3eb-9bb0-4911-9556-34885158fc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:54.018588 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39d3eb-9bb0-4911-9556-34885158fc01 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:54.018867 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39d3eb-9bb0-4911-9556-34885158fc01 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:54.019138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39d3eb-9bb0-4911-9556-34885158fc01 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:54.019896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39d3eb-9bb0-4911-9556-34885158fc01 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:54.020196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39d3eb-9bb0-4911-9556-34885158fc01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:54.021619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39d3eb-9bb0-4911-9556-34885158fc01 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:54.031769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 161/314] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:54.037417 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6da095-527f-4c5e-bc2d-561f1af78743 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:54.146943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6da095-527f-4c5e-bc2d-561f1af78743 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:54.177061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:54.183555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87764a01-1938-4e8e-b513-88da67f1a879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:54.184432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87764a01-1938-4e8e-b513-88da67f1a879 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:54.184716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87764a01-1938-4e8e-b513-88da67f1a879 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:54.184992 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87764a01-1938-4e8e-b513-88da67f1a879 None admin] PATH_INFO: `/v3/users/4350838777814489bddaa2df5bcce698` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:54.186312 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87764a01-1938-4e8e-b513-88da67f1a879 None admin] RBAC: Authorizing `identity:get_user(user_id=4350838777814489bddaa2df5bcce698)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:54.187769 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87764a01-1938-4e8e-b513-88da67f1a879 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:54.189649 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 154/315] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:54 2022] GET /identity/v3/users/4350838777814489bddaa2df5bcce698 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:54.197621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39d3eb-9bb0-4911-9556-34885158fc01 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:54.237816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:54.303366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39d3eb-9bb0-4911-9556-34885158fc01 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:54.343604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8cab5-737e-4d9c-b6f7-7f5d3df50d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:54.344509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cab5-737e-4d9c-b6f7-7f5d3df50d3a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:54.344935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cab5-737e-4d9c-b6f7-7f5d3df50d3a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:54.345350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cab5-737e-4d9c-b6f7-7f5d3df50d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:54.418227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8cab5-737e-4d9c-b6f7-7f5d3df50d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:54.419927 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8cab5-737e-4d9c-b6f7-7f5d3df50d3a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:54.451720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:54.525565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 162/316] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:38:54.534450 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87764a01-1938-4e8e-b513-88da67f1a879 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:54.648679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87764a01-1938-4e8e-b513-88da67f1a879 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:54.685399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb41b11-84d5-41ca-a107-2884a81d0481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:54.686925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb41b11-84d5-41ca-a107-2884a81d0481 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:54.687206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb41b11-84d5-41ca-a107-2884a81d0481 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:54.687478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb41b11-84d5-41ca-a107-2884a81d0481 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:54.688780 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb41b11-84d5-41ca-a107-2884a81d0481 None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:54.690577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb41b11-84d5-41ca-a107-2884a81d0481 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:54.692553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 155/317] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:38:54 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:54.698199 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8cab5-737e-4d9c-b6f7-7f5d3df50d3a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:54.802944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8cab5-737e-4d9c-b6f7-7f5d3df50d3a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:54.834152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:54.840452 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b8ec-269f-4e5d-9f6d-96bd7122ea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:54.845836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b8ec-269f-4e5d-9f6d-96bd7122ea27 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:54.845836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b8ec-269f-4e5d-9f6d-96bd7122ea27 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:54.845836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b8ec-269f-4e5d-9f6d-96bd7122ea27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:54.845836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b8ec-269f-4e5d-9f6d-96bd7122ea27 None admin] RBAC: Adding query filter params (role.id=595c6e7915fd49fba493261855a5f6b8, scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978, user.id=4350838777814489bddaa2df5bcce698) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:54.845836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b8ec-269f-4e5d-9f6d-96bd7122ea27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:54.845836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b8ec-269f-4e5d-9f6d-96bd7122ea27 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:54.852101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 163/318] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:38:54 2022] GET /identity/v3/role_assignments?user.id=4350838777814489bddaa2df5bcce698&scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978&role.id=595c6e7915fd49fba493261855a5f6b8 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:55.830300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971242c-7a81-4a06-b8dd-d10d268c6643 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:55.830835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971242c-7a81-4a06-b8dd-d10d268c6643 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:55.830835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971242c-7a81-4a06-b8dd-d10d268c6643 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:55.832267 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 156/319] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:55.838627 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87184cc-c0ac-44eb-9868-8242cc755494 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:55.839143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87184cc-c0ac-44eb-9868-8242cc755494 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:55.839217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87184cc-c0ac-44eb-9868-8242cc755494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:55.859651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-e87184cc-c0ac-44eb-9868-8242cc755494 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:55.860888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e87184cc-c0ac-44eb-9868-8242cc755494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:55.941423 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 164/320] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:55.957445 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971242c-7a81-4a06-b8dd-d10d268c6643 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:55.999264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1984862-63e9-4c7e-b84b-fc78b867e24f None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:55.999569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1984862-63e9-4c7e-b84b-fc78b867e24f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:55.999830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1984862-63e9-4c7e-b84b-fc78b867e24f None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:56.001337 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 165/321] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:56.006200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4812-cafb-44e3-a547-635c3290b71b None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:56.006487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4812-cafb-44e3-a547-635c3290b71b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:56.006769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4812-cafb-44e3-a547-635c3290b71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:56.023490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-910b4812-cafb-44e3-a547-635c3290b71b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:56.024670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-910b4812-cafb-44e3-a547-635c3290b71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:56.029353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:56.068154 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971242c-7a81-4a06-b8dd-d10d268c6643 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:56.100138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 166/322] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:56.108835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b6c59-0750-48e0-93c2-7fb03ab69613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:56.109679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b6c59-0750-48e0-93c2-7fb03ab69613 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:56.109964 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b6c59-0750-48e0-93c2-7fb03ab69613 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:56.110238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b6c59-0750-48e0-93c2-7fb03ab69613 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:56.111397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b6c59-0750-48e0-93c2-7fb03ab69613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:56.112892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b6c59-0750-48e0-93c2-7fb03ab69613 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:56.114666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 157/323] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:38:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:56.120380 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b4812-cafb-44e3-a547-635c3290b71b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:56.124635 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b6c59-0750-48e0-93c2-7fb03ab69613 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:56.179534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:56.224444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b4812-cafb-44e3-a547-635c3290b71b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:56.230602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b6c59-0750-48e0-93c2-7fb03ab69613 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:56.263125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f73b5e-e222-4e60-b672-0d1d2b1bcab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:56.263796 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f73b5e-e222-4e60-b672-0d1d2b1bcab7 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:56.264697 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f73b5e-e222-4e60-b672-0d1d2b1bcab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:56.264975 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f73b5e-e222-4e60-b672-0d1d2b1bcab7 None admin] PATH_INFO: `/v3/groups` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:56.265445 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e997b-c952-4d1c-b83c-efb65fba8981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:56.265726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f73b5e-e222-4e60-b672-0d1d2b1bcab7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:56.266234 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e997b-c952-4d1c-b83c-efb65fba8981 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:56.266513 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e997b-c952-4d1c-b83c-efb65fba8981 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:56.266783 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e997b-c952-4d1c-b83c-efb65fba8981 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:56.267175 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f73b5e-e222-4e60-b672-0d1d2b1bcab7 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:56.268648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:56.278070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e997b-c952-4d1c-b83c-efb65fba8981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-651e997b-c952-4d1c-b83c-efb65fba8981 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:56.285889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:56.286967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:56.287836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:56.287836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:56.287836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:56.287836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:56.287836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:56.287836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:56.287836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:56.287836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:56.287836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:56.287836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:56.287836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:38:56.287836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:38:56.287836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 158/324] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:38:56.290684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871c3b-cd52-4ce1-9f1f-07cfd03986d7 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:56.290974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871c3b-cd52-4ce1-9f1f-07cfd03986d7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:56.291254 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871c3b-cd52-4ce1-9f1f-07cfd03986d7 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:56.292545 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 159/325] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:56.293295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0871c3b-cd52-4ce1-9f1f-07cfd03986d7 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:56.362649 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 167/326] 10.222.0.39 () {60 vars in 1134 bytes} [Tue May 31 20:38:56 2022] POST /identity/v3/groups => generated 226 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:38:56.364121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a2ad9-ce5b-4b7d-929c-8897c936e3b4 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:56.364543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a2ad9-ce5b-4b7d-929c-8897c936e3b4 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:56.364997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a2ad9-ce5b-4b7d-929c-8897c936e3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:56.383535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-f16a2ad9-ce5b-4b7d-929c-8897c936e3b4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:56.384752 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-f16a2ad9-ce5b-4b7d-929c-8897c936e3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:56.400835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0871c3b-cd52-4ce1-9f1f-07cfd03986d7 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:56.440427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa792cb-f8ba-4b0e-b934-2775b938d394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:56.441110 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa792cb-f8ba-4b0e-b934-2775b938d394 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:56.441419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa792cb-f8ba-4b0e-b934-2775b938d394 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:56.441705 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa792cb-f8ba-4b0e-b934-2775b938d394 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:56.442469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa792cb-f8ba-4b0e-b934-2775b938d394 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:56.442784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa792cb-f8ba-4b0e-b934-2775b938d394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:56.444189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa792cb-f8ba-4b0e-b934-2775b938d394 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:56.460260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 160/327] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:56.461520 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa792cb-f8ba-4b0e-b934-2775b938d394 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:56.477410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 168/328] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:56.492357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a2ad9-ce5b-4b7d-929c-8897c936e3b4 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:56.535330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:56.544473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:56.593906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa792cb-f8ba-4b0e-b934-2775b938d394 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:56.609710 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a2ad9-ce5b-4b7d-929c-8897c936e3b4 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:56.636723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e12241-aa7e-4e1d-83d3-a3e78a62b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:56.637726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e12241-aa7e-4e1d-83d3-a3e78a62b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:56.638007 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e12241-aa7e-4e1d-83d3-a3e78a62b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:56.638623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e12241-aa7e-4e1d-83d3-a3e78a62b5b1 None admin] PATH_INFO: `/v3/users/1a5ef1f03659470d9b6afcf19bbf5ebe` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:56.640496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e12241-aa7e-4e1d-83d3-a3e78a62b5b1 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5ef1f03659470d9b6afcf19bbf5ebe)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:56.642016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e12241-aa7e-4e1d-83d3-a3e78a62b5b1 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:56.643682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 161/329] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:56 2022] GET /identity/v3/users/1a5ef1f03659470d9b6afcf19bbf5ebe => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:56.650104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e12241-aa7e-4e1d-83d3-a3e78a62b5b1 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:56.652667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9da4ea-da78-4252-9960-a1ee7fdbdba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:56.653527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9da4ea-da78-4252-9960-a1ee7fdbdba7 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:56.653813 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9da4ea-da78-4252-9960-a1ee7fdbdba7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:56.654089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9da4ea-da78-4252-9960-a1ee7fdbdba7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:56.666887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9da4ea-da78-4252-9960-a1ee7fdbdba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-ad9da4ea-da78-4252-9960-a1ee7fdbdba7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:56.676307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:56.677255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:56.678101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:56.678101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:56.678101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:56.678101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:56.678101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:56.678101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:56.678101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:56.678101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:56.678101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:56.678101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:56.678101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:38:56.678101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:56.681828 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 169/330] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:38:56.684007 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9da4ea-da78-4252-9960-a1ee7fdbdba7 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:56.775894 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e12241-aa7e-4e1d-83d3-a3e78a62b5b1 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:56.807768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:56.815170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9da4ea-da78-4252-9960-a1ee7fdbdba7 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:56.827246 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a53f2-0987-4b67-924b-b398ce91d601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:56.828685 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a53f2-0987-4b67-924b-b398ce91d601 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:56.829141 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a53f2-0987-4b67-924b-b398ce91d601 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:56.829717 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a53f2-0987-4b67-924b-b398ce91d601 None admin] PATH_INFO: `/v3/system/users/1a5ef1f03659470d9b6afcf19bbf5ebe/roles/595c6e7915fd49fba493261855a5f6b8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:56.831289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a53f2-0987-4b67-924b-b398ce91d601 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1a5ef1f03659470d9b6afcf19bbf5ebe, role_id=595c6e7915fd49fba493261855a5f6b8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:56.832893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a53f2-0987-4b67-924b-b398ce91d601 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:56.833480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:56.862442 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363ed16-9762-4c34-84f0-dd77ca1d5479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:56.863171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ed16-9762-4c34-84f0-dd77ca1d5479 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:56.863451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ed16-9762-4c34-84f0-dd77ca1d5479 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:56.863723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ed16-9762-4c34-84f0-dd77ca1d5479 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:56.864478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363ed16-9762-4c34-84f0-dd77ca1d5479 None admin] RBAC: Adding query filter params (name=member) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:56.864786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363ed16-9762-4c34-84f0-dd77ca1d5479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:56.866405 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363ed16-9762-4c34-84f0-dd77ca1d5479 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:56.877094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 170/331] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:56.884857 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363ed16-9762-4c34-84f0-dd77ca1d5479 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:56.918178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 162/332] 10.222.0.39 () {58 vars in 1334 bytes} [Tue May 31 20:38:56 2022] PUT /identity/v3/system/users/1a5ef1f03659470d9b6afcf19bbf5ebe/roles/595c6e7915fd49fba493261855a5f6b8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:38:57.009728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363ed16-9762-4c34-84f0-dd77ca1d5479 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:57.064450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343d26e-5998-4e2d-99fa-9c880a8f7b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:57.065795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343d26e-5998-4e2d-99fa-9c880a8f7b07 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:57.066318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343d26e-5998-4e2d-99fa-9c880a8f7b07 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:57.066767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343d26e-5998-4e2d-99fa-9c880a8f7b07 None admin] PATH_INFO: `/v3/users/945d4bf08ad14121b1d393a979f56549` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:57.068392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343d26e-5998-4e2d-99fa-9c880a8f7b07 None admin] RBAC: Authorizing `identity:get_user(user_id=945d4bf08ad14121b1d393a979f56549)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:57.070173 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343d26e-5998-4e2d-99fa-9c880a8f7b07 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:57.072190 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 171/333] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:38:56 2022] GET /identity/v3/users/945d4bf08ad14121b1d393a979f56549 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:38:57.078697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a53f2-0987-4b67-924b-b398ce91d601 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:57.210346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a53f2-0987-4b67-924b-b398ce91d601 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:57.258151 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d37be-1629-4f9f-99bc-f3b15ecfeb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:57.258843 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d37be-1629-4f9f-99bc-f3b15ecfeb09 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:57.259134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d37be-1629-4f9f-99bc-f3b15ecfeb09 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:57.259419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d37be-1629-4f9f-99bc-f3b15ecfeb09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:57.260274 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d37be-1629-4f9f-99bc-f3b15ecfeb09 None admin] RBAC: Adding query filter params (role.id=32086f06b98341f09220be9a203efcb7, user.id=945d4bf08ad14121b1d393a979f56549, scope.system=all) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:57.260647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d37be-1629-4f9f-99bc-f3b15ecfeb09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:57.262178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d37be-1629-4f9f-99bc-f3b15ecfeb09 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:57.276936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 163/334] 10.222.0.39 () {56 vars in 1308 bytes} [Tue May 31 20:38:57 2022] GET /identity/v3/role_assignments?user.id=945d4bf08ad14121b1d393a979f56549&scope.system=all&role.id=32086f06b98341f09220be9a203efcb7 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:59.269006 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6bd90-0dba-4990-a10a-10671149e4f8 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:59.269573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6bd90-0dba-4990-a10a-10671149e4f8 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:59.269573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6bd90-0dba-4990-a10a-10671149e4f8 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:59.271244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 172/335] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:59.276552 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2107d35-9035-4905-b1df-45b6ac37cccf None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:59.277426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2107d35-9035-4905-b1df-45b6ac37cccf None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:59.277913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2107d35-9035-4905-b1df-45b6ac37cccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:59.315932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c2107d35-9035-4905-b1df-45b6ac37cccf None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:59.317399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c2107d35-9035-4905-b1df-45b6ac37cccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:59.382055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:59.411221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 164/336] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:59.452027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6bd90-0dba-4990-a10a-10671149e4f8 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:59.492482 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:59.572661 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6bd90-0dba-4990-a10a-10671149e4f8 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:59.617875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121912e6-b3b7-48bc-8d46-3942327d0513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:59.618697 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121912e6-b3b7-48bc-8d46-3942327d0513 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:59.618974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121912e6-b3b7-48bc-8d46-3942327d0513 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:59.619243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121912e6-b3b7-48bc-8d46-3942327d0513 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:59.634997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121912e6-b3b7-48bc-8d46-3942327d0513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-121912e6-b3b7-48bc-8d46-3942327d0513 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:38:59.643709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:38:59.644672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:38:59.645549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:38:59.645549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:38:59.645549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:38:59.645549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:38:59.645549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:38:59.645549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:38:59.645549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:38:59.645549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:38:59.645549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:38:59.645549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:38:59.645549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:38:59.645549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:38:59.650619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 173/337] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:38:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:38:59.656667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2107d35-9035-4905-b1df-45b6ac37cccf None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:59.668881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d83c-afe0-4f0b-ba26-29e0e6459edd None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:59.669194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d83c-afe0-4f0b-ba26-29e0e6459edd None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:59.669481 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d83c-afe0-4f0b-ba26-29e0e6459edd None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:59.671412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 174/338] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:59.683262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cabc39-af79-46a7-9c1e-0afd62e86f79 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:59.683585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cabc39-af79-46a7-9c1e-0afd62e86f79 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:59.683816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cabc39-af79-46a7-9c1e-0afd62e86f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:59.709035 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-e0cabc39-af79-46a7-9c1e-0afd62e86f79 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:59.710278 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e0cabc39-af79-46a7-9c1e-0afd62e86f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:59.793141 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2107d35-9035-4905-b1df-45b6ac37cccf None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:38:59.812977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 175/339] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:38:59.814594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a06313-c64b-41fc-8fd2-d5a08737a78c None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:59.815047 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a06313-c64b-41fc-8fd2-d5a08737a78c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:59.815479 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a06313-c64b-41fc-8fd2-d5a08737a78c None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:59.819019 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 176/340] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:38:59.827405 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f86bf0-376a-46ae-84e3-e58caa6fd89d None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:59.828268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f86bf0-376a-46ae-84e3-e58caa6fd89d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:59.828744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f86bf0-376a-46ae-84e3-e58caa6fd89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:59.845784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab6a25-74d9-4f35-98e6-87ab1181fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:38:59.858023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab6a25-74d9-4f35-98e6-87ab1181fc46 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:38:59.858023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab6a25-74d9-4f35-98e6-87ab1181fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:38:59.858023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab6a25-74d9-4f35-98e6-87ab1181fc46 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:38:59.858023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab6a25-74d9-4f35-98e6-87ab1181fc46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:38:59.858023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab6a25-74d9-4f35-98e6-87ab1181fc46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:38:59.858023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab6a25-74d9-4f35-98e6-87ab1181fc46 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:38:59.858540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a6f86bf0-376a-46ae-84e3-e58caa6fd89d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:38:59.858540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a6f86bf0-376a-46ae-84e3-e58caa6fd89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:38:59.864175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 165/341] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:38:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:38:59.869893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab6a25-74d9-4f35-98e6-87ab1181fc46 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:38:59.893536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:59.925262 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:38:59.946465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 177/342] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:38:59.947329 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f86bf0-376a-46ae-84e3-e58caa6fd89d None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:00.080549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f86bf0-376a-46ae-84e3-e58caa6fd89d None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:00.082808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab6a25-74d9-4f35-98e6-87ab1181fc46 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:00.123356 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede392f7-6054-4229-9d34-4fb877d1399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:00.124170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede392f7-6054-4229-9d34-4fb877d1399a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:00.124453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede392f7-6054-4229-9d34-4fb877d1399a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:00.124727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede392f7-6054-4229-9d34-4fb877d1399a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:00.138348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede392f7-6054-4229-9d34-4fb877d1399a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-ede392f7-6054-4229-9d34-4fb877d1399a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:00.151158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:00.152092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:00.152893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:00.152893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:00.152893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:00.152893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:00.152893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:00.152893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:00.152893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:00.152893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:00.152893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:00.152893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:00.152893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:39:00.152893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:00.152893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 178/343] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:38:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:00.154096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede392f7-6054-4229-9d34-4fb877d1399a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:00.154941 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70f2af-cb7c-474a-887f-0ca50fa8a905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:00.155814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70f2af-cb7c-474a-887f-0ca50fa8a905 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:00.156347 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70f2af-cb7c-474a-887f-0ca50fa8a905 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:00.156813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70f2af-cb7c-474a-887f-0ca50fa8a905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:00.177763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:00.266834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70f2af-cb7c-474a-887f-0ca50fa8a905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:00.268292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70f2af-cb7c-474a-887f-0ca50fa8a905 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:00.280033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede392f7-6054-4229-9d34-4fb877d1399a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:00.322261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6eff-7972-49cb-92dd-b002dc21baa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:00.323075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6eff-7972-49cb-92dd-b002dc21baa1 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:00.323472 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6eff-7972-49cb-92dd-b002dc21baa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:00.323754 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6eff-7972-49cb-92dd-b002dc21baa1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:00.337261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e6eff-7972-49cb-92dd-b002dc21baa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:00.348704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-3d3e6eff-7972-49cb-92dd-b002dc21baa1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:00.349822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:00.350727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:00.351631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:00.351631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:00.351631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:00.351631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:00.351631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:00.351631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:00.351631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:00.351631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:00.351631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:00.351631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:00.351631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:39:00.351631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:00.351631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 179/344] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:00.352298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6eff-7972-49cb-92dd-b002dc21baa1 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:00.446543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:00.473961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 166/345] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:39:00.475076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70f2af-cb7c-474a-887f-0ca50fa8a905 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:00.486362 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6eff-7972-49cb-92dd-b002dc21baa1 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:00.533082 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cd8ab-1d87-4783-82a1-b81892fffaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:00.534447 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cd8ab-1d87-4783-82a1-b81892fffaba None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:00.536017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cd8ab-1d87-4783-82a1-b81892fffaba None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:00.536017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cd8ab-1d87-4783-82a1-b81892fffaba None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:00.536481 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cd8ab-1d87-4783-82a1-b81892fffaba None admin] RBAC: Adding query filter params (name=member) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:00.536896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cd8ab-1d87-4783-82a1-b81892fffaba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:00.538802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cd8ab-1d87-4783-82a1-b81892fffaba None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:00.552263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 180/346] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:00.557412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19de8da-9e3a-4db7-bfbd-f87874f171e3 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:00.557412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19de8da-9e3a-4db7-bfbd-f87874f171e3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:00.557412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19de8da-9e3a-4db7-bfbd-f87874f171e3 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:00.557412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 181/347] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:00.557412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19de8da-9e3a-4db7-bfbd-f87874f171e3 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:00.616015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70f2af-cb7c-474a-887f-0ca50fa8a905 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:00.655680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961d7da-c182-4457-bbf7-1a7499111938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:00.656687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961d7da-c182-4457-bbf7-1a7499111938 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:00.657157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961d7da-c182-4457-bbf7-1a7499111938 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:00.657680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961d7da-c182-4457-bbf7-1a7499111938 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:00.658691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961d7da-c182-4457-bbf7-1a7499111938 None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:00.659232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961d7da-c182-4457-bbf7-1a7499111938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:00.660836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961d7da-c182-4457-bbf7-1a7499111938 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:00.668235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:00.673569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 167/348] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:00.674635 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961d7da-c182-4457-bbf7-1a7499111938 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:00.698982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19de8da-9e3a-4db7-bfbd-f87874f171e3 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:00.738888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18263360-93f1-4d73-b68b-43070f61ac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:00.739763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18263360-93f1-4d73-b68b-43070f61ac9d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:00.740049 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18263360-93f1-4d73-b68b-43070f61ac9d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:00.740339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18263360-93f1-4d73-b68b-43070f61ac9d None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:00.742317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18263360-93f1-4d73-b68b-43070f61ac9d None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:00.743778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18263360-93f1-4d73-b68b-43070f61ac9d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:00.745513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 182/349] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:00 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:00.746686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8ff7f-f5bb-469d-8140-be3dd2f4931b None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:00.746974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8ff7f-f5bb-469d-8140-be3dd2f4931b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:00.747249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8ff7f-f5bb-469d-8140-be3dd2f4931b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:00.753736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:00.764605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-fed8ff7f-f5bb-469d-8140-be3dd2f4931b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:00.765836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-fed8ff7f-f5bb-469d-8140-be3dd2f4931b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:00.808779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961d7da-c182-4457-bbf7-1a7499111938 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:00.843655 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 183/350] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:00.844534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8ff7f-f5bb-469d-8140-be3dd2f4931b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:00.846486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccedf1-47f1-4fe0-ac10-2831f6250bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:00.847141 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccedf1-47f1-4fe0-ac10-2831f6250bc6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:00.847420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccedf1-47f1-4fe0-ac10-2831f6250bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:00.847693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccedf1-47f1-4fe0-ac10-2831f6250bc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:00.922465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:00.925540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccedf1-47f1-4fe0-ac10-2831f6250bc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:00.927024 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccedf1-47f1-4fe0-ac10-2831f6250bc6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:00.952815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8ff7f-f5bb-469d-8140-be3dd2f4931b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:00.996037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde2ca6-42fe-468d-96a2-5add026c14e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:00.996761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde2ca6-42fe-468d-96a2-5add026c14e9 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:00.997053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde2ca6-42fe-468d-96a2-5add026c14e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:00.997334 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde2ca6-42fe-468d-96a2-5add026c14e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:01.000640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:01.056282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 168/351] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:01.057302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccedf1-47f1-4fe0-ac10-2831f6250bc6 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:01.101289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde2ca6-42fe-468d-96a2-5add026c14e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:01.104892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde2ca6-42fe-468d-96a2-5add026c14e9 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:01.204466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:01.208080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccedf1-47f1-4fe0-ac10-2831f6250bc6 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:01.227808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 184/352] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:01.228996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde2ca6-42fe-468d-96a2-5add026c14e9 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:01.259414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974bfd5-0280-456a-a34a-ac9f94a52b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:01.260286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974bfd5-0280-456a-a34a-ac9f94a52b70 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:01.260564 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974bfd5-0280-456a-a34a-ac9f94a52b70 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:01.260835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974bfd5-0280-456a-a34a-ac9f94a52b70 None admin] PATH_INFO: `/v3/groups/db903d58e04b40ad886a83249d9e03de` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:01.272727 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974bfd5-0280-456a-a34a-ac9f94a52b70 None admin] RBAC: Authorizing `identity:get_group(group_id=db903d58e04b40ad886a83249d9e03de)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:01.274247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974bfd5-0280-456a-a34a-ac9f94a52b70 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:01.277715 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 169/353] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:01 2022] GET /identity/v3/groups/db903d58e04b40ad886a83249d9e03de => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:01.277715 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18091584-83fc-498e-9103-9c5c8ea332e4 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:01.277715 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18091584-83fc-498e-9103-9c5c8ea332e4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:01.278142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18091584-83fc-498e-9103-9c5c8ea332e4 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:01.279402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 170/354] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:01.280179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18091584-83fc-498e-9103-9c5c8ea332e4 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:01.291499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:01.391981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde2ca6-42fe-468d-96a2-5add026c14e9 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:01.414850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18091584-83fc-498e-9103-9c5c8ea332e4 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:01.433360 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2d406-b667-475e-8514-a6641e6bfc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:01.434265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2d406-b667-475e-8514-a6641e6bfc3d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:01.434546 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2d406-b667-475e-8514-a6641e6bfc3d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:01.434819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2d406-b667-475e-8514-a6641e6bfc3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:01.452293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2d406-b667-475e-8514-a6641e6bfc3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-04f2d406-b667-475e-8514-a6641e6bfc3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:01.460663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:01.461830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:01.462647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:01.462647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:01.462647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:01.462647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:01.462647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:01.462647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:01.462647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:01.462647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:01.462647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:01.462647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:01.462647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:39:01.462647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:01.463301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 185/355] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:01.463942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2d406-b667-475e-8514-a6641e6bfc3d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:01.468355 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b35c0a-7bb9-4430-8163-8690d8ff4c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:01.469934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b35c0a-7bb9-4430-8163-8690d8ff4c3c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:01.469934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b35c0a-7bb9-4430-8163-8690d8ff4c3c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:01.469934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b35c0a-7bb9-4430-8163-8690d8ff4c3c None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:01.471878 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b35c0a-7bb9-4430-8163-8690d8ff4c3c None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:01.474201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b35c0a-7bb9-4430-8163-8690d8ff4c3c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:01.476058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 171/356] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:01 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:01.478576 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b78c87-c8e8-44ba-9728-5c3311c4a21b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:01.478866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b78c87-c8e8-44ba-9728-5c3311c4a21b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:01.479142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b78c87-c8e8-44ba-9728-5c3311c4a21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:01.497088 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-26b78c87-c8e8-44ba-9728-5c3311c4a21b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:01.499943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-26b78c87-c8e8-44ba-9728-5c3311c4a21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:01.536744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:01.584102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:01.591037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2d406-b667-475e-8514-a6641e6bfc3d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:01.603890 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 172/357] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:01.605055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b78c87-c8e8-44ba-9728-5c3311c4a21b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:01.641724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91048f4f-1834-402f-b24f-2797e69d7409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:01.643037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91048f4f-1834-402f-b24f-2797e69d7409 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:01.643315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91048f4f-1834-402f-b24f-2797e69d7409 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:01.644393 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91048f4f-1834-402f-b24f-2797e69d7409 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:01.646500 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91048f4f-1834-402f-b24f-2797e69d7409 None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:01.648209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91048f4f-1834-402f-b24f-2797e69d7409 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:01.650220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 186/358] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:01 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:01.651452 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91048f4f-1834-402f-b24f-2797e69d7409 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:01.733550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b78c87-c8e8-44ba-9728-5c3311c4a21b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:01.777475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54b21c-5def-494b-848e-4bcc1ad6c03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:01.778143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54b21c-5def-494b-848e-4bcc1ad6c03c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:01.778511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54b21c-5def-494b-848e-4bcc1ad6c03c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:01.778833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54b21c-5def-494b-848e-4bcc1ad6c03c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:01.779656 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54b21c-5def-494b-848e-4bcc1ad6c03c None admin] RBAC: Adding query filter params (group.id=db903d58e04b40ad886a83249d9e03de, role.id=cf5f891b636947e0840ddfa871027fed, scope.project.id=c9ce5e803e154d27aaf0235fa210da97) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:01.779970 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54b21c-5def-494b-848e-4bcc1ad6c03c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:01.781537 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54b21c-5def-494b-848e-4bcc1ad6c03c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:01.785334 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91048f4f-1834-402f-b24f-2797e69d7409 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:01.787623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 173/359] 10.222.0.39 () {56 vars in 1376 bytes} [Tue May 31 20:39:01 2022] GET /identity/v3/role_assignments?group.id=db903d58e04b40ad886a83249d9e03de&scope.project.id=c9ce5e803e154d27aaf0235fa210da97&role.id=cf5f891b636947e0840ddfa871027fed => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:01.792334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54b21c-5def-494b-848e-4bcc1ad6c03c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:01.834937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ac081-da26-4702-8396-123f00e411d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:01.835230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:01.835630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ac081-da26-4702-8396-123f00e411d7 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:01.835917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ac081-da26-4702-8396-123f00e411d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:01.836195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ac081-da26-4702-8396-123f00e411d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:01.836996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ac081-da26-4702-8396-123f00e411d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:01.837283 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ac081-da26-4702-8396-123f00e411d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:01.838733 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ac081-da26-4702-8396-123f00e411d7 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:01.849054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 187/360] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:39:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:01.852212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ac081-da26-4702-8396-123f00e411d7 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:01.891386 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:01.948963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54b21c-5def-494b-848e-4bcc1ad6c03c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:01.995182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f065b-9d50-4ebe-b895-6d038d610fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:01.995980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f065b-9d50-4ebe-b895-6d038d610fb1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:01.996261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f065b-9d50-4ebe-b895-6d038d610fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:01.996533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f065b-9d50-4ebe-b895-6d038d610fb1 None admin] PATH_INFO: `/v3/groups/db903d58e04b40ad886a83249d9e03de` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:02.000050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f065b-9d50-4ebe-b895-6d038d610fb1 None admin] RBAC: Authorizing `identity:get_group(group_id=db903d58e04b40ad886a83249d9e03de)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:02.000196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ac081-da26-4702-8396-123f00e411d7 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:02.000292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f065b-9d50-4ebe-b895-6d038d610fb1 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:02.003114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 174/361] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:01 2022] GET /identity/v3/groups/db903d58e04b40ad886a83249d9e03de => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:02.004045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f065b-9d50-4ebe-b895-6d038d610fb1 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:02.047709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913708f-0ec8-4ef6-bcd0-afb67289e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:02.048518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913708f-0ec8-4ef6-bcd0-afb67289e789 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:02.048798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913708f-0ec8-4ef6-bcd0-afb67289e789 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:02.049071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913708f-0ec8-4ef6-bcd0-afb67289e789 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:02.059944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913708f-0ec8-4ef6-bcd0-afb67289e789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-5913708f-0ec8-4ef6-bcd0-afb67289e789 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:02.068499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:02.069566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:02.070401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:02.070401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:02.070401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:02.070401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:02.070401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:02.070401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:02.070401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:02.070401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:02.070401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:02.070401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:02.070401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:39:02.070401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:02.071030 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 188/362] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:39:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:02.072021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b39b3-ba77-425a-a9b9-1a0476c98407 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:02.072306 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b39b3-ba77-425a-a9b9-1a0476c98407 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:02.072583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b39b3-ba77-425a-a9b9-1a0476c98407 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:02.074077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 189/363] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:02.074770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b39b3-ba77-425a-a9b9-1a0476c98407 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:02.146500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:02.153098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f065b-9d50-4ebe-b895-6d038d610fb1 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:02.194766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebb3ac-5f27-4129-a403-715125403032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:02.195627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebb3ac-5f27-4129-a403-715125403032 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:02.195907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebb3ac-5f27-4129-a403-715125403032 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:02.196181 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebb3ac-5f27-4129-a403-715125403032 None admin] PATH_INFO: `/v3/groups/db903d58e04b40ad886a83249d9e03de` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:02.197846 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:02.197964 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebb3ac-5f27-4129-a403-715125403032 None admin] RBAC: Authorizing `identity:get_group(group_id=db903d58e04b40ad886a83249d9e03de)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:02.199307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebb3ac-5f27-4129-a403-715125403032 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:02.202331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 175/364] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:02 2022] GET /identity/v3/groups/db903d58e04b40ad886a83249d9e03de => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:02.203827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebb3ac-5f27-4129-a403-715125403032 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:02.217315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b39b3-ba77-425a-a9b9-1a0476c98407 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:02.260885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010285c6-462e-4f9a-a90a-712449d92804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:02.262107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010285c6-462e-4f9a-a90a-712449d92804 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:02.262592 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010285c6-462e-4f9a-a90a-712449d92804 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:02.262869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010285c6-462e-4f9a-a90a-712449d92804 None admin] PATH_INFO: `/v3/users/1a5ef1f03659470d9b6afcf19bbf5ebe` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:02.264683 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010285c6-462e-4f9a-a90a-712449d92804 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5ef1f03659470d9b6afcf19bbf5ebe)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:02.266189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010285c6-462e-4f9a-a90a-712449d92804 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:02.268197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 190/365] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:39:02 2022] GET /identity/v3/users/1a5ef1f03659470d9b6afcf19bbf5ebe => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:02.269005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010285c6-462e-4f9a-a90a-712449d92804 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:02.344742 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebb3ac-5f27-4129-a403-715125403032 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:02.394575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008fb8e-9a6a-4dc7-87d9-69576bb6ea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:02.395536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008fb8e-9a6a-4dc7-87d9-69576bb6ea5e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:02.395816 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008fb8e-9a6a-4dc7-87d9-69576bb6ea5e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:02.396087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008fb8e-9a6a-4dc7-87d9-69576bb6ea5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:02.396916 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008fb8e-9a6a-4dc7-87d9-69576bb6ea5e None admin] RBAC: Adding query filter params (group.id=db903d58e04b40ad886a83249d9e03de, role.id=32086f06b98341f09220be9a203efcb7, scope.project.id=c9ce5e803e154d27aaf0235fa210da97) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:02.397033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010285c6-462e-4f9a-a90a-712449d92804 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:02.397548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008fb8e-9a6a-4dc7-87d9-69576bb6ea5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:02.399366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008fb8e-9a6a-4dc7-87d9-69576bb6ea5e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:02.410574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 176/366] 10.222.0.39 () {56 vars in 1376 bytes} [Tue May 31 20:39:02 2022] GET /identity/v3/role_assignments?group.id=db903d58e04b40ad886a83249d9e03de&scope.project.id=c9ce5e803e154d27aaf0235fa210da97&role.id=32086f06b98341f09220be9a203efcb7 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:02.412483 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba587d9a-aed5-44fa-9237-ea713762f2d7 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:02.412767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba587d9a-aed5-44fa-9237-ea713762f2d7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:02.413049 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba587d9a-aed5-44fa-9237-ea713762f2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:02.438814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ba587d9a-aed5-44fa-9237-ea713762f2d7 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:02.440912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ba587d9a-aed5-44fa-9237-ea713762f2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:02.442061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532f92a-d850-4e60-be9f-ab28768976bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:02.442877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532f92a-d850-4e60-be9f-ab28768976bd None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:02.443251 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532f92a-d850-4e60-be9f-ab28768976bd None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:02.443623 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532f92a-d850-4e60-be9f-ab28768976bd None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:02.444479 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532f92a-d850-4e60-be9f-ab28768976bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:02.444886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532f92a-d850-4e60-be9f-ab28768976bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:02.446419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532f92a-d850-4e60-be9f-ab28768976bd None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:02.458059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 191/367] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:02.459318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532f92a-d850-4e60-be9f-ab28768976bd None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:02.472488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:02.478458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:02.538167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 177/368] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:02.539362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba587d9a-aed5-44fa-9237-ea713762f2d7 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:02.620247 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532f92a-d850-4e60-be9f-ab28768976bd None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:02.676996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b90c7-0bf5-4489-be6f-7f6bccc5b943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:02.678228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b90c7-0bf5-4489-be6f-7f6bccc5b943 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:02.678752 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b90c7-0bf5-4489-be6f-7f6bccc5b943 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:02.679257 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b90c7-0bf5-4489-be6f-7f6bccc5b943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:02.680924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b90c7-0bf5-4489-be6f-7f6bccc5b943 None admin] RBAC: Adding query filter params (group.id=db903d58e04b40ad886a83249d9e03de, role.id=32086f06b98341f09220be9a203efcb7, scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:02.681532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b90c7-0bf5-4489-be6f-7f6bccc5b943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:02.684368 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b90c7-0bf5-4489-be6f-7f6bccc5b943 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:02.698350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 192/369] 10.222.0.39 () {56 vars in 1376 bytes} [Tue May 31 20:39:02 2022] GET /identity/v3/role_assignments?group.id=db903d58e04b40ad886a83249d9e03de&scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978&role.id=32086f06b98341f09220be9a203efcb7 => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:02.704774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b90c7-0bf5-4489-be6f-7f6bccc5b943 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:02.718096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba587d9a-aed5-44fa-9237-ea713762f2d7 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:02.821863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c841ecd-9365-4732-a07a-6f98a56673b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:02.823153 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c841ecd-9365-4732-a07a-6f98a56673b7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:02.823664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c841ecd-9365-4732-a07a-6f98a56673b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:02.824172 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c841ecd-9365-4732-a07a-6f98a56673b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:02.826431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c841ecd-9365-4732-a07a-6f98a56673b7 None admin] RBAC: Adding query filter params (role.id=595c6e7915fd49fba493261855a5f6b8, user.id=1a5ef1f03659470d9b6afcf19bbf5ebe, scope.system=all) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:02.826980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c841ecd-9365-4732-a07a-6f98a56673b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:02.830158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c841ecd-9365-4732-a07a-6f98a56673b7 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:02.872366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 178/370] 10.222.0.39 () {56 vars in 1308 bytes} [Tue May 31 20:39:02 2022] GET /identity/v3/role_assignments?user.id=1a5ef1f03659470d9b6afcf19bbf5ebe&scope.system=all&role.id=595c6e7915fd49fba493261855a5f6b8 => generated 510 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:02.876082 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c841ecd-9365-4732-a07a-6f98a56673b7 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:02.886151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:02.921777 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:02.922902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b90c7-0bf5-4489-be6f-7f6bccc5b943 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:02.979377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00914dba-975c-4252-be53-8b32bd3f322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:02.980718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00914dba-975c-4252-be53-8b32bd3f322c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:02.981017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00914dba-975c-4252-be53-8b32bd3f322c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:02.981290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00914dba-975c-4252-be53-8b32bd3f322c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:03.105877 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c841ecd-9365-4732-a07a-6f98a56673b7 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:03.118424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00914dba-975c-4252-be53-8b32bd3f322c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:03.119919 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00914dba-975c-4252-be53-8b32bd3f322c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:03.183118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7ad1c-3218-402a-9ca0-a19d46759f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:03.183927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7ad1c-3218-402a-9ca0-a19d46759f09 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:03.184210 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7ad1c-3218-402a-9ca0-a19d46759f09 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:03.184478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7ad1c-3218-402a-9ca0-a19d46759f09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:03.208759 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7ad1c-3218-402a-9ca0-a19d46759f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-9fe7ad1c-3218-402a-9ca0-a19d46759f09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:03.219620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:03.220572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:03.221400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:03.221400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:03.221400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:03.221400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:03.221400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:03.221400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:03.221400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:03.221400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:03.221400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:03.221400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:03.221400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:03.221400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:03.222025 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 179/371] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:03.227677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7ad1c-3218-402a-9ca0-a19d46759f09 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:03.267228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:03.319345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 193/372] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:03.330477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00914dba-975c-4252-be53-8b32bd3f322c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:03.360586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:03.389291 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7ad1c-3218-402a-9ca0-a19d46759f09 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:03.425760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfbc4b-1779-4c72-87ff-d57965517e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:03.426778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfbc4b-1779-4c72-87ff-d57965517e70 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:03.427274 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfbc4b-1779-4c72-87ff-d57965517e70 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:03.427737 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfbc4b-1779-4c72-87ff-d57965517e70 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:03.428671 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfbc4b-1779-4c72-87ff-d57965517e70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:03.429185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfbc4b-1779-4c72-87ff-d57965517e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:03.430773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfbc4b-1779-4c72-87ff-d57965517e70 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:03.440183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 180/373] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:03.445626 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfbc4b-1779-4c72-87ff-d57965517e70 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:03.545166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00914dba-975c-4252-be53-8b32bd3f322c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:03.625117 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfbc4b-1779-4c72-87ff-d57965517e70 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:03.631699 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd728c3-12b6-485b-aed1-19cfa507d1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:03.633256 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd728c3-12b6-485b-aed1-19cfa507d1f2 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:03.633800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd728c3-12b6-485b-aed1-19cfa507d1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:03.634307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd728c3-12b6-485b-aed1-19cfa507d1f2 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:03.642904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd728c3-12b6-485b-aed1-19cfa507d1f2 None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:03.645557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd728c3-12b6-485b-aed1-19cfa507d1f2 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:03.649290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 194/374] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:03 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:03.658347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd728c3-12b6-485b-aed1-19cfa507d1f2 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:03.673933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51390a-a97e-44fb-adf7-bb227d3d986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:03.674965 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51390a-a97e-44fb-adf7-bb227d3d986d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:03.675448 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51390a-a97e-44fb-adf7-bb227d3d986d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:03.675971 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51390a-a97e-44fb-adf7-bb227d3d986d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:03.701751 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:03.769156 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:03.824654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51390a-a97e-44fb-adf7-bb227d3d986d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:03.826826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51390a-a97e-44fb-adf7-bb227d3d986d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:03.876822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd728c3-12b6-485b-aed1-19cfa507d1f2 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:03.917917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cca9e-0d63-4a9c-a69a-a773ee593e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:03.918796 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cca9e-0d63-4a9c-a69a-a773ee593e4c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:03.919221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cca9e-0d63-4a9c-a69a-a773ee593e4c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:03.919934 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cca9e-0d63-4a9c-a69a-a773ee593e4c None admin] PATH_INFO: `/v3/groups/db903d58e04b40ad886a83249d9e03de` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:03.922054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cca9e-0d63-4a9c-a69a-a773ee593e4c None admin] RBAC: Authorizing `identity:get_group(group_id=db903d58e04b40ad886a83249d9e03de)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:03.923520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cca9e-0d63-4a9c-a69a-a773ee593e4c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:03.929502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 195/375] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:03 2022] GET /identity/v3/groups/db903d58e04b40ad886a83249d9e03de => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:03.931404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cca9e-0d63-4a9c-a69a-a773ee593e4c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:04.025623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 181/376] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:04.027159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51390a-a97e-44fb-adf7-bb227d3d986d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:04.039523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cca9e-0d63-4a9c-a69a-a773ee593e4c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:04.055035 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:04.075886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996de742-4849-405b-b381-2ba3e3bfecb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:04.076701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996de742-4849-405b-b381-2ba3e3bfecb6 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:04.077091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996de742-4849-405b-b381-2ba3e3bfecb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:04.077784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996de742-4849-405b-b381-2ba3e3bfecb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:04.079153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996de742-4849-405b-b381-2ba3e3bfecb6 None admin] RBAC: Adding query filter params (group.id=db903d58e04b40ad886a83249d9e03de, role.id=cf5f891b636947e0840ddfa871027fed, scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:04.079611 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996de742-4849-405b-b381-2ba3e3bfecb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:04.081103 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996de742-4849-405b-b381-2ba3e3bfecb6 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:04.087490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 196/377] 10.222.0.39 () {56 vars in 1376 bytes} [Tue May 31 20:39:03 2022] GET /identity/v3/role_assignments?group.id=db903d58e04b40ad886a83249d9e03de&scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978&role.id=cf5f891b636947e0840ddfa871027fed => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:04.117501 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:04.225076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51390a-a97e-44fb-adf7-bb227d3d986d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:04.279643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c6213-37f7-405a-8fd0-d1b02f30874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:04.280999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c6213-37f7-405a-8fd0-d1b02f30874f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:04.281539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c6213-37f7-405a-8fd0-d1b02f30874f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:04.282073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c6213-37f7-405a-8fd0-d1b02f30874f None admin] PATH_INFO: `/v3/projects/8f897b27191b44a4b4a76e83f6d0aaaa` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:04.283825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c6213-37f7-405a-8fd0-d1b02f30874f None admin] RBAC: Authorizing `identity:get_project(project_id=8f897b27191b44a4b4a76e83f6d0aaaa)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:04.285780 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c6213-37f7-405a-8fd0-d1b02f30874f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:04.288394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 182/378] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:04 2022] GET /identity/v3/projects/8f897b27191b44a4b4a76e83f6d0aaaa => generated 344 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:04.293958 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996de742-4849-405b-b381-2ba3e3bfecb6 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:04.460009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996de742-4849-405b-b381-2ba3e3bfecb6 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:04.498944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36cc13-d800-43b1-ae18-4e77629a8afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:04.499739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36cc13-d800-43b1-ae18-4e77629a8afa None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:04.500028 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36cc13-d800-43b1-ae18-4e77629a8afa None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:04.500302 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36cc13-d800-43b1-ae18-4e77629a8afa None admin] PATH_INFO: `/v3/groups/c029116fd326428a93d962dca54104de` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:04.507390 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36cc13-d800-43b1-ae18-4e77629a8afa None admin] RBAC: Authorizing `identity:get_group(group_id=c029116fd326428a93d962dca54104de)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:04.509030 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36cc13-d800-43b1-ae18-4e77629a8afa None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:04.511267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 197/379] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:04 2022] GET /identity/v3/groups/c029116fd326428a93d962dca54104de => generated 229 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:04.516875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c6213-37f7-405a-8fd0-d1b02f30874f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:04.627765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c6213-37f7-405a-8fd0-d1b02f30874f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:04.645742 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:04.663588 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b32d6-cced-4022-8094-392d78330b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:04.669204 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b32d6-cced-4022-8094-392d78330b7a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:04.669204 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b32d6-cced-4022-8094-392d78330b7a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:04.669204 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b32d6-cced-4022-8094-392d78330b7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:04.669204 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b32d6-cced-4022-8094-392d78330b7a None admin] RBAC: Adding query filter params (group.id=c029116fd326428a93d962dca54104de, role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=8f897b27191b44a4b4a76e83f6d0aaaa) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:04.669204 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b32d6-cced-4022-8094-392d78330b7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:04.669204 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b32d6-cced-4022-8094-392d78330b7a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:04.673843 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 183/380] 10.222.0.39 () {56 vars in 1376 bytes} [Tue May 31 20:39:04 2022] GET /identity/v3/role_assignments?group.id=c029116fd326428a93d962dca54104de&scope.project.id=8f897b27191b44a4b4a76e83f6d0aaaa&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:04.783745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e07022-0f15-4438-b009-9fa8a4d004ea None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:04.784247 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e07022-0f15-4438-b009-9fa8a4d004ea None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:04.784247 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e07022-0f15-4438-b009-9fa8a4d004ea None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:04.786048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 198/381] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:04.791418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d568c-7535-49a9-9fcf-7be56a89e7a9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:04.791720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d568c-7535-49a9-9fcf-7be56a89e7a9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:04.792005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d568c-7535-49a9-9fcf-7be56a89e7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:04.818519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c72d568c-7535-49a9-9fcf-7be56a89e7a9 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:04.819753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c72d568c-7535-49a9-9fcf-7be56a89e7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:04.902373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 184/382] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:04.937755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e07022-0f15-4438-b009-9fa8a4d004ea None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:04.991713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:05.063140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e07022-0f15-4438-b009-9fa8a4d004ea None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:05.109512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50555f-526c-423d-a8aa-1fc53e56ac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:05.110337 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50555f-526c-423d-a8aa-1fc53e56ac61 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:05.110621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50555f-526c-423d-a8aa-1fc53e56ac61 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:05.110897 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50555f-526c-423d-a8aa-1fc53e56ac61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:05.130371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50555f-526c-423d-a8aa-1fc53e56ac61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-cf50555f-526c-423d-a8aa-1fc53e56ac61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:05.138509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:05.139431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:05.140277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:05.140277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:05.140277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:05.140277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:05.140277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:05.140277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:05.140277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:05.140277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:05.140277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:05.140277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:05.140277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:39:05.140277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:05.140277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 199/383] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:39:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:05.146294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d568c-7535-49a9-9fcf-7be56a89e7a9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:05.258763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d568c-7535-49a9-9fcf-7be56a89e7a9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:05.261712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:05.301192 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d4e7-a3fb-4411-bd2d-3573b608ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:05.301919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d4e7-a3fb-4411-bd2d-3573b608ec0f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:05.302211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d4e7-a3fb-4411-bd2d-3573b608ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:05.302492 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d4e7-a3fb-4411-bd2d-3573b608ec0f None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:05.303244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63d4e7-a3fb-4411-bd2d-3573b608ec0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:05.303545 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63d4e7-a3fb-4411-bd2d-3573b608ec0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:05.304963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63d4e7-a3fb-4411-bd2d-3573b608ec0f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:05.315919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 185/384] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:05.320645 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50555f-526c-423d-a8aa-1fc53e56ac61 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:05.447158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50555f-526c-423d-a8aa-1fc53e56ac61 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:05.448742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:05.494775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3188ae0-6a59-42f9-888e-fd9183ed6328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:05.495674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188ae0-6a59-42f9-888e-fd9183ed6328 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:05.495966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188ae0-6a59-42f9-888e-fd9183ed6328 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:05.496253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188ae0-6a59-42f9-888e-fd9183ed6328 None admin] PATH_INFO: `/v3/groups/db903d58e04b40ad886a83249d9e03de` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:05.497675 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3188ae0-6a59-42f9-888e-fd9183ed6328 None admin] RBAC: Authorizing `identity:get_group(group_id=db903d58e04b40ad886a83249d9e03de)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:05.499220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3188ae0-6a59-42f9-888e-fd9183ed6328 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:05.502030 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 200/385] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:05 2022] GET /identity/v3/groups/db903d58e04b40ad886a83249d9e03de => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:05.506810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d4e7-a3fb-4411-bd2d-3573b608ec0f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:05.665902 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d4e7-a3fb-4411-bd2d-3573b608ec0f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:05.723022 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95027bbc-ff93-4ba5-957d-2325c6bd9461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:05.724260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95027bbc-ff93-4ba5-957d-2325c6bd9461 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:05.724770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95027bbc-ff93-4ba5-957d-2325c6bd9461 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:05.725247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95027bbc-ff93-4ba5-957d-2325c6bd9461 None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:05.726683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95027bbc-ff93-4ba5-957d-2325c6bd9461 None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:05.728365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95027bbc-ff93-4ba5-957d-2325c6bd9461 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:05.730320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 186/386] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:05 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:05.736080 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3188ae0-6a59-42f9-888e-fd9183ed6328 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:05.739611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864df835-96cb-4d83-b2d6-f2150df71344 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:05.740122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864df835-96cb-4d83-b2d6-f2150df71344 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:05.740696 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864df835-96cb-4d83-b2d6-f2150df71344 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:05.742345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 187/387] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:39:05.747922 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c2d7-6d12-4647-9ec2-ae37a2483e44 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:05.748208 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c2d7-6d12-4647-9ec2-ae37a2483e44 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:05.748485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c2d7-6d12-4647-9ec2-ae37a2483e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:05.782429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c2c5c2d7-6d12-4647-9ec2-ae37a2483e44 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:05.783680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c2c5c2d7-6d12-4647-9ec2-ae37a2483e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:05.830977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:05.896126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3188ae0-6a59-42f9-888e-fd9183ed6328 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:05.923341 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 188/388] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:39:05.924839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b4fd6-7e40-454c-9cec-91b61e3c0344 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:05.925432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b4fd6-7e40-454c-9cec-91b61e3c0344 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:05.925720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b4fd6-7e40-454c-9cec-91b61e3c0344 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:05.931184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 189/389] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:05.933348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aada5c4-184a-4176-8704-af93baf07c47 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:05.933657 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aada5c4-184a-4176-8704-af93baf07c47 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:05.933936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aada5c4-184a-4176-8704-af93baf07c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:05.957350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e042948-d5db-411b-8632-3a8ce5c12bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:05.958273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e042948-d5db-411b-8632-3a8ce5c12bfa None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:05.958552 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e042948-d5db-411b-8632-3a8ce5c12bfa None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:05.958827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e042948-d5db-411b-8632-3a8ce5c12bfa None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97/groups/db903d58e04b40ad886a83249d9e03de/roles/cf5f891b636947e0840ddfa871027fed` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:05.959903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-4aada5c4-184a-4176-8704-af93baf07c47 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:05.961048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e042948-d5db-411b-8632-3a8ce5c12bfa None admin] RBAC: Authorizing `identity:create_grant(project_id=c9ce5e803e154d27aaf0235fa210da97, group_id=db903d58e04b40ad886a83249d9e03de, role_id=cf5f891b636947e0840ddfa871027fed)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:05.961733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4aada5c4-184a-4176-8704-af93baf07c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:05.962526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e042948-d5db-411b-8632-3a8ce5c12bfa None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:06.042233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 190/390] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:06.042233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aada5c4-184a-4176-8704-af93baf07c47 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:06.048673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 201/391] 10.222.0.39 () {58 vars in 1442 bytes} [Tue May 31 20:39:05 2022] PUT /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97/groups/db903d58e04b40ad886a83249d9e03de/roles/cf5f891b636947e0840ddfa871027fed => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:39:06.067261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e042948-d5db-411b-8632-3a8ce5c12bfa None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:06.109972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:06.206427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:06.221797 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aada5c4-184a-4176-8704-af93baf07c47 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:06.241622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e042948-d5db-411b-8632-3a8ce5c12bfa None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:06.267796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41120bb9-9353-4967-8f7c-053f7beb57c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:06.269142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41120bb9-9353-4967-8f7c-053f7beb57c1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:06.269803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41120bb9-9353-4967-8f7c-053f7beb57c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:06.270321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41120bb9-9353-4967-8f7c-053f7beb57c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:06.284753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41120bb9-9353-4967-8f7c-053f7beb57c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:06.286321 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2d22e-462b-406e-9399-38b67dbcb250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:06.287146 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2d22e-462b-406e-9399-38b67dbcb250 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:06.287426 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2d22e-462b-406e-9399-38b67dbcb250 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:06.287696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2d22e-462b-406e-9399-38b67dbcb250 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-41120bb9-9353-4967-8f7c-053f7beb57c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:06.294449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:06.295433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:06.296244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:06.296244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:06.296244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:06.296244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:06.296244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:06.296244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:06.296244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:06.296244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:06.296244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:06.296244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:06.296244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:39:06.296244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:06.299253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 191/392] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:06.316396 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41120bb9-9353-4967-8f7c-053f7beb57c1 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:06.325957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2d22e-462b-406e-9399-38b67dbcb250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-f4b2d22e-462b-406e-9399-38b67dbcb250 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:06.339904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:06.340995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:06.341852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:06.341852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:06.341852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:06.341852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:06.341852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:06.341852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:06.341852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:06.341852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:06.341852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:06.341852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:06.341852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:39:06.341852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:06.344350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 202/393] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:06.357537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2d22e-462b-406e-9399-38b67dbcb250 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:06.471638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41120bb9-9353-4967-8f7c-053f7beb57c1 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:06.477270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:06.487615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2d22e-462b-406e-9399-38b67dbcb250 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:06.509535 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ea97c-2bf4-44a7-8592-4bd18ab39ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:06.510210 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ea97c-2bf4-44a7-8592-4bd18ab39ef4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:06.516350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ea97c-2bf4-44a7-8592-4bd18ab39ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:06.516350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ea97c-2bf4-44a7-8592-4bd18ab39ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:06.516350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ea97c-2bf4-44a7-8592-4bd18ab39ef4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:06.516350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ea97c-2bf4-44a7-8592-4bd18ab39ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:06.516350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ea97c-2bf4-44a7-8592-4bd18ab39ef4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:06.522698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 192/394] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:39:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:06.528952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ea97c-2bf4-44a7-8592-4bd18ab39ef4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:06.531232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8092f2-6a43-49a4-8f96-f461a5647953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:06.531918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8092f2-6a43-49a4-8f96-f461a5647953 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:06.532199 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8092f2-6a43-49a4-8f96-f461a5647953 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:06.532471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8092f2-6a43-49a4-8f96-f461a5647953 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:06.533517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8092f2-6a43-49a4-8f96-f461a5647953 None admin] RBAC: Adding query filter params (name=member) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:06.533897 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8092f2-6a43-49a4-8f96-f461a5647953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:06.536300 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8092f2-6a43-49a4-8f96-f461a5647953 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:06.546505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:06.547996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 203/395] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:39:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:06.554400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8092f2-6a43-49a4-8f96-f461a5647953 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:06.727176 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ea97c-2bf4-44a7-8592-4bd18ab39ef4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:06.758722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8092f2-6a43-49a4-8f96-f461a5647953 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:06.797519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e01ff-85d0-4958-8f42-80b93e602a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:06.798388 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e01ff-85d0-4958-8f42-80b93e602a2a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:06.798670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e01ff-85d0-4958-8f42-80b93e602a2a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:06.798943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e01ff-85d0-4958-8f42-80b93e602a2a None admin] PATH_INFO: `/v3/groups/db903d58e04b40ad886a83249d9e03de` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:06.801344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e01ff-85d0-4958-8f42-80b93e602a2a None admin] RBAC: Authorizing `identity:get_group(group_id=db903d58e04b40ad886a83249d9e03de)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:06.802836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e01ff-85d0-4958-8f42-80b93e602a2a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:06.805648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 193/396] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:06 2022] GET /identity/v3/groups/db903d58e04b40ad886a83249d9e03de => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:06.812064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e01ff-85d0-4958-8f42-80b93e602a2a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:06.829320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b6d8a-378f-4884-b128-0c886aeb757d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:06.830992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b6d8a-378f-4884-b128-0c886aeb757d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:06.830992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b6d8a-378f-4884-b128-0c886aeb757d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:06.830992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b6d8a-378f-4884-b128-0c886aeb757d None admin] PATH_INFO: `/v3/groups/db903d58e04b40ad886a83249d9e03de` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:06.834026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b6d8a-378f-4884-b128-0c886aeb757d None admin] RBAC: Authorizing `identity:get_group(group_id=db903d58e04b40ad886a83249d9e03de)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:06.835534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b6d8a-378f-4884-b128-0c886aeb757d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:06.845080 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 204/397] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:06 2022] GET /identity/v3/groups/db903d58e04b40ad886a83249d9e03de => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:06.861423 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b6d8a-378f-4884-b128-0c886aeb757d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:06.905768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:06.977844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:07.003013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e01ff-85d0-4958-8f42-80b93e602a2a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:07.039113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9dde1-0919-4b17-bf7d-56cac8431200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:07.039979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9dde1-0919-4b17-bf7d-56cac8431200 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:07.040263 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9dde1-0919-4b17-bf7d-56cac8431200 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:07.040540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9dde1-0919-4b17-bf7d-56cac8431200 None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:07.041790 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9dde1-0919-4b17-bf7d-56cac8431200 None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:07.043626 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9dde1-0919-4b17-bf7d-56cac8431200 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:07.046514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 194/398] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:06 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:07.051975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9dde1-0919-4b17-bf7d-56cac8431200 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:07.083528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b6d8a-378f-4884-b128-0c886aeb757d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:07.168337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9dde1-0919-4b17-bf7d-56cac8431200 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:07.180447 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871568fe-774e-4afd-a9aa-98424d0e0508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:07.181338 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871568fe-774e-4afd-a9aa-98424d0e0508 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:07.181654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871568fe-774e-4afd-a9aa-98424d0e0508 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:07.181937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871568fe-774e-4afd-a9aa-98424d0e0508 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:07.183151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871568fe-774e-4afd-a9aa-98424d0e0508 None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:07.185277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871568fe-774e-4afd-a9aa-98424d0e0508 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:07.193528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 205/399] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:06 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:07.202707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871568fe-774e-4afd-a9aa-98424d0e0508 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:07.245973 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ce194-1641-433c-b754-20c53283bf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:07.247476 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ce194-1641-433c-b754-20c53283bf69 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:07.247761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ce194-1641-433c-b754-20c53283bf69 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:07.248035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ce194-1641-433c-b754-20c53283bf69 None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97/groups/db903d58e04b40ad886a83249d9e03de/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:07.250923 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ce194-1641-433c-b754-20c53283bf69 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9ce5e803e154d27aaf0235fa210da97, group_id=db903d58e04b40ad886a83249d9e03de, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:07.252368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ce194-1641-433c-b754-20c53283bf69 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:07.316817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:07.327996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 195/400] 10.222.0.39 () {58 vars in 1442 bytes} [Tue May 31 20:39:07 2022] PUT /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97/groups/db903d58e04b40ad886a83249d9e03de/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:39:07.330493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef357f8-5d8c-460f-a5f7-e0c08f9dc133 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:07.331123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef357f8-5d8c-460f-a5f7-e0c08f9dc133 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:07.331601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef357f8-5d8c-460f-a5f7-e0c08f9dc133 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:07.331703 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871568fe-774e-4afd-a9aa-98424d0e0508 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:07.338101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 196/401] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:07.340945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeffec-2d93-45cd-b3e2-41681b6d9735 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:07.341595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeffec-2d93-45cd-b3e2-41681b6d9735 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:07.342094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeffec-2d93-45cd-b3e2-41681b6d9735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:07.357065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:07.364783 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-fcfeffec-2d93-45cd-b3e2-41681b6d9735 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:07.372650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fcfeffec-2d93-45cd-b3e2-41681b6d9735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:07.398607 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c8944-77dc-4ed1-9ed4-7cb6fe23639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:07.399856 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c8944-77dc-4ed1-9ed4-7cb6fe23639a None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:07.400278 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c8944-77dc-4ed1-9ed4-7cb6fe23639a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:07.400740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c8944-77dc-4ed1-9ed4-7cb6fe23639a None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978/groups/db903d58e04b40ad886a83249d9e03de/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:07.405927 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c8944-77dc-4ed1-9ed4-7cb6fe23639a None admin] RBAC: Authorizing `identity:create_grant(project_id=3b81e28b94aa40e9a9ab61284d4c0978, group_id=db903d58e04b40ad886a83249d9e03de, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:07.407729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c8944-77dc-4ed1-9ed4-7cb6fe23639a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:07.454448 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 197/402] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:07.477276 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeffec-2d93-45cd-b3e2-41681b6d9735 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:07.488583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 206/403] 10.222.0.39 () {58 vars in 1442 bytes} [Tue May 31 20:39:07 2022] PUT /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978/groups/db903d58e04b40ad886a83249d9e03de/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:39:07.576234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6a6c5-005b-4b63-b8dc-aaa0ccb8f7fd None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:07.576424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6a6c5-005b-4b63-b8dc-aaa0ccb8f7fd None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:07.576932 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6a6c5-005b-4b63-b8dc-aaa0ccb8f7fd None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:07.578724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 207/404] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:39:07.584532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d33e2-a741-4ee6-a77a-613ac7353779 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:07.584819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d33e2-a741-4ee6-a77a-613ac7353779 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:07.585100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d33e2-a741-4ee6-a77a-613ac7353779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:07.597993 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeffec-2d93-45cd-b3e2-41681b6d9735 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:07.605345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6a5d33e2-a741-4ee6-a77a-613ac7353779 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:07.606677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6a5d33e2-a741-4ee6-a77a-613ac7353779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:07.640891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d43745-ccd4-490b-824d-fd96333d974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:07.642148 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d43745-ccd4-490b-824d-fd96333d974d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:07.642685 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d43745-ccd4-490b-824d-fd96333d974d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:07.643102 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d43745-ccd4-490b-824d-fd96333d974d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:07.653153 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:07.658233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d43745-ccd4-490b-824d-fd96333d974d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-d5d43745-ccd4-490b-824d-fd96333d974d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:07.667182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:07.674460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:07.675465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:07.675465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:07.675465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:07.675465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:07.675465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:07.675465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:07.675465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:07.675465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:07.675465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:07.675465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:07.675465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:39:07.675465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:07.675465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 198/405] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:39:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:07.677453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d43745-ccd4-490b-824d-fd96333d974d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:07.701446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 208/406] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:39:07.722160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d33e2-a741-4ee6-a77a-613ac7353779 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:07.836357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d43745-ccd4-490b-824d-fd96333d974d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:07.846451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:07.879690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d33e2-a741-4ee6-a77a-613ac7353779 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:07.889740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358d8a4-54f0-45a0-8959-a1380fcf57fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:07.890482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358d8a4-54f0-45a0-8959-a1380fcf57fe None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:07.890763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358d8a4-54f0-45a0-8959-a1380fcf57fe None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:07.891042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358d8a4-54f0-45a0-8959-a1380fcf57fe None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:07.891797 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358d8a4-54f0-45a0-8959-a1380fcf57fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:07.892103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358d8a4-54f0-45a0-8959-a1380fcf57fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:07.901471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358d8a4-54f0-45a0-8959-a1380fcf57fe None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:07.923670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 199/407] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:07.925619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358d8a4-54f0-45a0-8959-a1380fcf57fe None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:07.940494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc207b2e-a8d5-408d-9012-6a67981a80c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:07.942068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc207b2e-a8d5-408d-9012-6a67981a80c2 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:07.943388 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc207b2e-a8d5-408d-9012-6a67981a80c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:07.944025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc207b2e-a8d5-408d-9012-6a67981a80c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:07.961767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc207b2e-a8d5-408d-9012-6a67981a80c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-bc207b2e-a8d5-408d-9012-6a67981a80c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:07.972339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:07.973480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:07.974366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:07.974366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:07.974366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:07.974366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:07.974366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:07.974366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:07.974366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:07.974366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:07.974366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:07.974366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:07.974366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:07.974366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:07.976898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 209/408] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:07.986992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc207b2e-a8d5-408d-9012-6a67981a80c2 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:08.023683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:08.069618 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358d8a4-54f0-45a0-8959-a1380fcf57fe None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:08.113673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8ecbf-61cd-49a9-b093-f4245325d364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:08.113673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8ecbf-61cd-49a9-b093-f4245325d364 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:08.113673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8ecbf-61cd-49a9-b093-f4245325d364 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:08.113673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8ecbf-61cd-49a9-b093-f4245325d364 None admin] PATH_INFO: `/v3/groups/db903d58e04b40ad886a83249d9e03de` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:08.114037 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8ecbf-61cd-49a9-b093-f4245325d364 None admin] RBAC: Authorizing `identity:get_group(group_id=db903d58e04b40ad886a83249d9e03de)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:08.114037 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8ecbf-61cd-49a9-b093-f4245325d364 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:08.117558 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 200/409] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:07 2022] GET /identity/v3/groups/db903d58e04b40ad886a83249d9e03de => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:08.119287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8ecbf-61cd-49a9-b093-f4245325d364 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:08.129405 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc207b2e-a8d5-408d-9012-6a67981a80c2 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:08.232266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00363b5c-2790-4c23-9281-2e66894e7591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:08.232951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363b5c-2790-4c23-9281-2e66894e7591 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:08.233238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363b5c-2790-4c23-9281-2e66894e7591 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:08.233546 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363b5c-2790-4c23-9281-2e66894e7591 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:08.234238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8ecbf-61cd-49a9-b093-f4245325d364 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:08.234348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00363b5c-2790-4c23-9281-2e66894e7591 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:08.234597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00363b5c-2790-4c23-9281-2e66894e7591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:08.236116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00363b5c-2790-4c23-9281-2e66894e7591 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:08.253041 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:08.262235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 210/410] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:08.267580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:08.270911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00363b5c-2790-4c23-9281-2e66894e7591 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:08.273714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd8873-4b27-4be2-ba90-89fdb117119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:08.274588 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8873-4b27-4be2-ba90-89fdb117119e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:08.274872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8873-4b27-4be2-ba90-89fdb117119e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:08.275149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8873-4b27-4be2-ba90-89fdb117119e None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:08.276436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd8873-4b27-4be2-ba90-89fdb117119e None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:08.278033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd8873-4b27-4be2-ba90-89fdb117119e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:08.284682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 201/411] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:08 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:08.285952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd8873-4b27-4be2-ba90-89fdb117119e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:08.501514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00363b5c-2790-4c23-9281-2e66894e7591 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:08.521039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd8873-4b27-4be2-ba90-89fdb117119e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:08.576333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac1c4-b1f8-4651-8943-0532b5701638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:08.577510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac1c4-b1f8-4651-8943-0532b5701638 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:08.577940 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac1c4-b1f8-4651-8943-0532b5701638 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:08.578491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac1c4-b1f8-4651-8943-0532b5701638 None admin] PATH_INFO: `/v3/groups/c029116fd326428a93d962dca54104de` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:08.581275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ac1c4-b1f8-4651-8943-0532b5701638 None admin] RBAC: Authorizing `identity:get_group(group_id=c029116fd326428a93d962dca54104de)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:08.583366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ac1c4-b1f8-4651-8943-0532b5701638 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:08.593094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 211/412] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:08 2022] GET /identity/v3/groups/c029116fd326428a93d962dca54104de => generated 229 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:08.594083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac1c4-b1f8-4651-8943-0532b5701638 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:08.599499 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fb803-56d4-4c11-9909-d0034507ae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:08.600399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fb803-56d4-4c11-9909-d0034507ae7f None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:08.600678 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fb803-56d4-4c11-9909-d0034507ae7f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:08.600951 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fb803-56d4-4c11-9909-d0034507ae7f None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978/groups/db903d58e04b40ad886a83249d9e03de/roles/cf5f891b636947e0840ddfa871027fed` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:08.604449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fb803-56d4-4c11-9909-d0034507ae7f None admin] RBAC: Authorizing `identity:create_grant(project_id=3b81e28b94aa40e9a9ab61284d4c0978, group_id=db903d58e04b40ad886a83249d9e03de, role_id=cf5f891b636947e0840ddfa871027fed)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:08.610791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fb803-56d4-4c11-9909-d0034507ae7f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:08.679320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:08.695457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 202/413] 10.222.0.39 () {58 vars in 1442 bytes} [Tue May 31 20:39:08 2022] PUT /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978/groups/db903d58e04b40ad886a83249d9e03de/roles/cf5f891b636947e0840ddfa871027fed => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:39:08.724845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac1c4-b1f8-4651-8943-0532b5701638 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:08.771116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451b5c-c2e8-4f06-8c4e-b09b1dd9e9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:08.771912 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451b5c-c2e8-4f06-8c4e-b09b1dd9e9b5 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:08.772192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451b5c-c2e8-4f06-8c4e-b09b1dd9e9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:08.772464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451b5c-c2e8-4f06-8c4e-b09b1dd9e9b5 None admin] PATH_INFO: `/v3/projects/8f897b27191b44a4b4a76e83f6d0aaaa` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:08.773831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d451b5c-c2e8-4f06-8c4e-b09b1dd9e9b5 None admin] RBAC: Authorizing `identity:get_project(project_id=8f897b27191b44a4b4a76e83f6d0aaaa)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:08.775290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d451b5c-c2e8-4f06-8c4e-b09b1dd9e9b5 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:08.777349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 212/414] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:08 2022] GET /identity/v3/projects/8f897b27191b44a4b4a76e83f6d0aaaa => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:08.782872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fb803-56d4-4c11-9909-d0034507ae7f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:08.805721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237060e8-0a20-48d4-91f7-47eff8ff8e9c None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:08.806146 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237060e8-0a20-48d4-91f7-47eff8ff8e9c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:08.806429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237060e8-0a20-48d4-91f7-47eff8ff8e9c None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:08.808870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 213/415] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:08.816065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f07207-72e9-42f2-960d-530cc3415d94 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:08.816416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f07207-72e9-42f2-960d-530cc3415d94 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:08.816682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f07207-72e9-42f2-960d-530cc3415d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:08.858012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-22f07207-72e9-42f2-960d-530cc3415d94 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:08.859395 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-22f07207-72e9-42f2-960d-530cc3415d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:08.909773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:08.981207 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 214/416] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:39:09.006385 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fb803-56d4-4c11-9909-d0034507ae7f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:09.015945 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f07207-72e9-42f2-960d-530cc3415d94 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:09.053962 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34a646-a153-4d55-a3b4-004f5fdd56e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:09.054770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34a646-a153-4d55-a3b4-004f5fdd56e9 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:09.055100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34a646-a153-4d55-a3b4-004f5fdd56e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:09.055379 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34a646-a153-4d55-a3b4-004f5fdd56e9 None admin] PATH_INFO: `/v3/projects/8f897b27191b44a4b4a76e83f6d0aaaa/groups/c029116fd326428a93d962dca54104de/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:09.057639 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34a646-a153-4d55-a3b4-004f5fdd56e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f897b27191b44a4b4a76e83f6d0aaaa, group_id=c029116fd326428a93d962dca54104de, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:09.059158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34a646-a153-4d55-a3b4-004f5fdd56e9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:09.096409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:09.128867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 203/417] 10.222.0.39 () {58 vars in 1442 bytes} [Tue May 31 20:39:08 2022] PUT /identity/v3/projects/8f897b27191b44a4b4a76e83f6d0aaaa/groups/c029116fd326428a93d962dca54104de/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:39:09.135950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f07207-72e9-42f2-960d-530cc3415d94 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:09.178443 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a321d-45b2-45ed-bd5c-60e0d1f1a129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:09.179269 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a321d-45b2-45ed-bd5c-60e0d1f1a129 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:09.179553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a321d-45b2-45ed-bd5c-60e0d1f1a129 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:09.179829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a321d-45b2-45ed-bd5c-60e0d1f1a129 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:09.192344 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a321d-45b2-45ed-bd5c-60e0d1f1a129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-994a321d-45b2-45ed-bd5c-60e0d1f1a129 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:09.200969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:09.202238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:09.203518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:09.203518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:09.203518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:09.203518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:09.203518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:09.203518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:09.203518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:09.203518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:09.203518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:09.203518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:09.203518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:39:09.203518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:09.203518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 215/418] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:39:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:09.208627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34a646-a153-4d55-a3b4-004f5fdd56e9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:09.393353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34a646-a153-4d55-a3b4-004f5fdd56e9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:09.411727 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:09.436751 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ba5e4-b88c-4dff-a843-c80b660044ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:09.437475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ba5e4-b88c-4dff-a843-c80b660044ad None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:09.437760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ba5e4-b88c-4dff-a843-c80b660044ad None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:09.438042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ba5e4-b88c-4dff-a843-c80b660044ad None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:09.438801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ba5e4-b88c-4dff-a843-c80b660044ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:09.439118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ba5e4-b88c-4dff-a843-c80b660044ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:09.440510 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ba5e4-b88c-4dff-a843-c80b660044ad None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:09.457745 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 204/419] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:09.459597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a321d-45b2-45ed-bd5c-60e0d1f1a129 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:09.602587 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a321d-45b2-45ed-bd5c-60e0d1f1a129 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:09.638159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:09.648280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce4445-295c-481c-869a-311dbc818ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:09.648951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce4445-295c-481c-869a-311dbc818ade None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:09.649239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce4445-295c-481c-869a-311dbc818ade None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:09.649557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce4445-295c-481c-869a-311dbc818ade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:09.750311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce4445-295c-481c-869a-311dbc818ade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:09.751796 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce4445-295c-481c-869a-311dbc818ade None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:09.907286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 216/420] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:09.912542 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ba5e4-b88c-4dff-a843-c80b660044ad None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:10.103293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ba5e4-b88c-4dff-a843-c80b660044ad None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:10.154096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81c00b-1c04-47f8-9fe5-ffb7eb7f5970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:10.154975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c00b-1c04-47f8-9fe5-ffb7eb7f5970 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:10.155260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c00b-1c04-47f8-9fe5-ffb7eb7f5970 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:10.155536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c00b-1c04-47f8-9fe5-ffb7eb7f5970 None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:10.162192 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81c00b-1c04-47f8-9fe5-ffb7eb7f5970 None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:10.163654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81c00b-1c04-47f8-9fe5-ffb7eb7f5970 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:10.165813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 205/421] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:09 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:10.171009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce4445-295c-481c-869a-311dbc818ade None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:10.232010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:10.347685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce4445-295c-481c-869a-311dbc818ade None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:10.387759 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59631c8-15d4-4d5e-ba3d-06068bc66705 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:10.388048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59631c8-15d4-4d5e-ba3d-06068bc66705 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:10.388328 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59631c8-15d4-4d5e-ba3d-06068bc66705 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:10.389868 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 206/422] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:10.390881 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3b7a2-c856-4da6-a8da-18a9310f6375 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:10.391169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3b7a2-c856-4da6-a8da-18a9310f6375 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:10.391444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3b7a2-c856-4da6-a8da-18a9310f6375 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:10.395895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 207/423] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:10.397059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b2511-4ad4-48c4-9a72-20760ef7af7f None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:10.397353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b2511-4ad4-48c4-9a72-20760ef7af7f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:10.397742 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b2511-4ad4-48c4-9a72-20760ef7af7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:10.397847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f98833-5225-4970-a25c-8b4304a17a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:10.398662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f98833-5225-4970-a25c-8b4304a17a0d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:10.398941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f98833-5225-4970-a25c-8b4304a17a0d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:10.399213 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f98833-5225-4970-a25c-8b4304a17a0d None admin] PATH_INFO: `/v3/groups/db903d58e04b40ad886a83249d9e03de` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:10.400476 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f98833-5225-4970-a25c-8b4304a17a0d None admin] RBAC: Authorizing `identity:get_group(group_id=db903d58e04b40ad886a83249d9e03de)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:10.402020 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f98833-5225-4970-a25c-8b4304a17a0d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:10.403933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 217/424] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:10 2022] GET /identity/v3/groups/db903d58e04b40ad886a83249d9e03de => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:10.405107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6669d-7f1a-4f3a-aaeb-855e12afe463 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:10.405424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6669d-7f1a-4f3a-aaeb-855e12afe463 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:10.405705 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6669d-7f1a-4f3a-aaeb-855e12afe463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:10.423094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-11f6669d-7f1a-4f3a-aaeb-855e12afe463 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:10.423265 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-fe2b2511-4ad4-48c4-9a72-20760ef7af7f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:10.424274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-11f6669d-7f1a-4f3a-aaeb-855e12afe463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:10.425173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fe2b2511-4ad4-48c4-9a72-20760ef7af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:10.490031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:10.505151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 218/425] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:10.517400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 208/426] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:10.517400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b2511-4ad4-48c4-9a72-20760ef7af7f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:10.535442 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6669d-7f1a-4f3a-aaeb-855e12afe463 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:10.567145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:10.654571 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b2511-4ad4-48c4-9a72-20760ef7af7f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:10.659415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6669d-7f1a-4f3a-aaeb-855e12afe463 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:10.693928 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374a3ef-974e-4545-b951-cdb3ce438fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:10.694599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374a3ef-974e-4545-b951-cdb3ce438fe6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:10.694961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374a3ef-974e-4545-b951-cdb3ce438fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:10.695313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374a3ef-974e-4545-b951-cdb3ce438fe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:10.696225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374a3ef-974e-4545-b951-cdb3ce438fe6 None admin] RBAC: Adding query filter params (group.id=db903d58e04b40ad886a83249d9e03de, role.id=cf5f891b636947e0840ddfa871027fed, scope.project.id=c9ce5e803e154d27aaf0235fa210da97) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:10.696634 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374a3ef-974e-4545-b951-cdb3ce438fe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:10.698421 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374a3ef-974e-4545-b951-cdb3ce438fe6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:10.704144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83821e8-a0b9-42d2-b7b4-f24d331d863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:10.705176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83821e8-a0b9-42d2-b7b4-f24d331d863b None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:10.705655 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83821e8-a0b9-42d2-b7b4-f24d331d863b None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:10.706099 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83821e8-a0b9-42d2-b7b4-f24d331d863b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:10.713773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 209/427] 10.222.0.39 () {56 vars in 1376 bytes} [Tue May 31 20:39:10 2022] GET /identity/v3/role_assignments?group.id=db903d58e04b40ad886a83249d9e03de&scope.project.id=c9ce5e803e154d27aaf0235fa210da97&role.id=cf5f891b636947e0840ddfa871027fed => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:10.714943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374a3ef-974e-4545-b951-cdb3ce438fe6 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:10.719445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83821e8-a0b9-42d2-b7b4-f24d331d863b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-e83821e8-a0b9-42d2-b7b4-f24d331d863b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:10.729540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:10.730521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:10.731883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:10.731883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:10.731883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:10.731883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:10.731883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:10.731883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:10.731883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:10.731883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:10.731883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:10.731883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:10.731883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:39:10.731883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:10.734814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 219/428] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:10.744814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83821e8-a0b9-42d2-b7b4-f24d331d863b None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:10.804667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:10.881520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:10.926199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374a3ef-974e-4545-b951-cdb3ce438fe6 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:10.930232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83821e8-a0b9-42d2-b7b4-f24d331d863b None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:11.007180 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70724e-3c33-4dd9-b9e4-665d72e7b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:11.007917 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70724e-3c33-4dd9-b9e4-665d72e7b3ad None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:11.008205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70724e-3c33-4dd9-b9e4-665d72e7b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:11.008485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70724e-3c33-4dd9-b9e4-665d72e7b3ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:11.012586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deecae8-f8af-4ebe-841a-c88c27a4bcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:11.013274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deecae8-f8af-4ebe-841a-c88c27a4bcb7 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:11.013583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deecae8-f8af-4ebe-841a-c88c27a4bcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:11.013866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deecae8-f8af-4ebe-841a-c88c27a4bcb7 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:11.014681 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deecae8-f8af-4ebe-841a-c88c27a4bcb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:11.014998 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deecae8-f8af-4ebe-841a-c88c27a4bcb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:11.016402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deecae8-f8af-4ebe-841a-c88c27a4bcb7 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:11.036028 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 220/429] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:39:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:11.038266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70724e-3c33-4dd9-b9e4-665d72e7b3ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:11.045226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deecae8-f8af-4ebe-841a-c88c27a4bcb7 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-6b70724e-3c33-4dd9-b9e4-665d72e7b3ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:11.046090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:11.046957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:11.047815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:11.047815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:11.047815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:11.047815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:11.047815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:11.047815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:11.047815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:11.047815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:11.047815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:11.047815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:11.047815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:39:11.047815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:11.047815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 210/430] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:11.063534 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70724e-3c33-4dd9-b9e4-665d72e7b3ad None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:11.212600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deecae8-f8af-4ebe-841a-c88c27a4bcb7 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:11.220140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:11.226612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70724e-3c33-4dd9-b9e4-665d72e7b3ad None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:11.267813 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664234c-b210-441b-bf14-5f3fe0b5b27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:11.268409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664234c-b210-441b-bf14-5f3fe0b5b27c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:11.268693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664234c-b210-441b-bf14-5f3fe0b5b27c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:11.268962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664234c-b210-441b-bf14-5f3fe0b5b27c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:11.287800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:11.295236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6fb2b-a6fe-410a-acb5-0a539afe9229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:11.296339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6fb2b-a6fe-410a-acb5-0a539afe9229 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:11.296793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6fb2b-a6fe-410a-acb5-0a539afe9229 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:11.297234 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6fb2b-a6fe-410a-acb5-0a539afe9229 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:11.298183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6fb2b-a6fe-410a-acb5-0a539afe9229 None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:11.302651 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6fb2b-a6fe-410a-acb5-0a539afe9229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:11.302651 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6fb2b-a6fe-410a-acb5-0a539afe9229 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:11.310721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 211/431] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:39:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:11.316696 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6fb2b-a6fe-410a-acb5-0a539afe9229 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:11.372600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664234c-b210-441b-bf14-5f3fe0b5b27c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:11.375064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664234c-b210-441b-bf14-5f3fe0b5b27c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:11.443321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6fb2b-a6fe-410a-acb5-0a539afe9229 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:11.485510 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b9f5c-b773-4bcf-9914-08552bf5641d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:11.486352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b9f5c-b773-4bcf-9914-08552bf5641d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:11.486734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b9f5c-b773-4bcf-9914-08552bf5641d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:11.487021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b9f5c-b773-4bcf-9914-08552bf5641d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:11.511876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 221/432] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:39:11.518331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664234c-b210-441b-bf14-5f3fe0b5b27c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:11.531411 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:11.588544 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:11.590384 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b9f5c-b773-4bcf-9914-08552bf5641d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:11.591871 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b9f5c-b773-4bcf-9914-08552bf5641d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:11.653887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664234c-b210-441b-bf14-5f3fe0b5b27c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:11.696408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1fddd-32b2-406d-99a4-89fbe96c8db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:11.697414 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1fddd-32b2-406d-99a4-89fbe96c8db6 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:11.697873 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1fddd-32b2-406d-99a4-89fbe96c8db6 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:11.698153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1fddd-32b2-406d-99a4-89fbe96c8db6 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:11.700005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1fddd-32b2-406d-99a4-89fbe96c8db6 None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:11.701979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1fddd-32b2-406d-99a4-89fbe96c8db6 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:11.703775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 222/433] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:11 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:11.705210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e242d-ddce-4e92-a893-eb578cc0ecf4 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:11.705674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e242d-ddce-4e92-a893-eb578cc0ecf4 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:11.706112 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e242d-ddce-4e92-a893-eb578cc0ecf4 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:11.707567 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 223/434] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:11.709052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e242d-ddce-4e92-a893-eb578cc0ecf4 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:11.727798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 212/435] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:39:11.733833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921de46-4f6a-4c24-81a1-60f15e68e27f None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:11.734333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921de46-4f6a-4c24-81a1-60f15e68e27f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:11.734609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921de46-4f6a-4c24-81a1-60f15e68e27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:11.751491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-9921de46-4f6a-4c24-81a1-60f15e68e27f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:11.752684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-9921de46-4f6a-4c24-81a1-60f15e68e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:11.823152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:11.830342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e242d-ddce-4e92-a893-eb578cc0ecf4 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:11.845400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 213/436] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:11.845400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921de46-4f6a-4c24-81a1-60f15e68e27f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:11.846400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:11.869934 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a766f-6f15-4c58-b56f-71f79290172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:11.870913 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a766f-6f15-4c58-b56f-71f79290172e None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:11.871255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a766f-6f15-4c58-b56f-71f79290172e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:11.871535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a766f-6f15-4c58-b56f-71f79290172e None admin] PATH_INFO: `/v3/groups/db903d58e04b40ad886a83249d9e03de` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:11.873275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a766f-6f15-4c58-b56f-71f79290172e None admin] RBAC: Authorizing `identity:get_group(group_id=db903d58e04b40ad886a83249d9e03de)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:11.875350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a766f-6f15-4c58-b56f-71f79290172e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:11.882280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 224/437] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:11 2022] GET /identity/v3/groups/db903d58e04b40ad886a83249d9e03de => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:11.882280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a766f-6f15-4c58-b56f-71f79290172e None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:12.007753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a766f-6f15-4c58-b56f-71f79290172e None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:12.047641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2486727-73b0-4655-932d-09f9f11fb907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:12.048436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2486727-73b0-4655-932d-09f9f11fb907 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:12.048707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2486727-73b0-4655-932d-09f9f11fb907 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:12.048977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2486727-73b0-4655-932d-09f9f11fb907 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:12.059325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2486727-73b0-4655-932d-09f9f11fb907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-c2486727-73b0-4655-932d-09f9f11fb907 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:12.067266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:12.068292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:12.069093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:12.069093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:12.069093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:12.069093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:12.069093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:12.069093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:12.069093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:12.069093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:12.069093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:12.069093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:12.069093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:39:12.069093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:12.069093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 225/438] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:39:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:12.069800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2486727-73b0-4655-932d-09f9f11fb907 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:12.098042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921de46-4f6a-4c24-81a1-60f15e68e27f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:12.123890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:12.133281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48b595-258d-4552-932a-cf3860d61855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:12.134165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48b595-258d-4552-932a-cf3860d61855 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:12.134460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48b595-258d-4552-932a-cf3860d61855 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:12.134720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48b595-258d-4552-932a-cf3860d61855 None admin] PATH_INFO: `/v3/projects/c9ce5e803e154d27aaf0235fa210da97` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:12.135877 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48b595-258d-4552-932a-cf3860d61855 None admin] RBAC: Authorizing `identity:get_project(project_id=c9ce5e803e154d27aaf0235fa210da97)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:12.137935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48b595-258d-4552-932a-cf3860d61855 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:12.139607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 214/439] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:11 2022] GET /identity/v3/projects/c9ce5e803e154d27aaf0235fa210da97 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:12.140855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e1887-fef9-44c2-b282-e0b30a6df583 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:12.141019 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e1887-fef9-44c2-b282-e0b30a6df583 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:12.141290 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e1887-fef9-44c2-b282-e0b30a6df583 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:12.144216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 215/440] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:12.144216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e1887-fef9-44c2-b282-e0b30a6df583 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:12.191284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2486727-73b0-4655-932d-09f9f11fb907 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:12.212083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:12.226369 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a98b45-4173-48f1-899c-e972c999591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:12.227529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a98b45-4173-48f1-899c-e972c999591c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:12.227529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a98b45-4173-48f1-899c-e972c999591c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:12.227529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a98b45-4173-48f1-899c-e972c999591c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:12.228364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a98b45-4173-48f1-899c-e972c999591c None admin] RBAC: Adding query filter params (group.id=db903d58e04b40ad886a83249d9e03de, role.id=32086f06b98341f09220be9a203efcb7, scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:12.228681 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a98b45-4173-48f1-899c-e972c999591c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:12.230155 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a98b45-4173-48f1-899c-e972c999591c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:12.238704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 226/441] 10.222.0.39 () {56 vars in 1376 bytes} [Tue May 31 20:39:12 2022] GET /identity/v3/role_assignments?group.id=db903d58e04b40ad886a83249d9e03de&scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978&role.id=32086f06b98341f09220be9a203efcb7 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:12.239529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a98b45-4173-48f1-899c-e972c999591c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:12.268145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e1887-fef9-44c2-b282-e0b30a6df583 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:12.310971 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120930bb-4811-4674-bc24-3d630e251fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:12.311875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120930bb-4811-4674-bc24-3d630e251fcb None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:12.312601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120930bb-4811-4674-bc24-3d630e251fcb None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:12.312893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120930bb-4811-4674-bc24-3d630e251fcb None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:12.313708 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120930bb-4811-4674-bc24-3d630e251fcb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:12.314016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120930bb-4811-4674-bc24-3d630e251fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:12.315436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120930bb-4811-4674-bc24-3d630e251fcb None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:12.325267 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 216/442] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:12.326518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4507-f5ff-4e65-b300-3a0f03909faf None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:12.326808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4507-f5ff-4e65-b300-3a0f03909faf None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:12.327080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4507-f5ff-4e65-b300-3a0f03909faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:12.345891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a67d4507-f5ff-4e65-b300-3a0f03909faf None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:12.347223 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a67d4507-f5ff-4e65-b300-3a0f03909faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:12.367473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a98b45-4173-48f1-899c-e972c999591c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:12.377785 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:12.414829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf2d3c-d764-4db2-94b3-8ecc5c0765b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:12.415697 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf2d3c-d764-4db2-94b3-8ecc5c0765b5 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:12.415979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf2d3c-d764-4db2-94b3-8ecc5c0765b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:12.416342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf2d3c-d764-4db2-94b3-8ecc5c0765b5 None admin] PATH_INFO: `/v3/groups/db903d58e04b40ad886a83249d9e03de` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:12.417526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf2d3c-d764-4db2-94b3-8ecc5c0765b5 None admin] RBAC: Authorizing `identity:get_group(group_id=db903d58e04b40ad886a83249d9e03de)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:12.419846 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf2d3c-d764-4db2-94b3-8ecc5c0765b5 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:12.426138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 227/443] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:12 2022] GET /identity/v3/groups/db903d58e04b40ad886a83249d9e03de => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:12.426138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf2d3c-d764-4db2-94b3-8ecc5c0765b5 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:12.433445 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 217/444] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:12.435128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d4507-f5ff-4e65-b300-3a0f03909faf None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:12.509284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:12.547687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf2d3c-d764-4db2-94b3-8ecc5c0765b5 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:12.564180 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d4507-f5ff-4e65-b300-3a0f03909faf None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:12.581916 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a596b6f-fe66-49f6-8455-6176520c6c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:12.582567 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a596b6f-fe66-49f6-8455-6176520c6c00 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:12.582852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a596b6f-fe66-49f6-8455-6176520c6c00 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:12.583131 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a596b6f-fe66-49f6-8455-6176520c6c00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:12.598962 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428a4df-3aa8-4fce-90ee-e7c98f5ec465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:12.599416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428a4df-3aa8-4fce-90ee-e7c98f5ec465 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:12.599699 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428a4df-3aa8-4fce-90ee-e7c98f5ec465 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:12.599970 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428a4df-3aa8-4fce-90ee-e7c98f5ec465 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:12.600797 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428a4df-3aa8-4fce-90ee-e7c98f5ec465 None admin] RBAC: Adding query filter params (group.id=db903d58e04b40ad886a83249d9e03de, role.id=32086f06b98341f09220be9a203efcb7, scope.project.id=c9ce5e803e154d27aaf0235fa210da97) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:12.601110 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428a4df-3aa8-4fce-90ee-e7c98f5ec465 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:12.602578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428a4df-3aa8-4fce-90ee-e7c98f5ec465 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:12.609002 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 218/445] 10.222.0.39 () {56 vars in 1376 bytes} [Tue May 31 20:39:12 2022] GET /identity/v3/role_assignments?group.id=db903d58e04b40ad886a83249d9e03de&scope.project.id=c9ce5e803e154d27aaf0235fa210da97&role.id=32086f06b98341f09220be9a203efcb7 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:12.609814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428a4df-3aa8-4fce-90ee-e7c98f5ec465 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:12.631296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:12.660415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a596b6f-fe66-49f6-8455-6176520c6c00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:12.661959 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a596b6f-fe66-49f6-8455-6176520c6c00 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:12.740375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428a4df-3aa8-4fce-90ee-e7c98f5ec465 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:12.758648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:12.791680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 228/446] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:12.796995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811a2ba-de21-448e-9ed4-28741e85508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:12.797585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a596b6f-fe66-49f6-8455-6176520c6c00 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:12.797873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811a2ba-de21-448e-9ed4-28741e85508f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:12.798166 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811a2ba-de21-448e-9ed4-28741e85508f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:12.798441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811a2ba-de21-448e-9ed4-28741e85508f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:12.814973 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811a2ba-de21-448e-9ed4-28741e85508f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-7811a2ba-de21-448e-9ed4-28741e85508f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:12.829668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:12.830623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:12.831431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:12.831431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:12.831431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:12.831431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:12.831431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:12.831431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:12.831431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:12.831431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:12.831431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:12.831431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:12.831431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:12.831431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:12.833865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 219/447] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:12.837920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811a2ba-de21-448e-9ed4-28741e85508f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:12.895918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:12.928870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a596b6f-fe66-49f6-8455-6176520c6c00 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:12.963749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811a2ba-de21-448e-9ed4-28741e85508f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:12.968054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef38c2-2c05-478d-81b5-1669625e2665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:12.968938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef38c2-2c05-478d-81b5-1669625e2665 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:12.969308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef38c2-2c05-478d-81b5-1669625e2665 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:12.969620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef38c2-2c05-478d-81b5-1669625e2665 None admin] PATH_INFO: `/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:12.972676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef38c2-2c05-478d-81b5-1669625e2665 None admin] RBAC: Authorizing `identity:get_project(project_id=3b81e28b94aa40e9a9ab61284d4c0978)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:12.973622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef38c2-2c05-478d-81b5-1669625e2665 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:12.975836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 229/448] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:12 2022] GET /identity/v3/projects/3b81e28b94aa40e9a9ab61284d4c0978 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:12.982051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef38c2-2c05-478d-81b5-1669625e2665 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:13.011641 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792cc75-8840-4faa-a066-b3f43caf8b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:13.012316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792cc75-8840-4faa-a066-b3f43caf8b70 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:13.012608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792cc75-8840-4faa-a066-b3f43caf8b70 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:13.012887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792cc75-8840-4faa-a066-b3f43caf8b70 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:13.013678 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792cc75-8840-4faa-a066-b3f43caf8b70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:13.013987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792cc75-8840-4faa-a066-b3f43caf8b70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:13.015372 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792cc75-8840-4faa-a066-b3f43caf8b70 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:13.029393 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 220/449] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:13.037647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792cc75-8840-4faa-a066-b3f43caf8b70 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:13.093163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:13.120259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef38c2-2c05-478d-81b5-1669625e2665 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:13.171254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546833f-3f8c-463a-b91d-4f62c14d36c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:13.172191 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546833f-3f8c-463a-b91d-4f62c14d36c7 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:13.172538 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546833f-3f8c-463a-b91d-4f62c14d36c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:13.172812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546833f-3f8c-463a-b91d-4f62c14d36c7 None admin] PATH_INFO: `/v3/groups/db903d58e04b40ad886a83249d9e03de` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:13.174050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546833f-3f8c-463a-b91d-4f62c14d36c7 None admin] RBAC: Authorizing `identity:get_group(group_id=db903d58e04b40ad886a83249d9e03de)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:13.176168 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546833f-3f8c-463a-b91d-4f62c14d36c7 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:13.177004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792cc75-8840-4faa-a066-b3f43caf8b70 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:13.177446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 230/450] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:12 2022] GET /identity/v3/groups/db903d58e04b40ad886a83249d9e03de => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:13.186659 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546833f-3f8c-463a-b91d-4f62c14d36c7 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:13.199786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:13.226185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888924a4-30e6-488e-b1fc-c33274e68783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:13.226962 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888924a4-30e6-488e-b1fc-c33274e68783 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:13.227246 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888924a4-30e6-488e-b1fc-c33274e68783 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:13.227524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888924a4-30e6-488e-b1fc-c33274e68783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:13.319461 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888924a4-30e6-488e-b1fc-c33274e68783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:13.320962 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888924a4-30e6-488e-b1fc-c33274e68783 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:13.323374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546833f-3f8c-463a-b91d-4f62c14d36c7 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:13.366331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:13.374271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5fc2a-deff-4433-b10b-5223c0f6cdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:13.374940 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5fc2a-deff-4433-b10b-5223c0f6cdd2 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:13.375228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5fc2a-deff-4433-b10b-5223c0f6cdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:13.375535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5fc2a-deff-4433-b10b-5223c0f6cdd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:13.376346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5fc2a-deff-4433-b10b-5223c0f6cdd2 None admin] RBAC: Adding query filter params (group.id=db903d58e04b40ad886a83249d9e03de, role.id=cf5f891b636947e0840ddfa871027fed, scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:13.376662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5fc2a-deff-4433-b10b-5223c0f6cdd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:13.378231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5fc2a-deff-4433-b10b-5223c0f6cdd2 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:13.393540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 231/451] 10.222.0.39 () {56 vars in 1376 bytes} [Tue May 31 20:39:13 2022] GET /identity/v3/role_assignments?group.id=db903d58e04b40ad886a83249d9e03de&scope.project.id=3b81e28b94aa40e9a9ab61284d4c0978&role.id=cf5f891b636947e0840ddfa871027fed => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:13.442419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 221/452] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:39:13.448443 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5fc2a-deff-4433-b10b-5223c0f6cdd2 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:13.531851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:13.563609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5fc2a-deff-4433-b10b-5223c0f6cdd2 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:13.599052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c8dc3-21f6-48f5-84e6-908465cf09ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:13.599916 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c8dc3-21f6-48f5-84e6-908465cf09ee None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:13.600195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c8dc3-21f6-48f5-84e6-908465cf09ee None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:13.600470 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c8dc3-21f6-48f5-84e6-908465cf09ee None admin] PATH_INFO: `/v3/projects/8f897b27191b44a4b4a76e83f6d0aaaa` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:13.601939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c8dc3-21f6-48f5-84e6-908465cf09ee None admin] RBAC: Authorizing `identity:get_project(project_id=8f897b27191b44a4b4a76e83f6d0aaaa)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:13.603375 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c8dc3-21f6-48f5-84e6-908465cf09ee None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:13.605063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 232/453] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:39:13 2022] GET /identity/v3/projects/8f897b27191b44a4b4a76e83f6d0aaaa => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:13.611215 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888924a4-30e6-488e-b1fc-c33274e68783 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:13.714064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888924a4-30e6-488e-b1fc-c33274e68783 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:13.749837 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce80bb2-aacb-484e-a83e-afa367ff596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:13.750698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce80bb2-aacb-484e-a83e-afa367ff596d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:13.750981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce80bb2-aacb-484e-a83e-afa367ff596d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:13.751254 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce80bb2-aacb-484e-a83e-afa367ff596d None admin] PATH_INFO: `/v3/groups/c029116fd326428a93d962dca54104de` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:13.752432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce80bb2-aacb-484e-a83e-afa367ff596d None admin] RBAC: Authorizing `identity:get_group(group_id=c029116fd326428a93d962dca54104de)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:13.753961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce80bb2-aacb-484e-a83e-afa367ff596d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:13.755575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 222/454] 10.222.0.39 () {56 vars in 1180 bytes} [Tue May 31 20:39:13 2022] GET /identity/v3/groups/c029116fd326428a93d962dca54104de => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:13.761526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c8dc3-21f6-48f5-84e6-908465cf09ee None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:13.862988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c8dc3-21f6-48f5-84e6-908465cf09ee None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:13.896870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5f893-ae3c-4f26-9301-2eca1d69a834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:13.897628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5f893-ae3c-4f26-9301-2eca1d69a834 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:13.897914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5f893-ae3c-4f26-9301-2eca1d69a834 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:13.898190 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5f893-ae3c-4f26-9301-2eca1d69a834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:13.899021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5f893-ae3c-4f26-9301-2eca1d69a834 None admin] RBAC: Adding query filter params (group.id=c029116fd326428a93d962dca54104de, role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=8f897b27191b44a4b4a76e83f6d0aaaa) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:13.899335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5f893-ae3c-4f26-9301-2eca1d69a834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:13.900774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5f893-ae3c-4f26-9301-2eca1d69a834 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:13.907374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 233/455] 10.222.0.39 () {56 vars in 1376 bytes} [Tue May 31 20:39:13 2022] GET /identity/v3/role_assignments?group.id=c029116fd326428a93d962dca54104de&scope.project.id=8f897b27191b44a4b4a76e83f6d0aaaa&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:16.674544 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c1d48-3a6e-407f-a069-3d0a28cd9d2a None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:16.675097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c1d48-3a6e-407f-a069-3d0a28cd9d2a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:16.675097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c1d48-3a6e-407f-a069-3d0a28cd9d2a None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:16.676590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 223/456] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:16.691078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90ebe3-582c-4fd6-8fd8-d018678eba4f None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:16.691573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90ebe3-582c-4fd6-8fd8-d018678eba4f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:16.691645 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90ebe3-582c-4fd6-8fd8-d018678eba4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:16.704660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:16.711026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-1e90ebe3-582c-4fd6-8fd8-d018678eba4f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:16.712241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1e90ebe3-582c-4fd6-8fd8-d018678eba4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:16.818758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 234/457] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:16.860338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c1d48-3a6e-407f-a069-3d0a28cd9d2a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:16.871342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:17.027846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c1d48-3a6e-407f-a069-3d0a28cd9d2a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:17.040925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039857-cf8c-40fb-95f5-4b1f44dad089 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:17.041620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039857-cf8c-40fb-95f5-4b1f44dad089 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:17.042094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039857-cf8c-40fb-95f5-4b1f44dad089 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:17.044618 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 235/458] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:17.051025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774034b-a28c-4c3b-9864-63e756db610c None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:17.051626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774034b-a28c-4c3b-9864-63e756db610c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:17.052095 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774034b-a28c-4c3b-9864-63e756db610c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:17.075933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28506a94-3831-4941-bba1-d09e70a07561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:17.076750 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28506a94-3831-4941-bba1-d09e70a07561 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:17.077029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28506a94-3831-4941-bba1-d09e70a07561 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:17.077299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28506a94-3831-4941-bba1-d09e70a07561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:17.104146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28506a94-3831-4941-bba1-d09e70a07561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:17.106214 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28506a94-3831-4941-bba1-d09e70a07561 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-28506a94-3831-4941-bba1-d09e70a07561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:17.146292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:17.147230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:17.148075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:17.148075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:17.148075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:17.148075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:17.157898 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 224/459] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:17.158943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28506a94-3831-4941-bba1-d09e70a07561 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:17.239545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-0774034b-a28c-4c3b-9864-63e756db610c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:17.241552 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0774034b-a28c-4c3b-9864-63e756db610c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:17.260298 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:17.319503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28506a94-3831-4941-bba1-d09e70a07561 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:17.336263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 236/460] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:17.339734 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a552c3-c6c8-4e24-9b19-d2eac94295b9 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:17.340215 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a552c3-c6c8-4e24-9b19-d2eac94295b9 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:17.340657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a552c3-c6c8-4e24-9b19-d2eac94295b9 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:17.342948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 237/461] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:17.354685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b4b35-67dc-4277-95c7-209e90ca1fa4 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:17.355748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b4b35-67dc-4277-95c7-209e90ca1fa4 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:17.356229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b4b35-67dc-4277-95c7-209e90ca1fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:17.368377 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7fa92-3248-4264-9050-2e308d967cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:17.369127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7fa92-3248-4264-9050-2e308d967cc9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:17.369654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7fa92-3248-4264-9050-2e308d967cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:17.370105 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7fa92-3248-4264-9050-2e308d967cc9 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:17.371076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7fa92-3248-4264-9050-2e308d967cc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:17.371579 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7fa92-3248-4264-9050-2e308d967cc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:17.373121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7fa92-3248-4264-9050-2e308d967cc9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:17.379980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b44b4b35-67dc-4277-95c7-209e90ca1fa4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:17.381742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b44b4b35-67dc-4277-95c7-209e90ca1fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:17.387183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 225/462] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:17.392461 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7fa92-3248-4264-9050-2e308d967cc9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:17.454091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:17.469808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 238/463] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:17.470492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b4b35-67dc-4277-95c7-209e90ca1fa4 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:17.505122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7fa92-3248-4264-9050-2e308d967cc9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:17.524795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:17.544604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54382e2-93cf-406c-9017-e33a185a27f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:17.545491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54382e2-93cf-406c-9017-e33a185a27f8 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:17.545781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54382e2-93cf-406c-9017-e33a185a27f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:17.546054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54382e2-93cf-406c-9017-e33a185a27f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:17.557537 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54382e2-93cf-406c-9017-e33a185a27f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:17.559746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54382e2-93cf-406c-9017-e33a185a27f8 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:17.579109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b4b35-67dc-4277-95c7-209e90ca1fa4 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-b54382e2-93cf-406c-9017-e33a185a27f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:17.579761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:17.580684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:17.581704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:17.581704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:17.581704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:17.581704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:17.588529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 226/464] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:17.588529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e7cd1-ba42-4a61-81e9-64157bfabc4a None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:17.588529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e7cd1-ba42-4a61-81e9-64157bfabc4a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:17.588529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e7cd1-ba42-4a61-81e9-64157bfabc4a None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:17.588529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 227/465] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:17.588529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e7cd1-ba42-4a61-81e9-64157bfabc4a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:17.624114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf32541-1788-4460-874f-6cf61cd49cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:17.624779 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf32541-1788-4460-874f-6cf61cd49cd6 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:17.625057 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf32541-1788-4460-874f-6cf61cd49cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:17.625332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf32541-1788-4460-874f-6cf61cd49cd6 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:17.626074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf32541-1788-4460-874f-6cf61cd49cd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:17.627478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf32541-1788-4460-874f-6cf61cd49cd6 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:17.693541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e7cd1-ba42-4a61-81e9-64157bfabc4a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:17.730673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ed960-8722-40e5-a66a-be995c8c5a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:17.731526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ed960-8722-40e5-a66a-be995c8c5a27 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:17.731809 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ed960-8722-40e5-a66a-be995c8c5a27 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:17.732080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ed960-8722-40e5-a66a-be995c8c5a27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:17.732842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 239/466] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:39:17 2022] POST /identity/v3/users => generated 246 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:39:17.733565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf32541-1788-4460-874f-6cf61cd49cd6 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:17.757811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ed960-8722-40e5-a66a-be995c8c5a27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:17.759739 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ed960-8722-40e5-a66a-be995c8c5a27 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-264ed960-8722-40e5-a66a-be995c8c5a27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:17.782430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:17.783431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:17.784268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:17.784268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:17.784268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:17.784268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:17.791704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 228/467] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:17.794669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007c1b2-a9c1-4540-82d2-79bf8dc1a45c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:17.795270 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007c1b2-a9c1-4540-82d2-79bf8dc1a45c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:17.795840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007c1b2-a9c1-4540-82d2-79bf8dc1a45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:17.798063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:17.817336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d007c1b2-a9c1-4540-82d2-79bf8dc1a45c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:17.818988 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d007c1b2-a9c1-4540-82d2-79bf8dc1a45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:17.839183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:17.857471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf32541-1788-4460-874f-6cf61cd49cd6 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:17.896923 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0639b-71ea-4536-afcd-adc56090d5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:17.897707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0639b-71ea-4536-afcd-adc56090d5e9 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:17.897992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0639b-71ea-4536-afcd-adc56090d5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:17.898268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0639b-71ea-4536-afcd-adc56090d5e9 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:17.899612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0639b-71ea-4536-afcd-adc56090d5e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:17.899981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0639b-71ea-4536-afcd-adc56090d5e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:17.901668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0639b-71ea-4536-afcd-adc56090d5e9 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:17.909769 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 229/468] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:17.911135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007c1b2-a9c1-4540-82d2-79bf8dc1a45c None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:17.921420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 240/469] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:17.922715 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0639b-71ea-4536-afcd-adc56090d5e9 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:18.053864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007c1b2-a9c1-4540-82d2-79bf8dc1a45c None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:18.058862 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0639b-71ea-4536-afcd-adc56090d5e9 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:18.075854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:18.092329 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397dc38-ae6b-4b71-9e7f-d36d4e67a146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:18.092916 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397dc38-ae6b-4b71-9e7f-d36d4e67a146 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:18.093244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397dc38-ae6b-4b71-9e7f-d36d4e67a146 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:18.093483 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397dc38-ae6b-4b71-9e7f-d36d4e67a146 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:18.094195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397dc38-ae6b-4b71-9e7f-d36d4e67a146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:18.094496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397dc38-ae6b-4b71-9e7f-d36d4e67a146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:18.095922 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397dc38-ae6b-4b71-9e7f-d36d4e67a146 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:18.099266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4d84c-b580-447d-9829-62ab5e7ec9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:18.099941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4d84c-b580-447d-9829-62ab5e7ec9c3 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:18.100225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4d84c-b580-447d-9829-62ab5e7ec9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:18.100502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4d84c-b580-447d-9829-62ab5e7ec9c3 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:18.101206 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4d84c-b580-447d-9829-62ab5e7ec9c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:18.103172 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4d84c-b580-447d-9829-62ab5e7ec9c3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:18.109487 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 230/470] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:18.109487 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397dc38-ae6b-4b71-9e7f-d36d4e67a146 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:18.125021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:18.185987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 241/471] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:39:17 2022] POST /identity/v3/users => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:39:18.199576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4821bb6-3cf8-4c08-b879-4552c8ac1143 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:18.199886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4821bb6-3cf8-4c08-b879-4552c8ac1143 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:18.200145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4821bb6-3cf8-4c08-b879-4552c8ac1143 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:18.201968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 242/472] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:18 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:18.202504 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4821bb6-3cf8-4c08-b879-4552c8ac1143 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:18.223345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397dc38-ae6b-4b71-9e7f-d36d4e67a146 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:18.285906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddd62c-a2ea-47a0-b8a8-237f27404606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:18.287878 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd62c-a2ea-47a0-b8a8-237f27404606 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:18.288381 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd62c-a2ea-47a0-b8a8-237f27404606 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:18.288857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd62c-a2ea-47a0-b8a8-237f27404606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:18.305867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddd62c-a2ea-47a0-b8a8-237f27404606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:18.307861 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddd62c-a2ea-47a0-b8a8-237f27404606 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e1ddd62c-a2ea-47a0-b8a8-237f27404606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:18.327584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:18.328716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:18.329763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:18.329763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:18.329763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:18.329763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:18.335955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 231/473] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:18.335955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516cd45-ab85-4a49-82d4-bd9b814f634b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:18.335955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516cd45-ab85-4a49-82d4-bd9b814f634b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:18.335955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516cd45-ab85-4a49-82d4-bd9b814f634b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:18.349723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4821bb6-3cf8-4c08-b879-4552c8ac1143 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:18.353670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-3516cd45-ab85-4a49-82d4-bd9b814f634b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:18.355417 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-3516cd45-ab85-4a49-82d4-bd9b814f634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:18.400712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cfc06-357e-4350-b7c5-a654564713b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:18.401785 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cfc06-357e-4350-b7c5-a654564713b4 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:18.402212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cfc06-357e-4350-b7c5-a654564713b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:18.402689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cfc06-357e-4350-b7c5-a654564713b4 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:18.404358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cfc06-357e-4350-b7c5-a654564713b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:18.407334 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cfc06-357e-4350-b7c5-a654564713b4 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:18.425154 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:18.436400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 232/474] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:18.437150 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516cd45-ab85-4a49-82d4-bd9b814f634b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:18.526111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 243/475] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:39:18 2022] POST /identity/v3/users => generated 248 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:39:18.528021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cfc06-357e-4350-b7c5-a654564713b4 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:18.550404 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516cd45-ab85-4a49-82d4-bd9b814f634b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:18.578144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:18.601125 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e338e3-d478-4630-aceb-00d5b054d051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:18.602231 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e338e3-d478-4630-aceb-00d5b054d051 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:18.602578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e338e3-d478-4630-aceb-00d5b054d051 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:18.602857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e338e3-d478-4630-aceb-00d5b054d051 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:18.603645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e338e3-d478-4630-aceb-00d5b054d051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:18.604277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e338e3-d478-4630-aceb-00d5b054d051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:18.606138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e338e3-d478-4630-aceb-00d5b054d051 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:18.620827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 233/476] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:18.627595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e338e3-d478-4630-aceb-00d5b054d051 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:18.726508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:18.734919 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cfc06-357e-4350-b7c5-a654564713b4 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:18.800694 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c8ffc-0f3d-48b1-b1d2-04bd1f64dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:18.801391 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c8ffc-0f3d-48b1-b1d2-04bd1f64dd82 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:18.801679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c8ffc-0f3d-48b1-b1d2-04bd1f64dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:18.801954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c8ffc-0f3d-48b1-b1d2-04bd1f64dd82 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:18.802698 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c8ffc-0f3d-48b1-b1d2-04bd1f64dd82 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:18.804140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c8ffc-0f3d-48b1-b1d2-04bd1f64dd82 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:18.816239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e338e3-d478-4630-aceb-00d5b054d051 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:18.855267 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdcc82-85d1-4b2b-aa27-4e2ff2566366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:18.856895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.sql.core [None req-6d2c8ffc-0f3d-48b1-b1d2-04bd1f64dd82 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 31 20:39:18.856895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 31 20:39:18.856895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [parameters: {'id': '4b060d82a166412eab87395270c42ff9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 31 20:39:18.856895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87215) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 31 20:39:18.857602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdcc82-85d1-4b2b-aa27-4e2ff2566366 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:18.858118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdcc82-85d1-4b2b-aa27-4e2ff2566366 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:18.861700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdcc82-85d1-4b2b-aa27-4e2ff2566366 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:18.861700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdcc82-85d1-4b2b-aa27-4e2ff2566366 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:18.861700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdcc82-85d1-4b2b-aa27-4e2ff2566366 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-6d2c8ffc-0f3d-48b1-b1d2-04bd1f64dd82 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application result = self._query(query) May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application conn.query(q) May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application result.read() May 31 20:39:18.873976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return ref.to_dict() May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 20:39:18.874970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application next(self.gen) May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application yield resource May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application next(self.gen) May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self.session.rollback() May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self.force_reraise() May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise self.value May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application session.commit() May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 31 20:39:18.875904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._prepare_impl() May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self.session.flush() May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._flush(objects) May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application compat.raise_( May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application flush_context.execute() May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rec.execute(self) May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 31 20:39:18.876742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application _emit_insert_statements( May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application c = connection._execute_20( May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ret = self._execute_context( May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 20:39:18.878263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application result = self._query(query) May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application conn.query(q) May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application result.read() May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 20:39:18.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [parameters: {'id': '4b060d82a166412eab87395270c42ff9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:18.879956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 31 20:39:18.880744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:18.887480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 244/477] 10.222.0.39 () {60 vars in 1131 bytes} [Tue May 31 20:39:18 2022] POST /identity/v3/roles => generated 144 bytes in 349 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:18.887480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c8ffc-0f3d-48b1-b1d2-04bd1f64dd82 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:18.943287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 234/478] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:39:18 2022] POST /identity/v3/users => generated 249 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:39:18.993943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:19.007262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c8ffc-0f3d-48b1-b1d2-04bd1f64dd82 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:19.051810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b33e9d-a9e2-4c3d-8459-83ccb1789d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:19.052964 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b33e9d-a9e2-4c3d-8459-83ccb1789d5f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:19.053340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b33e9d-a9e2-4c3d-8459-83ccb1789d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:19.053790 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b33e9d-a9e2-4c3d-8459-83ccb1789d5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:19.066165 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b33e9d-a9e2-4c3d-8459-83ccb1789d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-c9b33e9d-a9e2-4c3d-8459-83ccb1789d5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:19.075626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:19.076778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:19.077806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:19.077806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:19.077806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:19.077806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:19.077806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:19.077806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:19.077806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:19.077806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:19.077806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:19.077806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:19.077806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:39:19.077806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:19.079966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 245/479] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:39:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:19.085244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdcc82-85d1-4b2b-aa27-4e2ff2566366 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:19.210731 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdcc82-85d1-4b2b-aa27-4e2ff2566366 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:19.222819 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:19.250017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d20b9-5ab9-4974-8029-3b0de1b69454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:19.250880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d20b9-5ab9-4974-8029-3b0de1b69454 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:19.251259 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d20b9-5ab9-4974-8029-3b0de1b69454 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:19.251632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d20b9-5ab9-4974-8029-3b0de1b69454 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:19.252574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d20b9-5ab9-4974-8029-3b0de1b69454 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:19.252981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d20b9-5ab9-4974-8029-3b0de1b69454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:19.254515 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d20b9-5ab9-4974-8029-3b0de1b69454 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:19.269674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 235/480] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:20.373953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42f390-f449-4502-ac57-4c9e474b03df None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:20.374513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42f390-f449-4502-ac57-4c9e474b03df None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:20.374513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42f390-f449-4502-ac57-4c9e474b03df None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:20.376287 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 246/481] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:20.382372 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f482b56-8094-4a2f-844b-06aae6f0a583 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:20.382880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f482b56-8094-4a2f-844b-06aae6f0a583 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:20.382988 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f482b56-8094-4a2f-844b-06aae6f0a583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:20.406564 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-6f482b56-8094-4a2f-844b-06aae6f0a583 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:20.407796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6f482b56-8094-4a2f-844b-06aae6f0a583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:20.503756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 236/482] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:20.547648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42f390-f449-4502-ac57-4c9e474b03df None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:20.663432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42f390-f449-4502-ac57-4c9e474b03df None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:20.701008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f4fb7-76d6-41a4-ad38-a0260a6f978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:20.701838 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f4fb7-76d6-41a4-ad38-a0260a6f978c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:20.702121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f4fb7-76d6-41a4-ad38-a0260a6f978c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:20.702396 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f4fb7-76d6-41a4-ad38-a0260a6f978c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:20.713349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f4fb7-76d6-41a4-ad38-a0260a6f978c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-860f4fb7-76d6-41a4-ad38-a0260a6f978c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:20.721120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:20.722050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:20.722869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:20.722869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:20.722869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:20.722869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:20.722869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:20.722869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:20.722869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:20.722869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:20.722869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:20.722869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:20.722869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:20.722869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:20.722869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 247/483] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:20.728140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f482b56-8094-4a2f-844b-06aae6f0a583 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:20.903313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:20.906174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f482b56-8094-4a2f-844b-06aae6f0a583 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:20.957050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6467b9-8a4f-40e4-b081-92020ec04575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:20.957660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6467b9-8a4f-40e4-b081-92020ec04575 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:20.957938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6467b9-8a4f-40e4-b081-92020ec04575 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:20.958211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6467b9-8a4f-40e4-b081-92020ec04575 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:20.958955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6467b9-8a4f-40e4-b081-92020ec04575 None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:20.959260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6467b9-8a4f-40e4-b081-92020ec04575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:20.960634 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6467b9-8a4f-40e4-b081-92020ec04575 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:20.973272 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 237/484] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:20.978680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f4fb7-76d6-41a4-ad38-a0260a6f978c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:21.003652 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:21.127063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f4fb7-76d6-41a4-ad38-a0260a6f978c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:21.176777 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3842fe7-dd58-424a-a46d-850b60414a86 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:21.177125 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3842fe7-dd58-424a-a46d-850b60414a86 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:21.177357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3842fe7-dd58-424a-a46d-850b60414a86 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:21.178024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17739920-df08-41b9-ab12-1841cd7da8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:21.178873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 238/485] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:21.178980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17739920-df08-41b9-ab12-1841cd7da8ee None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:21.179130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17739920-df08-41b9-ab12-1841cd7da8ee None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:21.179946 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17739920-df08-41b9-ab12-1841cd7da8ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:21.185344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c92da-3740-40e7-b2cc-07c0f1ceaa0f None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:21.185680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c92da-3740-40e7-b2cc-07c0f1ceaa0f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:21.185959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c92da-3740-40e7-b2cc-07c0f1ceaa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:21.195125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17739920-df08-41b9-ab12-1841cd7da8ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:21.196808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17739920-df08-41b9-ab12-1841cd7da8ee None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-17739920-df08-41b9-ab12-1841cd7da8ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:21.218033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:21.218924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:21.219776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:21.219776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:21.219776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:21.219776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:21.219776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 248/486] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:21.222468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d54c92da-3740-40e7-b2cc-07c0f1ceaa0f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:21.223659 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d54c92da-3740-40e7-b2cc-07c0f1ceaa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:21.225037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17739920-df08-41b9-ab12-1841cd7da8ee None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:21.298207 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:21.358225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17739920-df08-41b9-ab12-1841cd7da8ee None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:21.404368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 239/487] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:39:21.430198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4a298-a166-4711-86eb-ce9a4e2d673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:21.430876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4a298-a166-4711-86eb-ce9a4e2d673e None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:21.431166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4a298-a166-4711-86eb-ce9a4e2d673e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:21.431445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4a298-a166-4711-86eb-ce9a4e2d673e None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:21.432186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4a298-a166-4711-86eb-ce9a4e2d673e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:21.432545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4a298-a166-4711-86eb-ce9a4e2d673e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:21.436346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4a298-a166-4711-86eb-ce9a4e2d673e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:21.436506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c92da-3740-40e7-b2cc-07c0f1ceaa0f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:21.459144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 249/488] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:21.466303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4a298-a166-4711-86eb-ce9a4e2d673e None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:21.623939 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:21.639252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c92da-3740-40e7-b2cc-07c0f1ceaa0f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:21.663600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4a298-a166-4711-86eb-ce9a4e2d673e None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:21.702538 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:21.716155 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c810920-6c34-4329-a888-830dbaaa19e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:21.716998 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810920-6c34-4329-a888-830dbaaa19e2 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:21.717281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810920-6c34-4329-a888-830dbaaa19e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:21.720666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810920-6c34-4329-a888-830dbaaa19e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:21.740479 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6d1bc-4ec3-49b7-a10e-d0b270e8abe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:21.741294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d1bc-4ec3-49b7-a10e-d0b270e8abe2 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:21.741609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d1bc-4ec3-49b7-a10e-d0b270e8abe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:21.741884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d1bc-4ec3-49b7-a10e-d0b270e8abe2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:21.743011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c810920-6c34-4329-a888-830dbaaa19e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-8c810920-6c34-4329-a888-830dbaaa19e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:21.752746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:21.753725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:21.754540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:21.754540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:21.754540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:21.754540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:21.754540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:21.754540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:21.754540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:21.754540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:21.754540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:21.754540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:21.754540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:21.754540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:21.754540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 240/489] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:21.758565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6d1bc-4ec3-49b7-a10e-d0b270e8abe2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:21.760033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6d1bc-4ec3-49b7-a10e-d0b270e8abe2 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:21.762159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c810920-6c34-4329-a888-830dbaaa19e2 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-15f6d1bc-4ec3-49b7-a10e-d0b270e8abe2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:21.787863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:21.788834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:21.789771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:21.789771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:21.789771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:21.789771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:21.789771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:21.789771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:21.789771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:21.789771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:21.789771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:39:21.789771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:21.793094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 250/490] 10.222.0.39 () {56 vars in 1093 bytes} [Tue May 31 20:39:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:21.795038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27a778-eec8-4532-80dc-2d25a1d79770 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:21.795386 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27a778-eec8-4532-80dc-2d25a1d79770 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:21.795671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27a778-eec8-4532-80dc-2d25a1d79770 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:21.801557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 251/491] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:21.802612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27a778-eec8-4532-80dc-2d25a1d79770 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:21.893460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c810920-6c34-4329-a888-830dbaaa19e2 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:21.922803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27a778-eec8-4532-80dc-2d25a1d79770 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:21.931847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24de93-3d5f-49e8-9aed-4221dcda877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:21.933067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24de93-3d5f-49e8-9aed-4221dcda877d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:21.933352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24de93-3d5f-49e8-9aed-4221dcda877d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:21.933657 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24de93-3d5f-49e8-9aed-4221dcda877d None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:21.934509 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24de93-3d5f-49e8-9aed-4221dcda877d None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:21.934819 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24de93-3d5f-49e8-9aed-4221dcda877d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:21.936302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24de93-3d5f-49e8-9aed-4221dcda877d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:21.945699 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 241/492] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:21.947097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00cc33-3dd2-4cac-8632-6f39a0854db9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:21.947394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00cc33-3dd2-4cac-8632-6f39a0854db9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:21.947671 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00cc33-3dd2-4cac-8632-6f39a0854db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:21.962846 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecf23c-17b8-4395-aa4a-71337dcffa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:21.964330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecf23c-17b8-4395-aa4a-71337dcffa9c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:21.964720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecf23c-17b8-4395-aa4a-71337dcffa9c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:21.965101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecf23c-17b8-4395-aa4a-71337dcffa9c None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:21.966118 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecf23c-17b8-4395-aa4a-71337dcffa9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:21.966527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecf23c-17b8-4395-aa4a-71337dcffa9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:21.966791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-8d00cc33-3dd2-4cac-8632-6f39a0854db9 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:21.967987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8d00cc33-3dd2-4cac-8632-6f39a0854db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:21.968320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecf23c-17b8-4395-aa4a-71337dcffa9c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:21.978243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:22.010869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 252/493] 10.222.0.39 () {56 vars in 1133 bytes} [Tue May 31 20:39:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:22.012137 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecf23c-17b8-4395-aa4a-71337dcffa9c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:22.049676 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 242/494] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:22.050846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00cc33-3dd2-4cac-8632-6f39a0854db9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:22.068268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:22.130513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecf23c-17b8-4395-aa4a-71337dcffa9c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:22.163918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00cc33-3dd2-4cac-8632-6f39a0854db9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:22.169370 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0020260-5b59-4ce0-bdfa-3e481010a6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:22.170193 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0020260-5b59-4ce0-bdfa-3e481010a6ba None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:22.170477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0020260-5b59-4ce0-bdfa-3e481010a6ba None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:22.170755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0020260-5b59-4ce0-bdfa-3e481010a6ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:22.182191 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0020260-5b59-4ce0-bdfa-3e481010a6ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:22.183691 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0020260-5b59-4ce0-bdfa-3e481010a6ba None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:22.197603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a630c-59a1-4555-8cb6-36e1a2e0932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:22.198783 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a630c-59a1-4555-8cb6-36e1a2e0932e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:22.199069 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a630c-59a1-4555-8cb6-36e1a2e0932e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:22.199345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a630c-59a1-4555-8cb6-36e1a2e0932e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-c0020260-5b59-4ce0-bdfa-3e481010a6ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:22.202225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:22.203113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:22.204000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:22.204000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:22.204000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:22.204000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:22.204000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 253/495] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:22.204678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d3424-53ed-46c5-b110-ffb552cc4f96 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:22.204957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d3424-53ed-46c5-b110-ffb552cc4f96 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:22.205232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d3424-53ed-46c5-b110-ffb552cc4f96 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:22.206513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 254/496] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:22.207208 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d3424-53ed-46c5-b110-ffb552cc4f96 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:22.220330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:22.275047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a630c-59a1-4555-8cb6-36e1a2e0932e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:22.277143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a630c-59a1-4555-8cb6-36e1a2e0932e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:22.300397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:22.310922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d3424-53ed-46c5-b110-ffb552cc4f96 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:22.352598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea620148-9fc6-488a-a455-91a4bb6289f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:22.353431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea620148-9fc6-488a-a455-91a4bb6289f7 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:22.353720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea620148-9fc6-488a-a455-91a4bb6289f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:22.353999 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea620148-9fc6-488a-a455-91a4bb6289f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:22.364516 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea620148-9fc6-488a-a455-91a4bb6289f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-ea620148-9fc6-488a-a455-91a4bb6289f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:22.372271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:22.373182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:22.374044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:22.374044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:22.374044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:22.374044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:22.374044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:22.374044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:22.374044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:22.374044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:22.374044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:22.374044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:22.374044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:22.374044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:22.374044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 255/497] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:22.374713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eab15-c348-4dbb-8597-dc9908b6af6a None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:22.374969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eab15-c348-4dbb-8597-dc9908b6af6a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:22.375246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eab15-c348-4dbb-8597-dc9908b6af6a None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:22.376605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 256/498] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:22.377203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eab15-c348-4dbb-8597-dc9908b6af6a None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:22.387920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 243/499] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:22.387920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249167-923c-457f-8ecd-9d36947b292b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:22.387920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249167-923c-457f-8ecd-9d36947b292b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:22.387920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249167-923c-457f-8ecd-9d36947b292b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:22.404019 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-54249167-923c-457f-8ecd-9d36947b292b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:22.405252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-54249167-923c-457f-8ecd-9d36947b292b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:22.446727 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:22.473028 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 244/500] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:22.474267 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54249167-923c-457f-8ecd-9d36947b292b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:22.505036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eab15-c348-4dbb-8597-dc9908b6af6a None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:22.539342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966458c-e925-45e4-8622-37c56ed3810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:22.540012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966458c-e925-45e4-8622-37c56ed3810a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:22.540298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966458c-e925-45e4-8622-37c56ed3810a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:22.540578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966458c-e925-45e4-8622-37c56ed3810a None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:22.541304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966458c-e925-45e4-8622-37c56ed3810a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:22.541709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966458c-e925-45e4-8622-37c56ed3810a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:22.543094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966458c-e925-45e4-8622-37c56ed3810a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:22.554984 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 257/501] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:22.559022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2492fe-8759-4072-ac57-4715a10956d9 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:22.559376 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2492fe-8759-4072-ac57-4715a10956d9 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:22.559660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2492fe-8759-4072-ac57-4715a10956d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:22.576766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-ce2492fe-8759-4072-ac57-4715a10956d9 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:22.577981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ce2492fe-8759-4072-ac57-4715a10956d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:22.581143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:22.584918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54249167-923c-457f-8ecd-9d36947b292b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:22.618963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5becb-de84-4d57-9f4c-966299031fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:22.619630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5becb-de84-4d57-9f4c-966299031fe8 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:22.620423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5becb-de84-4d57-9f4c-966299031fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:22.620696 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5becb-de84-4d57-9f4c-966299031fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:22.621469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5becb-de84-4d57-9f4c-966299031fe8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:22.621778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5becb-de84-4d57-9f4c-966299031fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:22.623147 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5becb-de84-4d57-9f4c-966299031fe8 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:22.631300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 245/502] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:22.632105 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5becb-de84-4d57-9f4c-966299031fe8 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:22.645397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 258/503] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:22.646254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2492fe-8759-4072-ac57-4715a10956d9 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:22.672784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:22.737927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5becb-de84-4d57-9f4c-966299031fe8 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:22.746289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2492fe-8759-4072-ac57-4715a10956d9 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:22.772475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5aecc-7f57-4abd-b08c-47b1fe393e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:22.773256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5aecc-7f57-4abd-b08c-47b1fe393e5c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:22.773575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5aecc-7f57-4abd-b08c-47b1fe393e5c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:22.773853 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5aecc-7f57-4abd-b08c-47b1fe393e5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:22.781017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d6e74-d0e2-4a05-8466-171d26bb53b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:22.781833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d6e74-d0e2-4a05-8466-171d26bb53b4 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:22.782113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d6e74-d0e2-4a05-8466-171d26bb53b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:22.782388 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d6e74-d0e2-4a05-8466-171d26bb53b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:22.784854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5aecc-7f57-4abd-b08c-47b1fe393e5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:22.786670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5aecc-7f57-4abd-b08c-47b1fe393e5c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:22.790859 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:22.793053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d6e74-d0e2-4a05-8466-171d26bb53b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:22.794592 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d6e74-d0e2-4a05-8466-171d26bb53b4 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e4b5aecc-7f57-4abd-b08c-47b1fe393e5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:22.804981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:22.812289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:22.813129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:22.813129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:22.813129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:22.813129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:22.813129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 246/504] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:22.813129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5aecc-7f57-4abd-b08c-47b1fe393e5c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-f50d6e74-d0e2-4a05-8466-171d26bb53b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:22.813509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:22.814275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:22.815132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:22.815132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:22.815132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:22.815132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:22.815132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 259/505] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:22.816084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d6e74-d0e2-4a05-8466-171d26bb53b4 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:22.913135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:22.915991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d6e74-d0e2-4a05-8466-171d26bb53b4 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:22.932947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5aecc-7f57-4abd-b08c-47b1fe393e5c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:22.953116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff386413-f582-44af-892d-6b5b75bbf9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:22.954339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386413-f582-44af-892d-6b5b75bbf9ee None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:22.954790 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386413-f582-44af-892d-6b5b75bbf9ee None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:22.955276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386413-f582-44af-892d-6b5b75bbf9ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:22.972447 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff386413-f582-44af-892d-6b5b75bbf9ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:22.973953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff386413-f582-44af-892d-6b5b75bbf9ee None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:22.974492 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b75a1e-da20-411c-8808-250ee25378ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:22.975815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b75a1e-da20-411c-8808-250ee25378ab None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:22.976318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b75a1e-da20-411c-8808-250ee25378ab None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:22.976816 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b75a1e-da20-411c-8808-250ee25378ab None admin] PATH_INFO: `/v3/users/glance` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:22.989586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b75a1e-da20-411c-8808-250ee25378ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-ff386413-f582-44af-892d-6b5b75bbf9ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:22.990908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:22.991764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:22.992619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:22.992619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:22.992619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:22.992619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:22.992619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 260/506] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:22.992896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b75a1e-da20-411c-8808-250ee25378ab None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:22.992965 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff386413-f582-44af-892d-6b5b75bbf9ee None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-62b75a1e-da20-411c-8808-250ee25378ab None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:23.013189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:23.014224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:23.015288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:23.015288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:23.015288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:23.015288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:23.015288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:23.015288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:23.015288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:23.015288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:23.015288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 31 20:39:23.015288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:23.017556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 247/507] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:23.018558 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b75a1e-da20-411c-8808-250ee25378ab None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:23.043451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:23.099942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff386413-f582-44af-892d-6b5b75bbf9ee None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:23.122456 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b75a1e-da20-411c-8808-250ee25378ab None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:23.134440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b36a5d-aed0-401d-a766-c8819ac4a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:23.135791 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b36a5d-aed0-401d-a766-c8819ac4a7ca None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:23.136188 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b36a5d-aed0-401d-a766-c8819ac4a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:23.136475 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b36a5d-aed0-401d-a766-c8819ac4a7ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:23.147457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b36a5d-aed0-401d-a766-c8819ac4a7ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-84b36a5d-aed0-401d-a766-c8819ac4a7ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:23.155757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:23.156693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:23.157836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:23.157836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:23.157836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:23.157836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:23.157836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:23.157836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:23.157836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:23.157836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:23.157836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:23.157836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:23.157836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:23.157836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:23.157836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 261/508] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:23.158501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b36a5d-aed0-401d-a766-c8819ac4a7ca None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:23.169724 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ec771-e3df-44f9-8220-70d0819241a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:23.170389 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ec771-e3df-44f9-8220-70d0819241a4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:23.170683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ec771-e3df-44f9-8220-70d0819241a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:23.170954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ec771-e3df-44f9-8220-70d0819241a4 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:23.171672 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ec771-e3df-44f9-8220-70d0819241a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:23.171974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ec771-e3df-44f9-8220-70d0819241a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:23.173347 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ec771-e3df-44f9-8220-70d0819241a4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:23.186347 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 248/509] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:23.187085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ec771-e3df-44f9-8220-70d0819241a4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:23.201044 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:23.266673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b36a5d-aed0-401d-a766-c8819ac4a7ca None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:23.268882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:23.292552 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ec771-e3df-44f9-8220-70d0819241a4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:23.301277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa808095-b7db-4a4c-b031-3011a48fc493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:23.301982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa808095-b7db-4a4c-b031-3011a48fc493 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:23.302271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa808095-b7db-4a4c-b031-3011a48fc493 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:23.302554 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa808095-b7db-4a4c-b031-3011a48fc493 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:23.303287 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa808095-b7db-4a4c-b031-3011a48fc493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:23.303594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa808095-b7db-4a4c-b031-3011a48fc493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:23.304996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa808095-b7db-4a4c-b031-3011a48fc493 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:23.318017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 262/510] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:23.318677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa808095-b7db-4a4c-b031-3011a48fc493 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:23.332313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062b767-89ca-40e4-a3df-17feb84f800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:23.332977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062b767-89ca-40e4-a3df-17feb84f800a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:23.333265 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062b767-89ca-40e4-a3df-17feb84f800a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:23.333582 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062b767-89ca-40e4-a3df-17feb84f800a None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:23.334567 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062b767-89ca-40e4-a3df-17feb84f800a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:23.334880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062b767-89ca-40e4-a3df-17feb84f800a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:23.336264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062b767-89ca-40e4-a3df-17feb84f800a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:23.348053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 249/511] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:23.348866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062b767-89ca-40e4-a3df-17feb84f800a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:23.415756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:23.420976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa808095-b7db-4a4c-b031-3011a48fc493 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:23.449934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062b767-89ca-40e4-a3df-17feb84f800a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:23.456551 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e8fd3-024d-4898-b076-427868f5bbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:23.457352 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8fd3-024d-4898-b076-427868f5bbb0 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:23.457672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8fd3-024d-4898-b076-427868f5bbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:23.457952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8fd3-024d-4898-b076-427868f5bbb0 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:23.458793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e8fd3-024d-4898-b076-427868f5bbb0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:23.459103 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e8fd3-024d-4898-b076-427868f5bbb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:23.460551 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e8fd3-024d-4898-b076-427868f5bbb0 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:23.477901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 263/512] 10.222.0.39 () {56 vars in 1137 bytes} [Tue May 31 20:39:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:23.479039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e8fd3-024d-4898-b076-427868f5bbb0 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:23.484046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be69d7-bbd0-4110-b004-6548d4032c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:23.484711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be69d7-bbd0-4110-b004-6548d4032c6d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:23.484994 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be69d7-bbd0-4110-b004-6548d4032c6d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:23.485271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be69d7-bbd0-4110-b004-6548d4032c6d None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:23.486054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be69d7-bbd0-4110-b004-6548d4032c6d None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:23.486363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be69d7-bbd0-4110-b004-6548d4032c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:23.487739 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be69d7-bbd0-4110-b004-6548d4032c6d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:23.496737 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 250/513] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:23.498789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be69d7-bbd0-4110-b004-6548d4032c6d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:23.504038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:23.587113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e8fd3-024d-4898-b076-427868f5bbb0 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:23.600036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be69d7-bbd0-4110-b004-6548d4032c6d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:23.621750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446eff5-0ea3-4251-8d19-c2f784938352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:23.622549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446eff5-0ea3-4251-8d19-c2f784938352 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:23.622835 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446eff5-0ea3-4251-8d19-c2f784938352 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:23.623114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446eff5-0ea3-4251-8d19-c2f784938352 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:23.630782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446eff5-0ea3-4251-8d19-c2f784938352 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:23.631106 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:23.632263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446eff5-0ea3-4251-8d19-c2f784938352 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:23.637629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ded88d-476e-4cc0-8517-49bfc98a9f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:23.638298 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ded88d-476e-4cc0-8517-49bfc98a9f21 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:23.638615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ded88d-476e-4cc0-8517-49bfc98a9f21 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:23.638891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ded88d-476e-4cc0-8517-49bfc98a9f21 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:23.639781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ded88d-476e-4cc0-8517-49bfc98a9f21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:23.641211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ded88d-476e-4cc0-8517-49bfc98a9f21 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-d446eff5-0ea3-4251-8d19-c2f784938352 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:23.647510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:23.648427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:23.649279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:23.649279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:23.649279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:23.649279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:23.649279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:23.649279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:23.649279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:23.649279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:23.649279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 264/514] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:23.650238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446eff5-0ea3-4251-8d19-c2f784938352 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:23.727146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 251/515] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:39:23 2022] POST /identity/v3/users => generated 247 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:39:23.728089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ded88d-476e-4cc0-8517-49bfc98a9f21 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:23.732197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:23.753655 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446eff5-0ea3-4251-8d19-c2f784938352 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:23.802262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c268e3-fcb5-4be4-bdac-a0a5ddbe6764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:23.803237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c268e3-fcb5-4be4-bdac-a0a5ddbe6764 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:23.803526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c268e3-fcb5-4be4-bdac-a0a5ddbe6764 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:23.803799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c268e3-fcb5-4be4-bdac-a0a5ddbe6764 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:23.815311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c268e3-fcb5-4be4-bdac-a0a5ddbe6764 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:23.817199 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c268e3-fcb5-4be4-bdac-a0a5ddbe6764 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-30c268e3-fcb5-4be4-bdac-a0a5ddbe6764 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:23.833911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:23.836693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:23.837704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:23.837704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:23.837704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:23.837704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:23.837704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:23.837704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:23.837704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:23.837704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:23.837704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:39:23.837704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:23.840669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 265/516] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:23.841696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c268e3-fcb5-4be4-bdac-a0a5ddbe6764 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:23.866068 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ded88d-476e-4cc0-8517-49bfc98a9f21 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:23.906866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a126e9-78c6-4e56-946e-83dbf18e503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:23.907519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a126e9-78c6-4e56-946e-83dbf18e503f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:23.907808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a126e9-78c6-4e56-946e-83dbf18e503f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:23.908079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a126e9-78c6-4e56-946e-83dbf18e503f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:23.964647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c268e3-fcb5-4be4-bdac-a0a5ddbe6764 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:23.976789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:23.992181 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a126e9-78c6-4e56-946e-83dbf18e503f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:23.993683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a126e9-78c6-4e56-946e-83dbf18e503f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:24.005151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa2bdd-d8d9-4d01-854a-9ed740cae264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:24.006013 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa2bdd-d8d9-4d01-854a-9ed740cae264 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:24.006308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa2bdd-d8d9-4d01-854a-9ed740cae264 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:24.006588 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa2bdd-d8d9-4d01-854a-9ed740cae264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:24.018613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa2bdd-d8d9-4d01-854a-9ed740cae264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:24.020089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa2bdd-d8d9-4d01-854a-9ed740cae264 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:24.022637 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-d0fa2bdd-d8d9-4d01-854a-9ed740cae264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:24.038864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:24.039770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:24.041265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:24.041265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:24.041265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:24.041265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:24.041265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 266/517] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:24.041265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa2bdd-d8d9-4d01-854a-9ed740cae264 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:24.109197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 252/518] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:24.114362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a126e9-78c6-4e56-946e-83dbf18e503f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:24.148336 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa2bdd-d8d9-4d01-854a-9ed740cae264 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:24.184960 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fa0e5-9dfd-4651-8ee3-a78a87102e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:24.185665 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fa0e5-9dfd-4651-8ee3-a78a87102e1b None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:24.185948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fa0e5-9dfd-4651-8ee3-a78a87102e1b None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:24.186236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fa0e5-9dfd-4651-8ee3-a78a87102e1b None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:24.187021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fa0e5-9dfd-4651-8ee3-a78a87102e1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:24.187401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fa0e5-9dfd-4651-8ee3-a78a87102e1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:24.188784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fa0e5-9dfd-4651-8ee3-a78a87102e1b None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:24.204408 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:24.208249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 267/519] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:24.209084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fa0e5-9dfd-4651-8ee3-a78a87102e1b None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:24.226375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a126e9-78c6-4e56-946e-83dbf18e503f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:24.267476 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273c2ad-50ad-4a13-a60b-c504de761e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:24.268157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273c2ad-50ad-4a13-a60b-c504de761e8b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:24.268444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273c2ad-50ad-4a13-a60b-c504de761e8b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:24.268836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273c2ad-50ad-4a13-a60b-c504de761e8b None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:24.269589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273c2ad-50ad-4a13-a60b-c504de761e8b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:24.269903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273c2ad-50ad-4a13-a60b-c504de761e8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:24.270586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:24.271545 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273c2ad-50ad-4a13-a60b-c504de761e8b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:24.311037 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 253/520] 10.222.0.39 () {56 vars in 1137 bytes} [Tue May 31 20:39:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:24.311895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273c2ad-50ad-4a13-a60b-c504de761e8b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:24.329357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fa0e5-9dfd-4651-8ee3-a78a87102e1b None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:24.364648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff825e-f32e-4cbd-b3ba-04d463172f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:24.365235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff825e-f32e-4cbd-b3ba-04d463172f76 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:24.365573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff825e-f32e-4cbd-b3ba-04d463172f76 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:24.365852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff825e-f32e-4cbd-b3ba-04d463172f76 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:24.366575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff825e-f32e-4cbd-b3ba-04d463172f76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:24.366911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff825e-f32e-4cbd-b3ba-04d463172f76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:24.368273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff825e-f32e-4cbd-b3ba-04d463172f76 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:24.381806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 268/521] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:24.382625 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff825e-f32e-4cbd-b3ba-04d463172f76 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:24.431574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273c2ad-50ad-4a13-a60b-c504de761e8b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:24.470029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cd6d6-b7a2-48cb-9c6e-09ae862a0448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:24.470835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd6d6-b7a2-48cb-9c6e-09ae862a0448 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:24.471119 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd6d6-b7a2-48cb-9c6e-09ae862a0448 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:24.471398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd6d6-b7a2-48cb-9c6e-09ae862a0448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:24.483131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cd6d6-b7a2-48cb-9c6e-09ae862a0448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:24.484611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cd6d6-b7a2-48cb-9c6e-09ae862a0448 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:24.497615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:24.501019 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff825e-f32e-4cbd-b3ba-04d463172f76 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-3e5cd6d6-b7a2-48cb-9c6e-09ae862a0448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:24.510607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:24.511947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:24.512803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:24.512803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:24.512803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:24.512803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:24.512803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 254/522] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:24.512803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cd6d6-b7a2-48cb-9c6e-09ae862a0448 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:24.521524 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:24.545196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f7ed9-a13e-45a2-a262-ef1d470ad7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:24.546330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f7ed9-a13e-45a2-a262-ef1d470ad7b7 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:24.546615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f7ed9-a13e-45a2-a262-ef1d470ad7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:24.547148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f7ed9-a13e-45a2-a262-ef1d470ad7b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:24.547987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f7ed9-a13e-45a2-a262-ef1d470ad7b7 None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=8c86c12743bd4ee8843dba4a7af5d7a0) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:24.548296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f7ed9-a13e-45a2-a262-ef1d470ad7b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:24.550747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f7ed9-a13e-45a2-a262-ef1d470ad7b7 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:24.565421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 269/523] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:24 2022] GET /identity/v3/role_assignments?user.id=8c86c12743bd4ee8843dba4a7af5d7a0&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:24.565421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f7ed9-a13e-45a2-a262-ef1d470ad7b7 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:24.641895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cd6d6-b7a2-48cb-9c6e-09ae862a0448 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:24.691985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf2ad5-c34f-4d90-abe4-172c2fc59007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:24.692643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf2ad5-c34f-4d90-abe4-172c2fc59007 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:24.692925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf2ad5-c34f-4d90-abe4-172c2fc59007 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:24.693201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf2ad5-c34f-4d90-abe4-172c2fc59007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:24.710873 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f7ed9-a13e-45a2-a262-ef1d470ad7b7 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:24.761884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e81b6-eda8-46e2-a310-1a5ac470a5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:24.762699 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e81b6-eda8-46e2-a310-1a5ac470a5ad None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:24.762978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e81b6-eda8-46e2-a310-1a5ac470a5ad None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:24.763253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e81b6-eda8-46e2-a310-1a5ac470a5ad None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:24.774524 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e81b6-eda8-46e2-a310-1a5ac470a5ad None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:24.775428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:24.777315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e81b6-eda8-46e2-a310-1a5ac470a5ad None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:24.784434 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf2ad5-c34f-4d90-abe4-172c2fc59007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:24.785955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf2ad5-c34f-4d90-abe4-172c2fc59007 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-af7e81b6-eda8-46e2-a310-1a5ac470a5ad None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:24.796064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:24.799003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:24.799917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:24.799917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:24.799917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:24.799917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:24.799917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:24.799917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:24.799917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:24.799917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:24.799917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 31 20:39:24.799917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:24.801842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 270/524] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:24.802942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e81b6-eda8-46e2-a310-1a5ac470a5ad None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:24.846582 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:24.907667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 255/525] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:24.908776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf2ad5-c34f-4d90-abe4-172c2fc59007 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:24.923681 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e81b6-eda8-46e2-a310-1a5ac470a5ad None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:24.973975 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fb7df-376e-43df-9f38-2deb41e54fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:24.975167 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fb7df-376e-43df-9f38-2deb41e54fa9 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:24.975599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fb7df-376e-43df-9f38-2deb41e54fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:24.976436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fb7df-376e-43df-9f38-2deb41e54fa9 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:24.977613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fb7df-376e-43df-9f38-2deb41e54fa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:24.978088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fb7df-376e-43df-9f38-2deb41e54fa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:24.981189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fb7df-376e-43df-9f38-2deb41e54fa9 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:24.998136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 271/526] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:24.999228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fb7df-376e-43df-9f38-2deb41e54fa9 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:25.015850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:25.028247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf2ad5-c34f-4d90-abe4-172c2fc59007 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:25.066782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583f308-9849-48ba-900a-a43d080c881d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:25.067475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583f308-9849-48ba-900a-a43d080c881d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:25.067753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583f308-9849-48ba-900a-a43d080c881d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:25.068025 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583f308-9849-48ba-900a-a43d080c881d None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:25.068896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583f308-9849-48ba-900a-a43d080c881d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:25.069165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583f308-9849-48ba-900a-a43d080c881d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:25.070635 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583f308-9849-48ba-900a-a43d080c881d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:25.090324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 256/527] 10.222.0.39 () {56 vars in 1139 bytes} [Tue May 31 20:39:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:25.090983 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583f308-9849-48ba-900a-a43d080c881d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:25.134264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:25.140586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fb7df-376e-43df-9f38-2deb41e54fa9 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:25.188830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6656263-0915-4c18-bc57-8d90c328e371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:25.190740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656263-0915-4c18-bc57-8d90c328e371 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:25.191229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656263-0915-4c18-bc57-8d90c328e371 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:25.191943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656263-0915-4c18-bc57-8d90c328e371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:25.204863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6656263-0915-4c18-bc57-8d90c328e371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:25.206391 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6656263-0915-4c18-bc57-8d90c328e371 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:25.216515 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583f308-9849-48ba-900a-a43d080c881d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-b6656263-0915-4c18-bc57-8d90c328e371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:25.228400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:25.229323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:25.230184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:25.230184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:25.230184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:25.230184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:25.235391 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 272/528] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:25.236268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6656263-0915-4c18-bc57-8d90c328e371 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:25.259056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a17f4-8b1d-41c8-9836-3add123d4977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:25.261372 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a17f4-8b1d-41c8-9836-3add123d4977 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:25.262141 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a17f4-8b1d-41c8-9836-3add123d4977 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:25.262616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a17f4-8b1d-41c8-9836-3add123d4977 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:25.273518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a17f4-8b1d-41c8-9836-3add123d4977 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:25.276456 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a17f4-8b1d-41c8-9836-3add123d4977 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-cc4a17f4-8b1d-41c8-9836-3add123d4977 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:25.296326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:25.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:25.298815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:25.298815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:25.298815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:25.298815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:25.298815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:25.298815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:25.298815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:25.298815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:25.300197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 257/529] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:25.305858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a17f4-8b1d-41c8-9836-3add123d4977 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:25.322973 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:25.366433 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6656263-0915-4c18-bc57-8d90c328e371 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:25.406854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404958cd-74fb-4469-b9c8-749982c2794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:25.407784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404958cd-74fb-4469-b9c8-749982c2794c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:25.407784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404958cd-74fb-4469-b9c8-749982c2794c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:25.408066 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404958cd-74fb-4469-b9c8-749982c2794c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:25.429206 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:25.444746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a17f4-8b1d-41c8-9836-3add123d4977 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:25.487251 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404958cd-74fb-4469-b9c8-749982c2794c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:25.488808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404958cd-74fb-4469-b9c8-749982c2794c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:25.494206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e29d0-f6c9-4870-9e4f-4fffcc38e1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:25.495801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e29d0-f6c9-4870-9e4f-4fffcc38e1c5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:25.496295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e29d0-f6c9-4870-9e4f-4fffcc38e1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:25.496760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e29d0-f6c9-4870-9e4f-4fffcc38e1c5 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:25.498297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e29d0-f6c9-4870-9e4f-4fffcc38e1c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:25.498825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e29d0-f6c9-4870-9e4f-4fffcc38e1c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:25.500916 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e29d0-f6c9-4870-9e4f-4fffcc38e1c5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:25.519354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 258/530] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:25.520276 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e29d0-f6c9-4870-9e4f-4fffcc38e1c5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:25.601793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:25.629591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e29d0-f6c9-4870-9e4f-4fffcc38e1c5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:25.631861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 273/531] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:25.633425 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404958cd-74fb-4469-b9c8-749982c2794c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:25.670979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255e5e0-c2fb-4b19-94ea-15ff6ea80ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:25.671672 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255e5e0-c2fb-4b19-94ea-15ff6ea80ed0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:25.671955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255e5e0-c2fb-4b19-94ea-15ff6ea80ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:25.672235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255e5e0-c2fb-4b19-94ea-15ff6ea80ed0 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:25.673026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255e5e0-c2fb-4b19-94ea-15ff6ea80ed0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:25.673336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255e5e0-c2fb-4b19-94ea-15ff6ea80ed0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:25.674844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255e5e0-c2fb-4b19-94ea-15ff6ea80ed0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:25.695060 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 259/532] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:25.695906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255e5e0-c2fb-4b19-94ea-15ff6ea80ed0 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:25.702148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:25.776473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404958cd-74fb-4469-b9c8-749982c2794c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:25.815616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255e5e0-c2fb-4b19-94ea-15ff6ea80ed0 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:25.824832 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fab18-1adc-47ab-8493-b8b8c3998d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:25.826457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fab18-1adc-47ab-8493-b8b8c3998d78 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:25.826968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fab18-1adc-47ab-8493-b8b8c3998d78 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:25.827468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fab18-1adc-47ab-8493-b8b8c3998d78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:25.837253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fab18-1adc-47ab-8493-b8b8c3998d78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:25.840669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fab18-1adc-47ab-8493-b8b8c3998d78 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:25.854418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70baf367-ed8f-4ca5-95f9-a6083c7e7d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:25.855331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baf367-ed8f-4ca5-95f9-a6083c7e7d88 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:25.855683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baf367-ed8f-4ca5-95f9-a6083c7e7d88 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:25.856026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baf367-ed8f-4ca5-95f9-a6083c7e7d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:25.858355 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-2b4fab18-1adc-47ab-8493-b8b8c3998d78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:25.862243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:25.863133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:25.863967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:25.863967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:25.863967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:25.863967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:25.863967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:25.863967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:25.863967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:25.863967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:25.866945 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 274/533] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:25.870283 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fab18-1adc-47ab-8493-b8b8c3998d78 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:25.873410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70baf367-ed8f-4ca5-95f9-a6083c7e7d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:25.874953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70baf367-ed8f-4ca5-95f9-a6083c7e7d88 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-70baf367-ed8f-4ca5-95f9-a6083c7e7d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:25.894452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:25.895625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:25.896652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:25.896652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:25.896652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:25.896652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:25.898812 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 260/534] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:25.900080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70baf367-ed8f-4ca5-95f9-a6083c7e7d88 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:26.012744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fab18-1adc-47ab-8493-b8b8c3998d78 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:26.013153 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70baf367-ed8f-4ca5-95f9-a6083c7e7d88 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:26.024185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:26.050358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc51ca-27d5-40b5-915b-fa1a49251aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:26.050604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798937d-bbca-40a9-a37f-70b43512b66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:26.051295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc51ca-27d5-40b5-915b-fa1a49251aa2 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:26.051549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798937d-bbca-40a9-a37f-70b43512b66d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:26.051809 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc51ca-27d5-40b5-915b-fa1a49251aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:26.052131 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798937d-bbca-40a9-a37f-70b43512b66d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:26.052237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc51ca-27d5-40b5-915b-fa1a49251aa2 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:26.052633 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798937d-bbca-40a9-a37f-70b43512b66d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:26.053205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc51ca-27d5-40b5-915b-fa1a49251aa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:26.053653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc51ca-27d5-40b5-915b-fa1a49251aa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:26.053921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798937d-bbca-40a9-a37f-70b43512b66d None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=01a22cd803304a19a58bfbe17addb11f) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:26.054369 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798937d-bbca-40a9-a37f-70b43512b66d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:26.055386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc51ca-27d5-40b5-915b-fa1a49251aa2 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:26.056189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798937d-bbca-40a9-a37f-70b43512b66d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:26.062580 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 275/535] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:25 2022] GET /identity/v3/role_assignments?user.id=01a22cd803304a19a58bfbe17addb11f&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:26.063584 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798937d-bbca-40a9-a37f-70b43512b66d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:26.081894 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 261/536] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:26.085612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc51ca-27d5-40b5-915b-fa1a49251aa2 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:26.162658 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:26.185010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798937d-bbca-40a9-a37f-70b43512b66d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:26.229569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef2896-9c7a-4328-85e2-5c070c5af9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:26.230646 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef2896-9c7a-4328-85e2-5c070c5af9b7 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:26.231078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef2896-9c7a-4328-85e2-5c070c5af9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:26.231498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef2896-9c7a-4328-85e2-5c070c5af9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:26.232377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef2896-9c7a-4328-85e2-5c070c5af9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:26.232942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef2896-9c7a-4328-85e2-5c070c5af9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:26.234680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef2896-9c7a-4328-85e2-5c070c5af9b7 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:26.240978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc51ca-27d5-40b5-915b-fa1a49251aa2 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:26.251273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 276/537] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:26.253016 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b750d-f678-4979-9fd6-af5b9026ff57 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:26.253506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b750d-f678-4979-9fd6-af5b9026ff57 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:26.253950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b750d-f678-4979-9fd6-af5b9026ff57 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:26.255812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 277/538] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:26.256736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b750d-f678-4979-9fd6-af5b9026ff57 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:26.298929 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac89eaf-bdb3-4415-abc9-198f888c2a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:26.299503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac89eaf-bdb3-4415-abc9-198f888c2a69 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:26.299781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac89eaf-bdb3-4415-abc9-198f888c2a69 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:26.306418 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:26.310627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac89eaf-bdb3-4415-abc9-198f888c2a69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:26.311062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac89eaf-bdb3-4415-abc9-198f888c2a69 None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=7cfcecd035214e2181622eb6b30ddf62) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:26.311382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac89eaf-bdb3-4415-abc9-198f888c2a69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:26.312855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac89eaf-bdb3-4415-abc9-198f888c2a69 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:26.322890 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 262/539] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:26 2022] GET /identity/v3/role_assignments?user.id=7cfcecd035214e2181622eb6b30ddf62&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:26.324547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1908bb-720f-405e-9ad3-3bb408d2727a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:26.324838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1908bb-720f-405e-9ad3-3bb408d2727a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:26.325114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1908bb-720f-405e-9ad3-3bb408d2727a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:26.349596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-cc1908bb-720f-405e-9ad3-3bb408d2727a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:26.350836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cc1908bb-720f-405e-9ad3-3bb408d2727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:26.397998 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b750d-f678-4979-9fd6-af5b9026ff57 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:26.444423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 263/540] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:26.448364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400c309-0cec-45ef-a649-d86f2f83019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:26.449512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400c309-0cec-45ef-a649-d86f2f83019b None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:26.449866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400c309-0cec-45ef-a649-d86f2f83019b None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:26.450139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400c309-0cec-45ef-a649-d86f2f83019b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:26.458526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400c309-0cec-45ef-a649-d86f2f83019b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:26.460016 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400c309-0cec-45ef-a649-d86f2f83019b None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-9400c309-0cec-45ef-a649-d86f2f83019b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:26.475608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:26.476517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:26.477371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:26.477371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:26.477371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:26.477371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:26.477371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:26.477371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:26.477371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:26.477371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:26.477371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 278/541] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:26.480715 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1908bb-720f-405e-9ad3-3bb408d2727a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:26.489805 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400c309-0cec-45ef-a649-d86f2f83019b None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:26.547342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:26.655150 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1908bb-720f-405e-9ad3-3bb408d2727a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:26.682538 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:26.696398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400c309-0cec-45ef-a649-d86f2f83019b None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:26.715169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff10bb3-11e4-458f-b39c-6360e5e1e04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:26.715997 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff10bb3-11e4-458f-b39c-6360e5e1e04d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:26.716282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff10bb3-11e4-458f-b39c-6360e5e1e04d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:26.716557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff10bb3-11e4-458f-b39c-6360e5e1e04d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:26.735156 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29c03d-7a53-481c-bfd5-4aafb2b73c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:26.735820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29c03d-7a53-481c-bfd5-4aafb2b73c7d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:26.736103 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29c03d-7a53-481c-bfd5-4aafb2b73c7d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:26.736382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29c03d-7a53-481c-bfd5-4aafb2b73c7d None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:26.736731 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff10bb3-11e4-458f-b39c-6360e5e1e04d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:26.737465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29c03d-7a53-481c-bfd5-4aafb2b73c7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:26.737784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29c03d-7a53-481c-bfd5-4aafb2b73c7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:26.739229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29c03d-7a53-481c-bfd5-4aafb2b73c7d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-0ff10bb3-11e4-458f-b39c-6360e5e1e04d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:26.745327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:26.746294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:26.747097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:26.747097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:26.747097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:26.747097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:26.747097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:26.747097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:26.747097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:26.747097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:26.747097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:26.747097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:26.747097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:26.747097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:26.752075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 264/542] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:26.759646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff10bb3-11e4-458f-b39c-6360e5e1e04d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:26.760705 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 279/543] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:26.764998 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29c03d-7a53-481c-bfd5-4aafb2b73c7d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:26.916142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29c03d-7a53-481c-bfd5-4aafb2b73c7d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:26.953144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9351a5f-dc0b-4a2f-82c7-0adcd03df52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:26.953840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9351a5f-dc0b-4a2f-82c7-0adcd03df52d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:26.954142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9351a5f-dc0b-4a2f-82c7-0adcd03df52d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:26.954421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9351a5f-dc0b-4a2f-82c7-0adcd03df52d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:26.955253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9351a5f-dc0b-4a2f-82c7-0adcd03df52d None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=16a77c08d2844e7cb81ac1370c527cdf) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:26.955568 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9351a5f-dc0b-4a2f-82c7-0adcd03df52d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:26.957017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9351a5f-dc0b-4a2f-82c7-0adcd03df52d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:26.963954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 280/544] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:26 2022] GET /identity/v3/role_assignments?user.id=16a77c08d2844e7cb81ac1370c527cdf&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:26.965208 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff10bb3-11e4-458f-b39c-6360e5e1e04d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:26.973781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:27.007686 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99aba94-7475-4219-af5b-e60d23d2d84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:27.008361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aba94-7475-4219-af5b-e60d23d2d84f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:27.008640 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aba94-7475-4219-af5b-e60d23d2d84f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:27.008910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aba94-7475-4219-af5b-e60d23d2d84f None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:27.009725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99aba94-7475-4219-af5b-e60d23d2d84f None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:27.010568 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99aba94-7475-4219-af5b-e60d23d2d84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:27.011949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99aba94-7475-4219-af5b-e60d23d2d84f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:27.021334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 265/545] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:27.027691 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9351a5f-dc0b-4a2f-82c7-0adcd03df52d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:27.073829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:27.132261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957e6e1-f56a-41bf-95a4-6bc4d828c0c6 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:27.132578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957e6e1-f56a-41bf-95a4-6bc4d828c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:27.132816 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957e6e1-f56a-41bf-95a4-6bc4d828c0c6 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:27.134663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 266/546] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:27.142162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a57c-9b0d-47a3-9e65-206d6b4f3fec None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:27.142481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a57c-9b0d-47a3-9e65-206d6b4f3fec None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:27.142722 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a57c-9b0d-47a3-9e65-206d6b4f3fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:27.158169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9351a5f-dc0b-4a2f-82c7-0adcd03df52d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:27.178607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7193a57c-9b0d-47a3-9e65-206d6b4f3fec None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:27.179737 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7193a57c-9b0d-47a3-9e65-206d6b4f3fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:27.194713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4175069-32a7-4b34-8c11-c9df77c99dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:27.195526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4175069-32a7-4b34-8c11-c9df77c99dcf None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:27.195814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4175069-32a7-4b34-8c11-c9df77c99dcf None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:27.196096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4175069-32a7-4b34-8c11-c9df77c99dcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:27.207686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4175069-32a7-4b34-8c11-c9df77c99dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:27.209154 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4175069-32a7-4b34-8c11-c9df77c99dcf None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-d4175069-32a7-4b34-8c11-c9df77c99dcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:27.229478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:27.230404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:27.232364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:27.232364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:27.232364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:27.232364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:27.232364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 281/547] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:27.236802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4175069-32a7-4b34-8c11-c9df77c99dcf None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:27.319192 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 267/548] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:27.319856 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:27.342521 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a57c-9b0d-47a3-9e65-206d6b4f3fec None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:27.348739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4175069-32a7-4b34-8c11-c9df77c99dcf None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:27.387489 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bc1a2-c7ec-4b8a-ad00-e0766e01e720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:27.388182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bc1a2-c7ec-4b8a-ad00-e0766e01e720 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:27.388465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bc1a2-c7ec-4b8a-ad00-e0766e01e720 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:27.388745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bc1a2-c7ec-4b8a-ad00-e0766e01e720 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:27.389527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bc1a2-c7ec-4b8a-ad00-e0766e01e720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:27.389838 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bc1a2-c7ec-4b8a-ad00-e0766e01e720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:27.391357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bc1a2-c7ec-4b8a-ad00-e0766e01e720 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:27.404462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 282/549] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:27.409853 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bc1a2-c7ec-4b8a-ad00-e0766e01e720 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:27.489418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a57c-9b0d-47a3-9e65-206d6b4f3fec None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:27.491179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:27.516861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bc1a2-c7ec-4b8a-ad00-e0766e01e720 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:27.528666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17141614-9db4-45bf-8f9a-dfe7b2a0d447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:27.529491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141614-9db4-45bf-8f9a-dfe7b2a0d447 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:27.529772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141614-9db4-45bf-8f9a-dfe7b2a0d447 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:27.530043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141614-9db4-45bf-8f9a-dfe7b2a0d447 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:27.542514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17141614-9db4-45bf-8f9a-dfe7b2a0d447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:27.547483 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-17141614-9db4-45bf-8f9a-dfe7b2a0d447 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:27.551981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:27.552910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:27.554866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:27.554866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:27.554866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:27.554866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:27.554866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:27.554866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:27.554866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:27.554866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:27.554866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:27.554866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:27.554866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:27.554866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:27.554866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 268/550] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:27.562152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99754f3-2458-4959-a3f9-140da3b1bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:27.564079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99754f3-2458-4959-a3f9-140da3b1bd1f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:27.564079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99754f3-2458-4959-a3f9-140da3b1bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:27.564079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99754f3-2458-4959-a3f9-140da3b1bd1f None admin] PATH_INFO: `/v3/users/swift` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:27.564946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17141614-9db4-45bf-8f9a-dfe7b2a0d447 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:27.584738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99754f3-2458-4959-a3f9-140da3b1bd1f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:27.586230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99754f3-2458-4959-a3f9-140da3b1bd1f None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-a99754f3-2458-4959-a3f9-140da3b1bd1f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:27.607497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:27.609720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:27.611989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:27.611989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:27.611989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:27.611989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:27.611989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:27.611989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:27.611989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:27.611989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:27.611989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 20:39:27.611989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:27.611989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 283/551] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:27.617951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99754f3-2458-4959-a3f9-140da3b1bd1f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:27.734902 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17141614-9db4-45bf-8f9a-dfe7b2a0d447 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:27.772470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d751e79-decf-4a10-bc74-db1ea302fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:27.773054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d751e79-decf-4a10-bc74-db1ea302fe81 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:27.773332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d751e79-decf-4a10-bc74-db1ea302fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:27.773650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d751e79-decf-4a10-bc74-db1ea302fe81 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:27.774401 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d751e79-decf-4a10-bc74-db1ea302fe81 None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:27.774705 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d751e79-decf-4a10-bc74-db1ea302fe81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:27.776655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d751e79-decf-4a10-bc74-db1ea302fe81 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:27.786055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 269/552] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:27.792173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d751e79-decf-4a10-bc74-db1ea302fe81 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:27.809177 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:27.834641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99754f3-2458-4959-a3f9-140da3b1bd1f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:27.879781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f91c93-52d9-4d08-ae0c-37428cb352d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:27.880462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f91c93-52d9-4d08-ae0c-37428cb352d0 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:27.880746 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f91c93-52d9-4d08-ae0c-37428cb352d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:27.881024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f91c93-52d9-4d08-ae0c-37428cb352d0 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:27.881897 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f91c93-52d9-4d08-ae0c-37428cb352d0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:27.882211 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f91c93-52d9-4d08-ae0c-37428cb352d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:27.884042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f91c93-52d9-4d08-ae0c-37428cb352d0 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:27.899651 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d751e79-decf-4a10-bc74-db1ea302fe81 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:27.903361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 284/553] 10.222.0.39 () {56 vars in 1135 bytes} [Tue May 31 20:39:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:27.908786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f91c93-52d9-4d08-ae0c-37428cb352d0 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:27.939213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cced7-5702-43e0-9acc-a4d357d95838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:27.940073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cced7-5702-43e0-9acc-a4d357d95838 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:27.940354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cced7-5702-43e0-9acc-a4d357d95838 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:27.940626 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cced7-5702-43e0-9acc-a4d357d95838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:27.953511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cced7-5702-43e0-9acc-a4d357d95838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:27.955078 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cced7-5702-43e0-9acc-a4d357d95838 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:27.969559 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e58cced7-5702-43e0-9acc-a4d357d95838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:27.975224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:27.976157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:27.981667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:27.981667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:27.981667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:27.981667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:27.981667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 270/554] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:27.982474 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cced7-5702-43e0-9acc-a4d357d95838 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:28.024214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f91c93-52d9-4d08-ae0c-37428cb352d0 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:28.054000 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:28.061389 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87ea87-499a-452c-9f7e-bd50335cebf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:28.062053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87ea87-499a-452c-9f7e-bd50335cebf0 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:28.062338 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87ea87-499a-452c-9f7e-bd50335cebf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:28.062615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87ea87-499a-452c-9f7e-bd50335cebf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:28.091952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cced7-5702-43e0-9acc-a4d357d95838 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:28.129123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935446a-d0a3-4408-ab72-a287eabfbbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:28.129811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935446a-d0a3-4408-ab72-a287eabfbbb0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:28.130216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935446a-d0a3-4408-ab72-a287eabfbbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:28.130495 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935446a-d0a3-4408-ab72-a287eabfbbb0 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:28.131276 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935446a-d0a3-4408-ab72-a287eabfbbb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:28.131585 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935446a-d0a3-4408-ab72-a287eabfbbb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:28.133184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935446a-d0a3-4408-ab72-a287eabfbbb0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:28.135865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87ea87-499a-452c-9f7e-bd50335cebf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:28.141887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87ea87-499a-452c-9f7e-bd50335cebf0 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:28.148978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 271/555] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:28.154504 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935446a-d0a3-4408-ab72-a287eabfbbb0 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:28.189033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:28.243266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 285/556] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:28.249341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87ea87-499a-452c-9f7e-bd50335cebf0 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:28.270469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935446a-d0a3-4408-ab72-a287eabfbbb0 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:28.300050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:28.310564 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d13aa-13e0-4a03-8693-3c1955d680d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:28.311502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d13aa-13e0-4a03-8693-3c1955d680d4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:28.311787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d13aa-13e0-4a03-8693-3c1955d680d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:28.312295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d13aa-13e0-4a03-8693-3c1955d680d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:28.320569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d13aa-13e0-4a03-8693-3c1955d680d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:28.322092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d13aa-13e0-4a03-8693-3c1955d680d4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-973d13aa-13e0-4a03-8693-3c1955d680d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:28.339229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:28.342100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:28.344331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:28.344331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:28.344331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:28.344331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:28.344331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:28.344331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:28.344331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:28.344331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:28.344331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:39:28.344331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:28.344331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 272/557] 10.222.0.39 () {56 vars in 1093 bytes} [Tue May 31 20:39:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:28.348611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d13aa-13e0-4a03-8693-3c1955d680d4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:28.363641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87ea87-499a-452c-9f7e-bd50335cebf0 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:28.438114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f66a85-4b84-4e93-84d3-79b7ddb1c20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:28.438930 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f66a85-4b84-4e93-84d3-79b7ddb1c20f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:28.439214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f66a85-4b84-4e93-84d3-79b7ddb1c20f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:28.439489 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f66a85-4b84-4e93-84d3-79b7ddb1c20f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:28.456711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f66a85-4b84-4e93-84d3-79b7ddb1c20f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:28.458084 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d13aa-13e0-4a03-8693-3c1955d680d4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:28.458287 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f66a85-4b84-4e93-84d3-79b7ddb1c20f None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:28.472430 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-40f66a85-4b84-4e93-84d3-79b7ddb1c20f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:28.491505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:28.493736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:28.496777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:28.496777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:28.496777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:28.496777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:28.496777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 286/558] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:28.505516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd323dd-3020-42f0-a204-ab4690c2603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:28.505516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd323dd-3020-42f0-a204-ab4690c2603f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:28.505516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd323dd-3020-42f0-a204-ab4690c2603f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:28.506510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f66a85-4b84-4e93-84d3-79b7ddb1c20f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:28.506670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd323dd-3020-42f0-a204-ab4690c2603f None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:28.506670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd323dd-3020-42f0-a204-ab4690c2603f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:28.506670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd323dd-3020-42f0-a204-ab4690c2603f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:28.506670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd323dd-3020-42f0-a204-ab4690c2603f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:28.539721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 273/559] 10.222.0.39 () {56 vars in 1133 bytes} [Tue May 31 20:39:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:28.555009 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd323dd-3020-42f0-a204-ab4690c2603f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:28.620319 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f66a85-4b84-4e93-84d3-79b7ddb1c20f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:28.646098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:28.702514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd323dd-3020-42f0-a204-ab4690c2603f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:28.718347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f396088-0ac6-4aa1-9c65-83b708a56852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:28.719053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f396088-0ac6-4aa1-9c65-83b708a56852 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:28.719329 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f396088-0ac6-4aa1-9c65-83b708a56852 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:28.719628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f396088-0ac6-4aa1-9c65-83b708a56852 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:28.720348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f396088-0ac6-4aa1-9c65-83b708a56852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:28.720650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f396088-0ac6-4aa1-9c65-83b708a56852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:28.722073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f396088-0ac6-4aa1-9c65-83b708a56852 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:28.741688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31856e3c-3114-4609-bb1d-28b1e8a9789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:28.743602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31856e3c-3114-4609-bb1d-28b1e8a9789d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:28.744570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31856e3c-3114-4609-bb1d-28b1e8a9789d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:28.744981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31856e3c-3114-4609-bb1d-28b1e8a9789d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:28.756627 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 287/560] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:28.759100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31856e3c-3114-4609-bb1d-28b1e8a9789d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:28.761332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31856e3c-3114-4609-bb1d-28b1e8a9789d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:28.762433 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f396088-0ac6-4aa1-9c65-83b708a56852 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-31856e3c-3114-4609-bb1d-28b1e8a9789d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:28.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:28.792118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:28.793042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:28.793042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:28.793042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:28.793042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:28.795002 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 274/561] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:28.812609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31856e3c-3114-4609-bb1d-28b1e8a9789d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:28.941689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:29.037011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f396088-0ac6-4aa1-9c65-83b708a56852 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:29.068643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:29.079597 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31856e3c-3114-4609-bb1d-28b1e8a9789d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:29.121334 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17b3ce-1229-4104-8166-0c9b2f467e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:29.122452 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17b3ce-1229-4104-8166-0c9b2f467e67 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:29.126144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17b3ce-1229-4104-8166-0c9b2f467e67 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:29.126587 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17b3ce-1229-4104-8166-0c9b2f467e67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:29.140374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17b3ce-1229-4104-8166-0c9b2f467e67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:29.145467 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17b3ce-1229-4104-8166-0c9b2f467e67 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:29.159269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ff6a3-a9d5-42f2-ab3c-405175d482fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:29.160249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ff6a3-a9d5-42f2-ab3c-405175d482fa None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:29.160680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ff6a3-a9d5-42f2-ab3c-405175d482fa None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:29.161116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ff6a3-a9d5-42f2-ab3c-405175d482fa None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:29.162023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ff6a3-a9d5-42f2-ab3c-405175d482fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:29.162972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ff6a3-a9d5-42f2-ab3c-405175d482fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:29.164386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ff6a3-a9d5-42f2-ab3c-405175d482fa None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-1e17b3ce-1229-4104-8166-0c9b2f467e67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:29.171324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:29.172428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:29.173530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:29.173530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:29.173530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:29.173530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:29.173530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:29.173530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:29.173530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:29.173530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:29.175152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 288/562] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:29.180674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37785277-bf63-47df-aa24-b8eec5e09a29 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:29.180674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37785277-bf63-47df-aa24-b8eec5e09a29 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:29.180674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37785277-bf63-47df-aa24-b8eec5e09a29 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:29.181978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 289/563] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:29.182973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37785277-bf63-47df-aa24-b8eec5e09a29 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:29.195939 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 275/564] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:29.202368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a901f1e-ce9e-4407-98ca-846b05ec0a7a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:29.202650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a901f1e-ce9e-4407-98ca-846b05ec0a7a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:29.202924 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a901f1e-ce9e-4407-98ca-846b05ec0a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:29.255818 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7a901f1e-ce9e-4407-98ca-846b05ec0a7a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:29.260160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7a901f1e-ce9e-4407-98ca-846b05ec0a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:29.305829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37785277-bf63-47df-aa24-b8eec5e09a29 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:29.333873 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:29.356038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b69a8d-6310-41b6-9ab2-fad8cdf67ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:29.357056 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69a8d-6310-41b6-9ab2-fad8cdf67ab1 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:29.358019 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69a8d-6310-41b6-9ab2-fad8cdf67ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:29.358510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69a8d-6310-41b6-9ab2-fad8cdf67ab1 None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:29.359761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b69a8d-6310-41b6-9ab2-fad8cdf67ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:29.360479 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b69a8d-6310-41b6-9ab2-fad8cdf67ab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:29.362776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b69a8d-6310-41b6-9ab2-fad8cdf67ab1 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:29.377410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 276/565] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:29.377410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a901f1e-ce9e-4407-98ca-846b05ec0a7a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:29.377699 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 290/566] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:29.381420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cccb44-c740-464c-955c-99dc8128fae2 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:29.381420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cccb44-c740-464c-955c-99dc8128fae2 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:29.381420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cccb44-c740-464c-955c-99dc8128fae2 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:29.384735 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 291/567] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:29.385628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cccb44-c740-464c-955c-99dc8128fae2 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:29.475532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:29.491569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a901f1e-ce9e-4407-98ca-846b05ec0a7a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:29.503081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cccb44-c740-464c-955c-99dc8128fae2 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:29.531909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d2e1b-a351-44e4-841c-01b9aa0a25c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:29.532801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d2e1b-a351-44e4-841c-01b9aa0a25c2 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:29.533087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d2e1b-a351-44e4-841c-01b9aa0a25c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:29.533481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d2e1b-a351-44e4-841c-01b9aa0a25c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:29.540319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d2e1b-a351-44e4-841c-01b9aa0a25c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:29.540465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e766b-54af-4358-96d1-dd08bb78faca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:29.541645 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e766b-54af-4358-96d1-dd08bb78faca None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:29.541923 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e766b-54af-4358-96d1-dd08bb78faca None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:29.542194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e766b-54af-4358-96d1-dd08bb78faca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:29.542403 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d2e1b-a351-44e4-841c-01b9aa0a25c2 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:29.543010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e766b-54af-4358-96d1-dd08bb78faca None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=90867ac821dd4adb8d52075fbd85caba) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:29.543314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e766b-54af-4358-96d1-dd08bb78faca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:29.544731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e766b-54af-4358-96d1-dd08bb78faca None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:29.559548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 292/568] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:29 2022] GET /identity/v3/role_assignments?user.id=90867ac821dd4adb8d52075fbd85caba&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:29.559548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf837c-788b-4693-9562-f75733a8c7fc None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:29.559548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf837c-788b-4693-9562-f75733a8c7fc None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:29.559548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf837c-788b-4693-9562-f75733a8c7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-c70d2e1b-a351-44e4-841c-01b9aa0a25c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:29.559972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:29.560758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:29.561681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:29.561681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:29.561681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:29.561681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:29.561681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:29.561681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:29.561681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:29.561681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:29.561681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 277/569] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:29.561681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d2e1b-a351-44e4-841c-01b9aa0a25c2 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:29.580286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-23cf837c-788b-4693-9562-f75733a8c7fc None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:29.581649 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-23cf837c-788b-4693-9562-f75733a8c7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:29.631845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:29.663149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 293/570] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:29.664131 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf837c-788b-4693-9562-f75733a8c7fc None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:29.717286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d2e1b-a351-44e4-841c-01b9aa0a25c2 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:29.758533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b687b8f-9366-41c9-82ca-28aa44df0e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:29.760311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b687b8f-9366-41c9-82ca-28aa44df0e11 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:29.760799 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b687b8f-9366-41c9-82ca-28aa44df0e11 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:29.761284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b687b8f-9366-41c9-82ca-28aa44df0e11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:29.774938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b687b8f-9366-41c9-82ca-28aa44df0e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-2b687b8f-9366-41c9-82ca-28aa44df0e11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:29.784402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:29.785486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:29.786352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:29.786352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:29.786352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:29.786352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:29.786352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:29.786352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:29.786352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:29.786352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:29.786352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:29.786352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:29.786352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:29.786352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:29.787015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf837c-788b-4693-9562-f75733a8c7fc None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:29.789310 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 278/571] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:29.790484 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b687b8f-9366-41c9-82ca-28aa44df0e11 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:29.801595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:29.822948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c91ed-f2d3-4c0a-a60c-42000bc4e5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:29.823621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c91ed-f2d3-4c0a-a60c-42000bc4e5d9 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:29.824153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c91ed-f2d3-4c0a-a60c-42000bc4e5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:29.824425 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c91ed-f2d3-4c0a-a60c-42000bc4e5d9 None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:29.825203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c91ed-f2d3-4c0a-a60c-42000bc4e5d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:29.825545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c91ed-f2d3-4c0a-a60c-42000bc4e5d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:29.827085 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c91ed-f2d3-4c0a-a60c-42000bc4e5d9 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:29.841001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 294/572] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:29.841942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c91ed-f2d3-4c0a-a60c-42000bc4e5d9 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:29.881044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:29.913221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b687b8f-9366-41c9-82ca-28aa44df0e11 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:29.948665 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c91ed-f2d3-4c0a-a60c-42000bc4e5d9 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:29.950299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb99041-3104-401b-88a5-dc86a3e369cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:29.951094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb99041-3104-401b-88a5-dc86a3e369cb None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:29.951382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb99041-3104-401b-88a5-dc86a3e369cb None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:29.951656 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb99041-3104-401b-88a5-dc86a3e369cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:29.973370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb99041-3104-401b-88a5-dc86a3e369cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-8bb99041-3104-401b-88a5-dc86a3e369cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:29.981249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:29.982563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:29.983596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:29.983596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:29.983596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:29.983596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:29.983596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:29.983596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:29.983596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:29.983596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:29.983596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:29.983596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:29.983596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:29.983596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:29.983596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 279/573] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:29.984450 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a7b57-f0d2-4b0f-909c-671d9367eac8 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:29.984450 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a7b57-f0d2-4b0f-909c-671d9367eac8 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:29.984450 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a7b57-f0d2-4b0f-909c-671d9367eac8 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:29.989520 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 280/574] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:29.989520 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a7b57-f0d2-4b0f-909c-671d9367eac8 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:30.007189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fa316-9fc1-432a-8c80-11c735040b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:30.007860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fa316-9fc1-432a-8c80-11c735040b4d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:30.008143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fa316-9fc1-432a-8c80-11c735040b4d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:30.008418 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fa316-9fc1-432a-8c80-11c735040b4d None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:30.009165 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fa316-9fc1-432a-8c80-11c735040b4d None admin] RBAC: Adding query filter params (name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:30.010063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fa316-9fc1-432a-8c80-11c735040b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:30.011448 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fa316-9fc1-432a-8c80-11c735040b4d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:30.025575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 295/575] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:30.026910 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb286a-a12d-4772-aaa4-da580a290e1a None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:30.027196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb286a-a12d-4772-aaa4-da580a290e1a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:30.027469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb286a-a12d-4772-aaa4-da580a290e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:30.045201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-88fb286a-a12d-4772-aaa4-da580a290e1a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:30.046445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-88fb286a-a12d-4772-aaa4-da580a290e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:30.068515 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:30.106363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a7b57-f0d2-4b0f-909c-671d9367eac8 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:30.121233 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 296/576] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:30.122407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb286a-a12d-4772-aaa4-da580a290e1a None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:30.151109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14c51e-5bcb-4014-bdac-fe25e5272ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:30.152002 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14c51e-5bcb-4014-bdac-fe25e5272ceb None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:30.152284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14c51e-5bcb-4014-bdac-fe25e5272ceb None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:30.152587 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14c51e-5bcb-4014-bdac-fe25e5272ceb None admin] PATH_INFO: `/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/8c86c12743bd4ee8843dba4a7af5d7a0/roles/1d87f67726f0470f81f36098070998b8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:30.167677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:30.168364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14c51e-5bcb-4014-bdac-fe25e5272ceb None admin] RBAC: Authorizing `identity:create_grant(project_id=69d14229f6554a34bf9084d36cffe8ac, user_id=8c86c12743bd4ee8843dba4a7af5d7a0, role_id=1d87f67726f0470f81f36098070998b8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:30.169856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14c51e-5bcb-4014-bdac-fe25e5272ceb None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:30.237422 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 281/577] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:39:29 2022] PUT /identity/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/8c86c12743bd4ee8843dba4a7af5d7a0/roles/1d87f67726f0470f81f36098070998b8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:39:30.237422 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14c51e-5bcb-4014-bdac-fe25e5272ceb None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:30.254069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb286a-a12d-4772-aaa4-da580a290e1a None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:30.301078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26a78-9d60-4540-a69c-215aa0c5b702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:30.302407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26a78-9d60-4540-a69c-215aa0c5b702 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:30.302802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26a78-9d60-4540-a69c-215aa0c5b702 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:30.303178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26a78-9d60-4540-a69c-215aa0c5b702 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:30.304170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d26a78-9d60-4540-a69c-215aa0c5b702 None admin] RBAC: Adding query filter params (name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:30.304601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d26a78-9d60-4540-a69c-215aa0c5b702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:30.309075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d26a78-9d60-4540-a69c-215aa0c5b702 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:30.323071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 297/578] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:30.324410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26a78-9d60-4540-a69c-215aa0c5b702 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:30.365937 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14c51e-5bcb-4014-bdac-fe25e5272ceb None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:30.386900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:30.407538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2ac82-fb88-42d3-9701-360c1afd9df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:30.408657 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2ac82-fb88-42d3-9701-360c1afd9df9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:30.409137 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2ac82-fb88-42d3-9701-360c1afd9df9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:30.409719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2ac82-fb88-42d3-9701-360c1afd9df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:30.423178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2ac82-fb88-42d3-9701-360c1afd9df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:30.424939 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2ac82-fb88-42d3-9701-360c1afd9df9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-a4d2ac82-fb88-42d3-9701-360c1afd9df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:30.447691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:30.449136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:30.450083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:30.450083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:30.450083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:30.450083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:30.451526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:30.452649 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 282/579] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:30.454021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2ac82-fb88-42d3-9701-360c1afd9df9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:30.467323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26a78-9d60-4540-a69c-215aa0c5b702 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:30.508721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a778d-8ce1-4a82-bb71-148eb1859a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:30.509628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a778d-8ce1-4a82-bb71-148eb1859a24 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:30.509911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a778d-8ce1-4a82-bb71-148eb1859a24 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:30.510177 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a778d-8ce1-4a82-bb71-148eb1859a24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:30.524071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a778d-8ce1-4a82-bb71-148eb1859a24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-047a778d-8ce1-4a82-bb71-148eb1859a24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:30.531816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:30.532741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:30.533617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:30.533617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:30.533617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:30.533617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:30.533617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:30.533617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:30.533617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:30.533617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:30.533617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:30.533617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:30.533617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:30.533617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:30.533617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 298/580] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:30.534296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a778d-8ce1-4a82-bb71-148eb1859a24 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:30.581419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2ac82-fb88-42d3-9701-360c1afd9df9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:30.618338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007dce1-9592-471a-aabf-769dae890a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:30.620033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007dce1-9592-471a-aabf-769dae890a39 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:30.620557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007dce1-9592-471a-aabf-769dae890a39 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:30.621005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007dce1-9592-471a-aabf-769dae890a39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:30.632757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007dce1-9592-471a-aabf-769dae890a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:30.635233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007dce1-9592-471a-aabf-769dae890a39 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-b007dce1-9592-471a-aabf-769dae890a39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:30.654604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:30.655518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:30.656478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:30.656478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:30.656478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:30.656478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:30.657543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a778d-8ce1-4a82-bb71-148eb1859a24 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:30.658990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 283/581] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:30.664260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007dce1-9592-471a-aabf-769dae890a39 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:30.688824 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:30.697688 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab726c4b-d18f-4af6-9adf-9f6c6c92229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:30.698353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab726c4b-d18f-4af6-9adf-9f6c6c92229a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:30.708135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab726c4b-d18f-4af6-9adf-9f6c6c92229a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:30.708135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab726c4b-d18f-4af6-9adf-9f6c6c92229a None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:30.708135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab726c4b-d18f-4af6-9adf-9f6c6c92229a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:30.708135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab726c4b-d18f-4af6-9adf-9f6c6c92229a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:30.708135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab726c4b-d18f-4af6-9adf-9f6c6c92229a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:30.717657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 299/582] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:30.718691 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab726c4b-d18f-4af6-9adf-9f6c6c92229a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:30.732993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:30.809164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007dce1-9592-471a-aabf-769dae890a39 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:30.834903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab726c4b-d18f-4af6-9adf-9f6c6c92229a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:30.860641 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ee1d2-8d67-49cc-9548-161f56815747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:30.861884 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ee1d2-8d67-49cc-9548-161f56815747 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:30.862328 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ee1d2-8d67-49cc-9548-161f56815747 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:30.862977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ee1d2-8d67-49cc-9548-161f56815747 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:30.864349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ee1d2-8d67-49cc-9548-161f56815747 None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:30.865057 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ee1d2-8d67-49cc-9548-161f56815747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:30.867296 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ee1d2-8d67-49cc-9548-161f56815747 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:30.881757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 284/583] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:30.881757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ee1d2-8d67-49cc-9548-161f56815747 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:30.882068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d85a4-6e21-4141-956b-d77df06039dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:30.883126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d85a4-6e21-4141-956b-d77df06039dc None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:30.883424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d85a4-6e21-4141-956b-d77df06039dc None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:30.883708 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d85a4-6e21-4141-956b-d77df06039dc None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:30.884448 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d85a4-6e21-4141-956b-d77df06039dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:30.884765 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d85a4-6e21-4141-956b-d77df06039dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:30.886221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d85a4-6e21-4141-956b-d77df06039dc None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:30.899539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 300/584] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:30.905284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d85a4-6e21-4141-956b-d77df06039dc None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:30.979684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:30.981675 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:31.006809 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ee1d2-8d67-49cc-9548-161f56815747 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:31.025692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d85a4-6e21-4141-956b-d77df06039dc None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:31.061920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0802a-18b1-4e5f-9cac-d1a1a568eb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:31.062720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0802a-18b1-4e5f-9cac-d1a1a568eb1e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:31.063002 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0802a-18b1-4e5f-9cac-d1a1a568eb1e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:31.063278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0802a-18b1-4e5f-9cac-d1a1a568eb1e None admin] PATH_INFO: `/v3/users/glance` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:31.064125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dccc1-cc40-488b-b56a-00662791e591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:31.064923 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dccc1-cc40-488b-b56a-00662791e591 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:31.065202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dccc1-cc40-488b-b56a-00662791e591 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:31.065501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dccc1-cc40-488b-b56a-00662791e591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:31.072016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0802a-18b1-4e5f-9cac-d1a1a568eb1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:31.074351 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0802a-18b1-4e5f-9cac-d1a1a568eb1e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:31.077138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dccc1-cc40-488b-b56a-00662791e591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:31.078751 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dccc1-cc40-488b-b56a-00662791e591 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-45b0802a-18b1-4e5f-9cac-d1a1a568eb1e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:31.091764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:31.092730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:31.094299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:31.094299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:31.094299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:31.094299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:31.094299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:31.094299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:31.094299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:31.094299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:31.094299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 31 20:39:31.094299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:31.094299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 285/585] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:31.094299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0802a-18b1-4e5f-9cac-d1a1a568eb1e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-5a6dccc1-cc40-488b-b56a-00662791e591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:31.107602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:31.108891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:31.110517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:31.110517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:31.110517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:31.110517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:31.110517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 301/586] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:31.114459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dccc1-cc40-488b-b56a-00662791e591 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:31.218868 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0802a-18b1-4e5f-9cac-d1a1a568eb1e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:31.239264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dccc1-cc40-488b-b56a-00662791e591 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:31.262692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0505c-a959-494c-9dbd-76e4ab939461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:31.263564 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0505c-a959-494c-9dbd-76e4ab939461 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:31.263848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0505c-a959-494c-9dbd-76e4ab939461 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:31.264118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0505c-a959-494c-9dbd-76e4ab939461 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:31.266030 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:31.272327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0505c-a959-494c-9dbd-76e4ab939461 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:31.273927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0505c-a959-494c-9dbd-76e4ab939461 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:31.283536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1f0f7-058a-41c0-b54c-0d428cf2fe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:31.284473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1f0f7-058a-41c0-b54c-0d428cf2fe2b None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:31.284912 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1f0f7-058a-41c0-b54c-0d428cf2fe2b None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:31.285357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1f0f7-058a-41c0-b54c-0d428cf2fe2b None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:31.286394 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1f0f7-058a-41c0-b54c-0d428cf2fe2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:31.286856 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1f0f7-058a-41c0-b54c-0d428cf2fe2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:31.288441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1f0f7-058a-41c0-b54c-0d428cf2fe2b None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-fff0505c-a959-494c-9dbd-76e4ab939461 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:31.290303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:31.291969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:31.293127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:31.293127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:31.293127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:31.293127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:31.293127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:31.293127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:31.293127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:31.293127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:31.293127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:39:31.293127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:31.299538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 286/587] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:31.300568 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0505c-a959-494c-9dbd-76e4ab939461 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:31.310385 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:31.317463 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 302/588] 10.222.0.39 () {56 vars in 1137 bytes} [Tue May 31 20:39:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:31.318654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1f0f7-058a-41c0-b54c-0d428cf2fe2b None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:31.438503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0505c-a959-494c-9dbd-76e4ab939461 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:31.441425 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1f0f7-058a-41c0-b54c-0d428cf2fe2b None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:31.480781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ead976-bdd4-4097-b5f2-bd0fd3b7f995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:31.482016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ead976-bdd4-4097-b5f2-bd0fd3b7f995 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:31.482758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ead976-bdd4-4097-b5f2-bd0fd3b7f995 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:31.483467 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ead976-bdd4-4097-b5f2-bd0fd3b7f995 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:31.484461 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ead976-bdd4-4097-b5f2-bd0fd3b7f995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:31.484998 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ead976-bdd4-4097-b5f2-bd0fd3b7f995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:31.486830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ead976-bdd4-4097-b5f2-bd0fd3b7f995 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:31.487267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392f597-453b-44d9-904a-2f7d0cd39534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:31.488048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392f597-453b-44d9-904a-2f7d0cd39534 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:31.488402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392f597-453b-44d9-904a-2f7d0cd39534 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:31.488752 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392f597-453b-44d9-904a-2f7d0cd39534 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:31.489994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392f597-453b-44d9-904a-2f7d0cd39534 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:31.490250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392f597-453b-44d9-904a-2f7d0cd39534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:31.491674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392f597-453b-44d9-904a-2f7d0cd39534 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:31.511765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 287/589] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:31.511765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ead976-bdd4-4097-b5f2-bd0fd3b7f995 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:31.518133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 303/590] 10.222.0.39 () {56 vars in 1137 bytes} [Tue May 31 20:39:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:31.518991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392f597-453b-44d9-904a-2f7d0cd39534 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:31.559268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:31.591959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:31.637754 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392f597-453b-44d9-904a-2f7d0cd39534 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:31.655213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ead976-bdd4-4097-b5f2-bd0fd3b7f995 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:31.686206 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c743c-42b3-4210-9007-37323d5fd0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:31.687585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c743c-42b3-4210-9007-37323d5fd0a8 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:31.688360 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c743c-42b3-4210-9007-37323d5fd0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:31.689322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c743c-42b3-4210-9007-37323d5fd0a8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:31.698073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717de6a-0e3b-4086-bfb3-c5425b844572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:31.699384 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717de6a-0e3b-4086-bfb3-c5425b844572 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:31.699670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717de6a-0e3b-4086-bfb3-c5425b844572 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:31.699948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717de6a-0e3b-4086-bfb3-c5425b844572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:31.700293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c743c-42b3-4210-9007-37323d5fd0a8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:31.702346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c743c-42b3-4210-9007-37323d5fd0a8 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:31.712646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717de6a-0e3b-4086-bfb3-c5425b844572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:31.714145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717de6a-0e3b-4086-bfb3-c5425b844572 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-456c743c-42b3-4210-9007-37323d5fd0a8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:31.721084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:31.722033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:31.722969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:31.722969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:31.722969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:31.722969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:31.722969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:31.722969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:31.722969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:31.722969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:31.722969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 31 20:39:31.722969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:31.725596 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 304/591] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:31.726578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c743c-42b3-4210-9007-37323d5fd0a8 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-f717de6a-0e3b-4086-bfb3-c5425b844572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:31.736863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:31.737804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:31.738687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:31.738687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:31.738687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:31.738687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:31.740868 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 288/592] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:31.741898 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717de6a-0e3b-4086-bfb3-c5425b844572 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:31.836614 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:31.842821 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c743c-42b3-4210-9007-37323d5fd0a8 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:31.849545 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717de6a-0e3b-4086-bfb3-c5425b844572 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:31.866519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:31.878689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf76d4b-34d2-401f-a7dc-a8449ec0da3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:31.879552 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf76d4b-34d2-401f-a7dc-a8449ec0da3a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:31.879815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf76d4b-34d2-401f-a7dc-a8449ec0da3a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:31.880125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf76d4b-34d2-401f-a7dc-a8449ec0da3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:31.891704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c741a-558f-4cd3-977c-3d0ffd7b3cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:31.892063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf76d4b-34d2-401f-a7dc-a8449ec0da3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:31.892834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c741a-558f-4cd3-977c-3d0ffd7b3cff None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:31.893507 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c741a-558f-4cd3-977c-3d0ffd7b3cff None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:31.893624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf76d4b-34d2-401f-a7dc-a8449ec0da3a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:31.894261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c741a-558f-4cd3-977c-3d0ffd7b3cff None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:31.895305 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c741a-558f-4cd3-977c-3d0ffd7b3cff None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:31.895811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c741a-558f-4cd3-977c-3d0ffd7b3cff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:31.897510 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c741a-558f-4cd3-977c-3d0ffd7b3cff None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-bbf76d4b-34d2-401f-a7dc-a8449ec0da3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:31.912379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:31.913327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:31.914237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:31.914237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:31.914237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:31.914237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:31.919008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 305/593] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:31.919888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf76d4b-34d2-401f-a7dc-a8449ec0da3a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:31.921235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 289/594] 10.222.0.39 () {56 vars in 1139 bytes} [Tue May 31 20:39:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:31.922278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c741a-558f-4cd3-977c-3d0ffd7b3cff None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:32.029210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf76d4b-34d2-401f-a7dc-a8449ec0da3a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:32.032140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c741a-558f-4cd3-977c-3d0ffd7b3cff None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:32.065451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70007127-b88d-43e7-af24-dee6882246de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:32.066119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70007127-b88d-43e7-af24-dee6882246de None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.066400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70007127-b88d-43e7-af24-dee6882246de None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.066679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70007127-b88d-43e7-af24-dee6882246de None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.067436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70007127-b88d-43e7-af24-dee6882246de None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:32.067679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70007127-b88d-43e7-af24-dee6882246de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:32.069339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70007127-b88d-43e7-af24-dee6882246de None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:32.070700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1fbb1-8cca-4a43-8d8d-72e246cad073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:32.071361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fbb1-8cca-4a43-8d8d-72e246cad073 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.071669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fbb1-8cca-4a43-8d8d-72e246cad073 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.071947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fbb1-8cca-4a43-8d8d-72e246cad073 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.072666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1fbb1-8cca-4a43-8d8d-72e246cad073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:32.072971 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1fbb1-8cca-4a43-8d8d-72e246cad073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:32.074639 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1fbb1-8cca-4a43-8d8d-72e246cad073 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:32.082542 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 306/595] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:32.083690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70007127-b88d-43e7-af24-dee6882246de None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:32.091596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 290/596] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:32.093026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe5876-cc80-4200-adb5-de5dba7ac131 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.093420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe5876-cc80-4200-adb5-de5dba7ac131 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.093785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe5876-cc80-4200-adb5-de5dba7ac131 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.095950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 291/597] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:32.097292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:32.097494 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe5876-cc80-4200-adb5-de5dba7ac131 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:32.132061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:32.199653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70007127-b88d-43e7-af24-dee6882246de None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:32.214806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe5876-cc80-4200-adb5-de5dba7ac131 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:32.237094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5dcd29-47dd-4ac6-973a-b0a4df5e534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:32.238212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dcd29-47dd-4ac6-973a-b0a4df5e534f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.238495 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dcd29-47dd-4ac6-973a-b0a4df5e534f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.238773 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dcd29-47dd-4ac6-973a-b0a4df5e534f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.250567 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609bec7-3c50-4731-9b3c-30386986815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:32.251318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5dcd29-47dd-4ac6-973a-b0a4df5e534f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:32.251428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609bec7-3c50-4731-9b3c-30386986815b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.251721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609bec7-3c50-4731-9b3c-30386986815b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.252016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609bec7-3c50-4731-9b3c-30386986815b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.252937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5dcd29-47dd-4ac6-973a-b0a4df5e534f None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:32.259013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609bec7-3c50-4731-9b3c-30386986815b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:32.261044 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609bec7-3c50-4731-9b3c-30386986815b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-ee5dcd29-47dd-4ac6-973a-b0a4df5e534f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:32.271261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:32.272166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:32.273068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:32.273068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:32.273068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:32.273068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-8609bec7-3c50-4731-9b3c-30386986815b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:32.275236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:32.276158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:32.277712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:32.277712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:32.277712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:32.277712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:32.277712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:32.277712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:32.277712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:32.277712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:32.277712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 292/598] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:32.277712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609bec7-3c50-4731-9b3c-30386986815b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:32.281025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 307/599] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:32.282225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c7bff-51cd-4548-808f-c9c7a75c23f6 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.282510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c7bff-51cd-4548-808f-c9c7a75c23f6 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.282790 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c7bff-51cd-4548-808f-c9c7a75c23f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.301268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-3c7c7bff-51cd-4548-808f-c9c7a75c23f6 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:32.302635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3c7c7bff-51cd-4548-808f-c9c7a75c23f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:32.367653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:32.379151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 308/600] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:32.379992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c7bff-51cd-4548-808f-c9c7a75c23f6 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:32.398093 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:32.409451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609bec7-3c50-4731-9b3c-30386986815b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:32.448922 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de255f4-5501-4a08-a554-c0c68dde4ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:32.449737 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de255f4-5501-4a08-a554-c0c68dde4ca7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.450021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de255f4-5501-4a08-a554-c0c68dde4ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.450300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de255f4-5501-4a08-a554-c0c68dde4ca7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.457417 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de255f4-5501-4a08-a554-c0c68dde4ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:32.459096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de255f4-5501-4a08-a554-c0c68dde4ca7 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-9de255f4-5501-4a08-a554-c0c68dde4ca7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:32.473522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:32.474439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:32.475348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:32.475348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:32.475348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:32.475348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:32.475348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:32.475348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:32.475348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:32.475348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:32.481693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 293/601] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:32.482748 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de255f4-5501-4a08-a554-c0c68dde4ca7 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:32.486298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c7bff-51cd-4548-808f-c9c7a75c23f6 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:32.524494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c792627-6d93-49ee-bc97-49dd6a200041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:32.525713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c792627-6d93-49ee-bc97-49dd6a200041 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.526048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c792627-6d93-49ee-bc97-49dd6a200041 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.526319 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c792627-6d93-49ee-bc97-49dd6a200041 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.527062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c792627-6d93-49ee-bc97-49dd6a200041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:32.527365 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c792627-6d93-49ee-bc97-49dd6a200041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:32.528750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c792627-6d93-49ee-bc97-49dd6a200041 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:32.541490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 309/602] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:32.542252 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c792627-6d93-49ee-bc97-49dd6a200041 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:32.594781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de255f4-5501-4a08-a554-c0c68dde4ca7 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:32.599161 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:32.632514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bc57f-c145-412c-a8e4-84d676daa222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:32.633266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bc57f-c145-412c-a8e4-84d676daa222 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.633646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bc57f-c145-412c-a8e4-84d676daa222 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.633944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bc57f-c145-412c-a8e4-84d676daa222 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.635336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bc57f-c145-412c-a8e4-84d676daa222 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:32.635710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bc57f-c145-412c-a8e4-84d676daa222 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:32.637184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bc57f-c145-412c-a8e4-84d676daa222 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:32.649891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 294/603] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:32.650719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bc57f-c145-412c-a8e4-84d676daa222 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:32.655320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c792627-6d93-49ee-bc97-49dd6a200041 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:32.665070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:32.689474 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9e50c-33f9-4823-82ff-bfd981e4ad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:32.690279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e50c-33f9-4823-82ff-bfd981e4ad1f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.690565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e50c-33f9-4823-82ff-bfd981e4ad1f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.690847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e50c-33f9-4823-82ff-bfd981e4ad1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.701843 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9e50c-33f9-4823-82ff-bfd981e4ad1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-20a9e50c-33f9-4823-82ff-bfd981e4ad1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:32.709520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:32.710560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:32.711413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:32.711413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:32.711413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:32.711413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:32.711413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:32.711413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:32.711413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:32.711413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:32.711413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:32.711413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:32.711413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:32.711413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:32.711413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 310/604] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:32.712736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9e50c-33f9-4823-82ff-bfd981e4ad1f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:32.752298 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bc57f-c145-412c-a8e4-84d676daa222 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:32.786325 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983de22-018d-4866-a6e9-1973f72eaf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:32.786981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983de22-018d-4866-a6e9-1973f72eaf45 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.787261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983de22-018d-4866-a6e9-1973f72eaf45 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.787534 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983de22-018d-4866-a6e9-1973f72eaf45 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.788317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983de22-018d-4866-a6e9-1973f72eaf45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:32.788628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983de22-018d-4866-a6e9-1973f72eaf45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:32.790137 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983de22-018d-4866-a6e9-1973f72eaf45 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:32.814020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 295/605] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:32.814020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c3ab-d6b4-489a-96cd-34434022af6b None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.814020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c3ab-d6b4-489a-96cd-34434022af6b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.814020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c3ab-d6b4-489a-96cd-34434022af6b None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.814020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 296/606] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:32.814020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c3ab-d6b4-489a-96cd-34434022af6b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:32.817478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9e50c-33f9-4823-82ff-bfd981e4ad1f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:32.828208 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:32.850666 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41856a-28eb-4482-ad82-a8036c3ca672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:32.851462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41856a-28eb-4482-ad82-a8036c3ca672 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.851743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41856a-28eb-4482-ad82-a8036c3ca672 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.852017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41856a-28eb-4482-ad82-a8036c3ca672 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.860348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41856a-28eb-4482-ad82-a8036c3ca672 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:32.862096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41856a-28eb-4482-ad82-a8036c3ca672 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-cf41856a-28eb-4482-ad82-a8036c3ca672 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:32.876797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:32.877886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:32.878993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:32.878993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:32.878993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:32.878993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:32.878993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:32.878993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:32.878993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:32.878993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:32.878993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 311/607] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:32.879583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41856a-28eb-4482-ad82-a8036c3ca672 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:32.883759 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:32.914902 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c3ab-d6b4-489a-96cd-34434022af6b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:32.949364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4f5e2-de52-40d7-9f72-0181418b8913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:32.950276 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4f5e2-de52-40d7-9f72-0181418b8913 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:32.950551 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4f5e2-de52-40d7-9f72-0181418b8913 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:32.950821 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4f5e2-de52-40d7-9f72-0181418b8913 None admin] PATH_INFO: `/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/01a22cd803304a19a58bfbe17addb11f/roles/1d87f67726f0470f81f36098070998b8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:32.966717 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4f5e2-de52-40d7-9f72-0181418b8913 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d14229f6554a34bf9084d36cffe8ac, user_id=01a22cd803304a19a58bfbe17addb11f, role_id=1d87f67726f0470f81f36098070998b8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:32.968159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4f5e2-de52-40d7-9f72-0181418b8913 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:32.979088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41856a-28eb-4482-ad82-a8036c3ca672 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:33.012130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7e1d6-14b8-4469-aa51-8ff7be6a9607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:33.012789 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7e1d6-14b8-4469-aa51-8ff7be6a9607 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:33.013070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7e1d6-14b8-4469-aa51-8ff7be6a9607 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:33.013342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7e1d6-14b8-4469-aa51-8ff7be6a9607 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:33.014158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7e1d6-14b8-4469-aa51-8ff7be6a9607 None admin] RBAC: Adding query filter params (name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:33.014463 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7e1d6-14b8-4469-aa51-8ff7be6a9607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:33.015824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7e1d6-14b8-4469-aa51-8ff7be6a9607 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:33.023594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 312/608] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:33.024359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7e1d6-14b8-4469-aa51-8ff7be6a9607 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:33.029542 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 297/609] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:39:32 2022] PUT /identity/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/01a22cd803304a19a58bfbe17addb11f/roles/1d87f67726f0470f81f36098070998b8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:39:33.030983 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e77d4-bdf6-40aa-a5ff-a6f26c98a009 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:33.031267 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e77d4-bdf6-40aa-a5ff-a6f26c98a009 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:33.031539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e77d4-bdf6-40aa-a5ff-a6f26c98a009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:33.057829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a80e77d4-bdf6-40aa-a5ff-a6f26c98a009 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:33.059307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a80e77d4-bdf6-40aa-a5ff-a6f26c98a009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:33.066327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:33.141605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 298/610] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:33.141605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e77d4-bdf6-40aa-a5ff-a6f26c98a009 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:33.147723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7e1d6-14b8-4469-aa51-8ff7be6a9607 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:33.190021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d0d1c-3218-4790-a88e-acd45ad77a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:33.190925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d0d1c-3218-4790-a88e-acd45ad77a20 None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:33.191208 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d0d1c-3218-4790-a88e-acd45ad77a20 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:33.191481 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d0d1c-3218-4790-a88e-acd45ad77a20 None admin] PATH_INFO: `/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/7cfcecd035214e2181622eb6b30ddf62/roles/1d87f67726f0470f81f36098070998b8` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:33.209622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:33.210671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d0d1c-3218-4790-a88e-acd45ad77a20 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d14229f6554a34bf9084d36cffe8ac, user_id=7cfcecd035214e2181622eb6b30ddf62, role_id=1d87f67726f0470f81f36098070998b8)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:33.212716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d0d1c-3218-4790-a88e-acd45ad77a20 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:33.262233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e77d4-bdf6-40aa-a5ff-a6f26c98a009 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:33.295642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c172c9-0f7c-4f5b-82b6-e9c0828f438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:33.296405 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c172c9-0f7c-4f5b-82b6-e9c0828f438c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:33.296766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c172c9-0f7c-4f5b-82b6-e9c0828f438c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:33.297119 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c172c9-0f7c-4f5b-82b6-e9c0828f438c None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:33.298031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c172c9-0f7c-4f5b-82b6-e9c0828f438c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:33.298420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c172c9-0f7c-4f5b-82b6-e9c0828f438c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:33.300120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c172c9-0f7c-4f5b-82b6-e9c0828f438c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:33.314608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 299/611] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:33.315533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c172c9-0f7c-4f5b-82b6-e9c0828f438c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:33.333499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 313/612] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:39:33 2022] PUT /identity/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/7cfcecd035214e2181622eb6b30ddf62/roles/1d87f67726f0470f81f36098070998b8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:39:33.333499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d0d1c-3218-4790-a88e-acd45ad77a20 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:33.443157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c172c9-0f7c-4f5b-82b6-e9c0828f438c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:33.451294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:33.461150 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:33.480656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d0d1c-3218-4790-a88e-acd45ad77a20 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:33.486285 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61232f42-7d8b-4e0e-808d-2eb6cde7e732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:33.487383 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61232f42-7d8b-4e0e-808d-2eb6cde7e732 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:33.487805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61232f42-7d8b-4e0e-808d-2eb6cde7e732 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:33.488218 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61232f42-7d8b-4e0e-808d-2eb6cde7e732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:33.500702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61232f42-7d8b-4e0e-808d-2eb6cde7e732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:33.502502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61232f42-7d8b-4e0e-808d-2eb6cde7e732 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-61232f42-7d8b-4e0e-808d-2eb6cde7e732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:33.523368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:33.524350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:33.525943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:33.525943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:33.525943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:33.525943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:33.529062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41e989-3daf-433d-8104-ff60983a6e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:33.529790 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 300/613] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:33.530528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e989-3daf-433d-8104-ff60983a6e90 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:33.530710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61232f42-7d8b-4e0e-808d-2eb6cde7e732 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:33.531185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e989-3daf-433d-8104-ff60983a6e90 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:33.531682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e989-3daf-433d-8104-ff60983a6e90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:33.548255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41e989-3daf-433d-8104-ff60983a6e90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-9f41e989-3daf-433d-8104-ff60983a6e90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:33.559827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:33.560845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:33.561732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:33.561732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:33.561732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:33.561732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:33.561732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:33.561732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:33.561732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:33.561732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:33.561732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:33.561732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:33.561732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:33.561732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:33.564969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 314/614] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:33.566069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41e989-3daf-433d-8104-ff60983a6e90 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:33.671125 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61232f42-7d8b-4e0e-808d-2eb6cde7e732 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:33.689410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41e989-3daf-433d-8104-ff60983a6e90 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:33.717694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5890fcf-c65d-4c28-aafd-2b14d96c8e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:33.718607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5890fcf-c65d-4c28-aafd-2b14d96c8e91 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:33.718893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5890fcf-c65d-4c28-aafd-2b14d96c8e91 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:33.719399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5890fcf-c65d-4c28-aafd-2b14d96c8e91 None admin] PATH_INFO: `/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/16a77c08d2844e7cb81ac1370c527cdf/roles/1d87f67726f0470f81f36098070998b8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:33.731943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43788c4e-c638-4805-9d97-304ee89f4fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:33.732609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43788c4e-c638-4805-9d97-304ee89f4fa7 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:33.732894 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43788c4e-c638-4805-9d97-304ee89f4fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:33.733173 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43788c4e-c638-4805-9d97-304ee89f4fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:33.734042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43788c4e-c638-4805-9d97-304ee89f4fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:33.734408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43788c4e-c638-4805-9d97-304ee89f4fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:33.735803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43788c4e-c638-4805-9d97-304ee89f4fa7 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:33.741675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5890fcf-c65d-4c28-aafd-2b14d96c8e91 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d14229f6554a34bf9084d36cffe8ac, user_id=16a77c08d2844e7cb81ac1370c527cdf, role_id=1d87f67726f0470f81f36098070998b8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:33.743952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5890fcf-c65d-4c28-aafd-2b14d96c8e91 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:33.750075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 315/615] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:33.754536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43788c4e-c638-4805-9d97-304ee89f4fa7 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:33.755202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:33.820207 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 301/616] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:39:33 2022] PUT /identity/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/16a77c08d2844e7cb81ac1370c527cdf/roles/1d87f67726f0470f81f36098070998b8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:39:33.826810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5890fcf-c65d-4c28-aafd-2b14d96c8e91 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:33.859434 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:33.978581 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43788c4e-c638-4805-9d97-304ee89f4fa7 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:34.027422 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1f1fa-6123-4cb1-8529-fc07cb93012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:34.028467 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1f1fa-6123-4cb1-8529-fc07cb93012c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:34.028949 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1f1fa-6123-4cb1-8529-fc07cb93012c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:34.029492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1f1fa-6123-4cb1-8529-fc07cb93012c None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:34.030502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1f1fa-6123-4cb1-8529-fc07cb93012c None admin] RBAC: Adding query filter params (name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:34.031029 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1f1fa-6123-4cb1-8529-fc07cb93012c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:34.032623 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1f1fa-6123-4cb1-8529-fc07cb93012c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:34.043363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 316/617] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:34.053458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5890fcf-c65d-4c28-aafd-2b14d96c8e91 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:34.054909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1f1fa-6123-4cb1-8529-fc07cb93012c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:34.090128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa171f-bd4a-4ef9-b16d-8cf08115bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:34.090714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa171f-bd4a-4ef9-b16d-8cf08115bdcf None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:34.090962 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa171f-bd4a-4ef9-b16d-8cf08115bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:34.091225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa171f-bd4a-4ef9-b16d-8cf08115bdcf None admin] PATH_INFO: `/v3/users/swift` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:34.100529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa171f-bd4a-4ef9-b16d-8cf08115bdcf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:34.102032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa171f-bd4a-4ef9-b16d-8cf08115bdcf None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-c4fa171f-bd4a-4ef9-b16d-8cf08115bdcf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:34.117995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:34.119045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:34.119999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:34.119999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:34.119999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:34.119999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:34.119999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:34.119999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:34.119999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:34.119999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:34.119999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 20:39:34.119999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:34.119999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 302/618] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:34.125320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa171f-bd4a-4ef9-b16d-8cf08115bdcf None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:34.140103 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:34.187832 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1f1fa-6123-4cb1-8529-fc07cb93012c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:34.216868 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:34.232089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7304c-70df-4b3f-82c4-c04a2fe6d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:34.233333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7304c-70df-4b3f-82c4-c04a2fe6d89c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:34.233867 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7304c-70df-4b3f-82c4-c04a2fe6d89c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:34.234340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7304c-70df-4b3f-82c4-c04a2fe6d89c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:34.245685 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa171f-bd4a-4ef9-b16d-8cf08115bdcf None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:34.247107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7304c-70df-4b3f-82c4-c04a2fe6d89c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:34.248866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7304c-70df-4b3f-82c4-c04a2fe6d89c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-1cc7304c-70df-4b3f-82c4-c04a2fe6d89c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:34.269763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:34.270743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:34.271629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:34.271629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:34.271629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:34.271629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:34.274193 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 317/619] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:34.280607 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7304c-70df-4b3f-82c4-c04a2fe6d89c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:34.291710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5387d3c-15fc-4be5-91f5-307d7f035e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:34.293569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5387d3c-15fc-4be5-91f5-307d7f035e4f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:34.294072 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5387d3c-15fc-4be5-91f5-307d7f035e4f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:34.294547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5387d3c-15fc-4be5-91f5-307d7f035e4f None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:34.296172 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5387d3c-15fc-4be5-91f5-307d7f035e4f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:34.297191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5387d3c-15fc-4be5-91f5-307d7f035e4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:34.299232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5387d3c-15fc-4be5-91f5-307d7f035e4f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:34.327037 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 303/620] 10.222.0.39 () {56 vars in 1135 bytes} [Tue May 31 20:39:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:34.333533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5387d3c-15fc-4be5-91f5-307d7f035e4f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:34.411338 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7304c-70df-4b3f-82c4-c04a2fe6d89c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:34.430203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:34.446001 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5387d3c-15fc-4be5-91f5-307d7f035e4f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:34.451113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e4f39-30c8-47b8-9061-a032fb362ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:34.452112 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e4f39-30c8-47b8-9061-a032fb362ded None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:34.452597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e4f39-30c8-47b8-9061-a032fb362ded None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:34.453064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e4f39-30c8-47b8-9061-a032fb362ded None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:34.454119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e4f39-30c8-47b8-9061-a032fb362ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:34.454733 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e4f39-30c8-47b8-9061-a032fb362ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:34.456350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e4f39-30c8-47b8-9061-a032fb362ded None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:34.470444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 318/621] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:34.476070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e4f39-30c8-47b8-9061-a032fb362ded None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:34.479776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:34.484740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c9a53-a5b9-44b5-9183-d63f9dbecb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:34.485503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c9a53-a5b9-44b5-9183-d63f9dbecb9e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:34.485789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c9a53-a5b9-44b5-9183-d63f9dbecb9e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:34.486064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c9a53-a5b9-44b5-9183-d63f9dbecb9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:34.497616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c9a53-a5b9-44b5-9183-d63f9dbecb9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:34.499069 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c9a53-a5b9-44b5-9183-d63f9dbecb9e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-650c9a53-a5b9-44b5-9183-d63f9dbecb9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:34.517334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:34.518295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:34.519180 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:34.519180 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:34.519180 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:34.519180 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:34.523003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 304/622] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:34.529095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c9a53-a5b9-44b5-9183-d63f9dbecb9e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:34.590394 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e4f39-30c8-47b8-9061-a032fb362ded None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:34.631654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226bbcc-9e5c-4d08-9fad-9cefb89819aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:34.632802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226bbcc-9e5c-4d08-9fad-9cefb89819aa None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:34.633280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226bbcc-9e5c-4d08-9fad-9cefb89819aa None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:34.634419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226bbcc-9e5c-4d08-9fad-9cefb89819aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:34.647591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226bbcc-9e5c-4d08-9fad-9cefb89819aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:34.650441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226bbcc-9e5c-4d08-9fad-9cefb89819aa None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-b226bbcc-9e5c-4d08-9fad-9cefb89819aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:34.676658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:34.677723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:34.678676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:34.678676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:34.678676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:34.678676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:34.678676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:34.678676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:34.678676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:34.678676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:34.678676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:39:34.678676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:34.689501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 319/623] 10.222.0.39 () {56 vars in 1093 bytes} [Tue May 31 20:39:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:34.689501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226bbcc-9e5c-4d08-9fad-9cefb89819aa None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:34.719376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c9a53-a5b9-44b5-9183-d63f9dbecb9e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:34.753686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:34.784269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0db63c-57d9-4329-917a-819534a9ddc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:34.784950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0db63c-57d9-4329-917a-819534a9ddc5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:34.785234 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0db63c-57d9-4329-917a-819534a9ddc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:34.785536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0db63c-57d9-4329-917a-819534a9ddc5 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:34.786264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0db63c-57d9-4329-917a-819534a9ddc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:34.786570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0db63c-57d9-4329-917a-819534a9ddc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:34.787953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0db63c-57d9-4329-917a-819534a9ddc5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:34.808120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 305/624] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:34.812652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0db63c-57d9-4329-917a-819534a9ddc5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:34.870094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226bbcc-9e5c-4d08-9fad-9cefb89819aa None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:34.905790 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:34.940343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e7766-700d-4583-b58f-57c20afa8b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:34.941025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e7766-700d-4583-b58f-57c20afa8b5c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:34.941369 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e7766-700d-4583-b58f-57c20afa8b5c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:34.941724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e7766-700d-4583-b58f-57c20afa8b5c None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:34.942569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e7766-700d-4583-b58f-57c20afa8b5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:34.942886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e7766-700d-4583-b58f-57c20afa8b5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:34.944327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e7766-700d-4583-b58f-57c20afa8b5c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:34.976891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 320/625] 10.222.0.39 () {56 vars in 1133 bytes} [Tue May 31 20:39:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:34.985611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0db63c-57d9-4329-917a-819534a9ddc5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:34.990578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e7766-700d-4583-b58f-57c20afa8b5c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:35.060970 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f034e8-52d4-4c0c-8436-84d1e2992886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:35.061718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f034e8-52d4-4c0c-8436-84d1e2992886 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:35.062003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f034e8-52d4-4c0c-8436-84d1e2992886 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:35.062282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f034e8-52d4-4c0c-8436-84d1e2992886 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:35.072302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f034e8-52d4-4c0c-8436-84d1e2992886 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:35.074049 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f034e8-52d4-4c0c-8436-84d1e2992886 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-d1f034e8-52d4-4c0c-8436-84d1e2992886 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:35.101317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:35.102281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:35.103195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:35.103195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:35.103195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:35.103195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:35.103195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:35.103195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:35.103195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:35.103195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:35.114481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 306/626] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:35.115327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f034e8-52d4-4c0c-8436-84d1e2992886 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:35.180146 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:35.192105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e7766-700d-4583-b58f-57c20afa8b5c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:35.251700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ace5b3-d043-4328-ba06-2bedbc83cdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:35.252353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace5b3-d043-4328-ba06-2bedbc83cdac None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:35.252631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace5b3-d043-4328-ba06-2bedbc83cdac None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:35.252899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace5b3-d043-4328-ba06-2bedbc83cdac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:35.319390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f034e8-52d4-4c0c-8436-84d1e2992886 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:35.321840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:35.343764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ace5b3-d043-4328-ba06-2bedbc83cdac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:35.345505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ace5b3-d043-4328-ba06-2bedbc83cdac None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:35.394081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194bb9a-77dd-4174-9d67-31ccec1c5030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:35.395038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194bb9a-77dd-4174-9d67-31ccec1c5030 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:35.395038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194bb9a-77dd-4174-9d67-31ccec1c5030 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:35.395298 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194bb9a-77dd-4174-9d67-31ccec1c5030 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:35.396097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194bb9a-77dd-4174-9d67-31ccec1c5030 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:35.396408 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194bb9a-77dd-4174-9d67-31ccec1c5030 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:35.397948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194bb9a-77dd-4174-9d67-31ccec1c5030 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:35.424838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 307/627] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:35.430720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194bb9a-77dd-4174-9d67-31ccec1c5030 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:35.448872 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:35.454192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 321/628] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:35.463012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ace5b3-d043-4328-ba06-2bedbc83cdac None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:35.570104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ace5b3-d043-4328-ba06-2bedbc83cdac None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:35.590138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194bb9a-77dd-4174-9d67-31ccec1c5030 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:35.615794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bc69c-8dac-4308-811d-d221807ff4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:35.616841 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bc69c-8dac-4308-811d-d221807ff4c5 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:35.617558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bc69c-8dac-4308-811d-d221807ff4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:35.617846 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bc69c-8dac-4308-811d-d221807ff4c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:35.625930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8f41f-9301-4dc0-96db-39beeba0849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:35.626914 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f41f-9301-4dc0-96db-39beeba0849a None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:35.627273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f41f-9301-4dc0-96db-39beeba0849a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:35.627622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f41f-9301-4dc0-96db-39beeba0849a None admin] PATH_INFO: `/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/90867ac821dd4adb8d52075fbd85caba/roles/1d87f67726f0470f81f36098070998b8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:35.631779 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bc69c-8dac-4308-811d-d221807ff4c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:35.633253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bc69c-8dac-4308-811d-d221807ff4c5 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:35.644405 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f41f-9301-4dc0-96db-39beeba0849a None admin] RBAC: Authorizing `identity:create_grant(project_id=69d14229f6554a34bf9084d36cffe8ac, user_id=90867ac821dd4adb8d52075fbd85caba, role_id=1d87f67726f0470f81f36098070998b8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:35.646005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f41f-9301-4dc0-96db-39beeba0849a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-030bc69c-8dac-4308-811d-d221807ff4c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:35.654327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:35.655260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:35.656782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:35.656782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:35.656782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:35.656782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:35.656782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 322/629] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:35.657197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee722-7c49-4137-8124-5df878a1f59e None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:35.657485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee722-7c49-4137-8124-5df878a1f59e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:35.657767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee722-7c49-4137-8124-5df878a1f59e None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:35.659377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 323/630] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:35.662501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bee722-7c49-4137-8124-5df878a1f59e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:35.718330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:35.751437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 308/631] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:39:35 2022] PUT /identity/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/90867ac821dd4adb8d52075fbd85caba/roles/1d87f67726f0470f81f36098070998b8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:39:35.753711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a6233-03d0-47de-a9e1-5f64c095f881 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:35.754214 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a6233-03d0-47de-a9e1-5f64c095f881 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:35.754750 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a6233-03d0-47de-a9e1-5f64c095f881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:35.782880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bee722-7c49-4137-8124-5df878a1f59e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:35.796179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-392a6233-03d0-47de-a9e1-5f64c095f881 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:35.797772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-392a6233-03d0-47de-a9e1-5f64c095f881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:35.824074 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:35.827303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c931205-3d98-4c69-858d-1b1502d181ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:35.828326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c931205-3d98-4c69-858d-1b1502d181ac None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:35.829314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c931205-3d98-4c69-858d-1b1502d181ac None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:35.829979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c931205-3d98-4c69-858d-1b1502d181ac None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:35.831063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c931205-3d98-4c69-858d-1b1502d181ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:35.831589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c931205-3d98-4c69-858d-1b1502d181ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:35.833507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c931205-3d98-4c69-858d-1b1502d181ac None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:35.848905 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 324/632] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:35.855179 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c931205-3d98-4c69-858d-1b1502d181ac None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:35.958355 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 309/633] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:35.983869 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a6233-03d0-47de-a9e1-5f64c095f881 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:36.063261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c931205-3d98-4c69-858d-1b1502d181ac None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:36.071950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:36.096213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a6233-03d0-47de-a9e1-5f64c095f881 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:36.103467 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd40f9-022f-416b-bcb5-2ad1eebe0175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:36.104648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd40f9-022f-416b-bcb5-2ad1eebe0175 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.105133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd40f9-022f-416b-bcb5-2ad1eebe0175 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.105678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd40f9-022f-416b-bcb5-2ad1eebe0175 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.114085 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd40f9-022f-416b-bcb5-2ad1eebe0175 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:36.115982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd40f9-022f-416b-bcb5-2ad1eebe0175 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:36.131726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f8c18-fdce-4fa1-b31d-362468411b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-8afd40f9-022f-416b-bcb5-2ad1eebe0175 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:36.132315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:36.133192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:36.134171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:36.134171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:36.134171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:36.134171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:36.134171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:36.134171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:36.134171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:36.134171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:36.134590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f8c18-fdce-4fa1-b31d-362468411b2b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.134590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f8c18-fdce-4fa1-b31d-362468411b2b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.134590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f8c18-fdce-4fa1-b31d-362468411b2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.136807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 325/634] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:36.138405 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6ae06-0f11-4817-af59-abc318fb7027 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.138897 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6ae06-0f11-4817-af59-abc318fb7027 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.139388 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6ae06-0f11-4817-af59-abc318fb7027 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.141169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 326/635] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:36.145341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6ae06-0f11-4817-af59-abc318fb7027 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:36.151606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f8c18-fdce-4fa1-b31d-362468411b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-181f8c18-fdce-4fa1-b31d-362468411b2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:36.159395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:36.160373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:36.161237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:36.161237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:36.161237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:36.161237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:36.161237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:36.161237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:36.161237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:36.161237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:36.161237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:36.161237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:36.161237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:36.161237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:36.161237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 310/636] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:36.162460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc2d55-d0ad-4045-8ed8-07183be0335a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.162568 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc2d55-d0ad-4045-8ed8-07183be0335a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.162828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc2d55-d0ad-4045-8ed8-07183be0335a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.169730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:36.181782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7bfc2d55-d0ad-4045-8ed8-07183be0335a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:36.182986 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7bfc2d55-d0ad-4045-8ed8-07183be0335a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:36.261402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 311/637] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:36.261402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc2d55-d0ad-4045-8ed8-07183be0335a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:36.281935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6ae06-0f11-4817-af59-abc318fb7027 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:36.335579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c78f2-7009-4f51-8d71-1963518a6464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:36.336425 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c78f2-7009-4f51-8d71-1963518a6464 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.337341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c78f2-7009-4f51-8d71-1963518a6464 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.337735 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c78f2-7009-4f51-8d71-1963518a6464 None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.338758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c78f2-7009-4f51-8d71-1963518a6464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:36.339198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c78f2-7009-4f51-8d71-1963518a6464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:36.340814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c78f2-7009-4f51-8d71-1963518a6464 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:36.356070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 327/638] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:36.357015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c78f2-7009-4f51-8d71-1963518a6464 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:36.367728 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc2d55-d0ad-4045-8ed8-07183be0335a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:36.387931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:36.405922 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a00b2-c897-4ee0-8bcb-b43fb944433d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:36.406599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a00b2-c897-4ee0-8bcb-b43fb944433d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.406884 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a00b2-c897-4ee0-8bcb-b43fb944433d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.407161 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a00b2-c897-4ee0-8bcb-b43fb944433d None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.407910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a00b2-c897-4ee0-8bcb-b43fb944433d None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:36.408220 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a00b2-c897-4ee0-8bcb-b43fb944433d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:36.409636 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a00b2-c897-4ee0-8bcb-b43fb944433d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:36.411070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:36.419627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 312/639] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:36.420526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a00b2-c897-4ee0-8bcb-b43fb944433d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:36.468090 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c78f2-7009-4f51-8d71-1963518a6464 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:36.505917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78054f82-0908-4bab-8304-9805f8077bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:36.506821 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78054f82-0908-4bab-8304-9805f8077bea None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.507214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78054f82-0908-4bab-8304-9805f8077bea None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.507503 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78054f82-0908-4bab-8304-9805f8077bea None admin] PATH_INFO: `/v3/roles/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.519009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78054f82-0908-4bab-8304-9805f8077bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:36.526542 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a00b2-c897-4ee0-8bcb-b43fb944433d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-78054f82-0908-4bab-8304-9805f8077bea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:36.530660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:36.531598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:36.532471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:36.532471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:36.532471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:36.532471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:36.532471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:36.532471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:36.532471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:36.532471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:36.532471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:36.532471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:36.532471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:36.532471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:36.536918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 328/640] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:36.537935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78054f82-0908-4bab-8304-9805f8077bea None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:36.570057 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b56ecc-e92f-4017-95ec-27f4c53a0603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:36.570710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b56ecc-e92f-4017-95ec-27f4c53a0603 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.570992 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b56ecc-e92f-4017-95ec-27f4c53a0603 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.571266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b56ecc-e92f-4017-95ec-27f4c53a0603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.572092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b56ecc-e92f-4017-95ec-27f4c53a0603 None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=8c86c12743bd4ee8843dba4a7af5d7a0) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:36.572402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b56ecc-e92f-4017-95ec-27f4c53a0603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:36.574146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b56ecc-e92f-4017-95ec-27f4c53a0603 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:36.580649 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 313/641] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:36 2022] GET /identity/v3/role_assignments?user.id=8c86c12743bd4ee8843dba4a7af5d7a0&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:36.581525 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b56ecc-e92f-4017-95ec-27f4c53a0603 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:36.652758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78054f82-0908-4bab-8304-9805f8077bea None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:36.654596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:36.655508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:36.692292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a6491-634f-450b-8284-51787cfdc846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:36.693276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6491-634f-450b-8284-51787cfdc846 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.693587 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6491-634f-450b-8284-51787cfdc846 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.693904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a6491-634f-450b-8284-51787cfdc846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.705840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a6491-634f-450b-8284-51787cfdc846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:36.707341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a6491-634f-450b-8284-51787cfdc846 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-fd5a6491-634f-450b-8284-51787cfdc846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:36.726022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:36.729654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:36.730768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:36.730768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:36.730768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:36.730768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:36.730768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 329/642] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:36.733215 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a6491-634f-450b-8284-51787cfdc846 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:36.747477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b56ecc-e92f-4017-95ec-27f4c53a0603 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:36.785067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b0bb7-2ee1-4640-b8b7-8741ce9e4e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:36.785774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0bb7-2ee1-4640-b8b7-8741ce9e4e7c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.786017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0bb7-2ee1-4640-b8b7-8741ce9e4e7c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.786292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0bb7-2ee1-4640-b8b7-8741ce9e4e7c None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.787045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b0bb7-2ee1-4640-b8b7-8741ce9e4e7c None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:36.787733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b0bb7-2ee1-4640-b8b7-8741ce9e4e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:36.788764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b0bb7-2ee1-4640-b8b7-8741ce9e4e7c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:36.799146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 314/643] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:36.803605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f6c26-78d2-4029-a974-df1f338b50eb None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.803605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f6c26-78d2-4029-a974-df1f338b50eb None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.803605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f6c26-78d2-4029-a974-df1f338b50eb None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.803605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 315/644] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:36.804569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f6c26-78d2-4029-a974-df1f338b50eb None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:36.853328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a6491-634f-450b-8284-51787cfdc846 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:36.892605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf984f-d73d-45f9-b745-b40319da3f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:36.893272 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf984f-d73d-45f9-b745-b40319da3f8e None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.893667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf984f-d73d-45f9-b745-b40319da3f8e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.893950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf984f-d73d-45f9-b745-b40319da3f8e None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.894739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf984f-d73d-45f9-b745-b40319da3f8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:36.895058 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf984f-d73d-45f9-b745-b40319da3f8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:36.896418 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf984f-d73d-45f9-b745-b40319da3f8e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:36.905248 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:36.911469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 330/645] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:36.913656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f346f-b295-4cf1-a778-87353d5b6455 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.913656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f346f-b295-4cf1-a778-87353d5b6455 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.913656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f346f-b295-4cf1-a778-87353d5b6455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.928158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f6c26-78d2-4029-a974-df1f338b50eb None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:36.934712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-765f346f-b295-4cf1-a778-87353d5b6455 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:36.934884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-765f346f-b295-4cf1-a778-87353d5b6455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:36.958737 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:36.972164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ca47d-425a-4bd8-9f68-2afe98651770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:36.972959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ca47d-425a-4bd8-9f68-2afe98651770 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:36.973246 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ca47d-425a-4bd8-9f68-2afe98651770 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:36.973634 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ca47d-425a-4bd8-9f68-2afe98651770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:36.984895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ca47d-425a-4bd8-9f68-2afe98651770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:36.986622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ca47d-425a-4bd8-9f68-2afe98651770 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-797ca47d-425a-4bd8-9f68-2afe98651770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:37.005080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:37.006232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:37.007621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:37.007621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:37.007621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:37.007621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:37.007621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 316/646] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:37.007621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ca47d-425a-4bd8-9f68-2afe98651770 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:37.017556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 331/647] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:37.018695 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f346f-b295-4cf1-a778-87353d5b6455 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:37.114783 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ca47d-425a-4bd8-9f68-2afe98651770 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:37.131315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f346f-b295-4cf1-a778-87353d5b6455 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:37.152254 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15e970-f660-488e-ae24-e423591556b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:37.153198 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15e970-f660-488e-ae24-e423591556b1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:37.153638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15e970-f660-488e-ae24-e423591556b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:37.154126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15e970-f660-488e-ae24-e423591556b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:37.161033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:37.163467 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15e970-f660-488e-ae24-e423591556b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:37.165671 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15e970-f660-488e-ae24-e423591556b1 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:37.169786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55720e07-0430-4c19-858f-65a6fa20b052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:37.170449 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720e07-0430-4c19-858f-65a6fa20b052 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:37.170726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720e07-0430-4c19-858f-65a6fa20b052 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:37.170999 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720e07-0430-4c19-858f-65a6fa20b052 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:37.171766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55720e07-0430-4c19-858f-65a6fa20b052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:37.172071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55720e07-0430-4c19-858f-65a6fa20b052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:37.173534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55720e07-0430-4c19-858f-65a6fa20b052 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-9f15e970-f660-488e-ae24-e423591556b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:37.182226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:37.189909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:37.192414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:37.192414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:37.192414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:37.192414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:37.192414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:37.192414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:37.192414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:37.192414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:37.192414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 31 20:39:37.192414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:37.192414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 317/648] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:37.192414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15e970-f660-488e-ae24-e423591556b1 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:37.193955 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 332/649] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:37.193955 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55720e07-0430-4c19-858f-65a6fa20b052 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:37.224037 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:37.296311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15e970-f660-488e-ae24-e423591556b1 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:37.304566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55720e07-0430-4c19-858f-65a6fa20b052 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:37.342126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0cd88-6568-402a-b1fd-65fbd14e699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:37.343087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0cd88-6568-402a-b1fd-65fbd14e699d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:37.343513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0cd88-6568-402a-b1fd-65fbd14e699d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:37.343981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc45551-2680-40de-8ffb-42d5f0490a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:37.344154 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0cd88-6568-402a-b1fd-65fbd14e699d None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:37.344770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc45551-2680-40de-8ffb-42d5f0490a43 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:37.345061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc45551-2680-40de-8ffb-42d5f0490a43 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:37.345478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc45551-2680-40de-8ffb-42d5f0490a43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:37.345688 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0cd88-6568-402a-b1fd-65fbd14e699d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:37.346174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0cd88-6568-402a-b1fd-65fbd14e699d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:37.348404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0cd88-6568-402a-b1fd-65fbd14e699d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:37.357152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc45551-2680-40de-8ffb-42d5f0490a43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-4bc45551-2680-40de-8ffb-42d5f0490a43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:37.365209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:37.366360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:37.367301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:37.367301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:37.367301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:37.367301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:37.367301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:37.367301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:37.367301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:37.367301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:37.367301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:37.367301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:37.367301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:37.367301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:37.375664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 318/651] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:37.375664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc45551-2680-40de-8ffb-42d5f0490a43 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:37.376125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 333/651] 10.222.0.39 () {56 vars in 1137 bytes} [Tue May 31 20:39:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:37.378204 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0cd88-6568-402a-b1fd-65fbd14e699d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:37.428420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:37.485522 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0cd88-6568-402a-b1fd-65fbd14e699d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:37.500609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:37.510312 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc45551-2680-40de-8ffb-42d5f0490a43 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:37.527118 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a315fa3-874e-4da4-bc6d-4965ea071160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:37.527989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a315fa3-874e-4da4-bc6d-4965ea071160 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:37.528443 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a315fa3-874e-4da4-bc6d-4965ea071160 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:37.529237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a315fa3-874e-4da4-bc6d-4965ea071160 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:37.530429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a315fa3-874e-4da4-bc6d-4965ea071160 None admin] RBAC: Adding query filter params (name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:37.530881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a315fa3-874e-4da4-bc6d-4965ea071160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:37.532830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a315fa3-874e-4da4-bc6d-4965ea071160 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:37.544553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 334/652] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:37.545598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a315fa3-874e-4da4-bc6d-4965ea071160 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:37.555423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241953a-6125-4c72-8bb7-e7835b678d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:37.556646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241953a-6125-4c72-8bb7-e7835b678d7a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:37.556767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241953a-6125-4c72-8bb7-e7835b678d7a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:37.557148 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241953a-6125-4c72-8bb7-e7835b678d7a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:37.565022 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241953a-6125-4c72-8bb7-e7835b678d7a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:37.566619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241953a-6125-4c72-8bb7-e7835b678d7a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e241953a-6125-4c72-8bb7-e7835b678d7a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:37.582278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:37.583441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:37.584591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:37.584591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:37.584591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:37.584591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:37.584591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:37.584591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:37.584591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:37.584591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:37.584591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:39:37.584591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:37.586237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 319/653] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:37.587755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241953a-6125-4c72-8bb7-e7835b678d7a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:37.668103 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a315fa3-874e-4da4-bc6d-4965ea071160 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:37.678305 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:37.706219 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f96bd-fb3a-4b38-b6bd-cfc96842e2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:37.707526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f96bd-fb3a-4b38-b6bd-cfc96842e2bf None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:37.708501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f96bd-fb3a-4b38-b6bd-cfc96842e2bf None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:37.709207 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f96bd-fb3a-4b38-b6bd-cfc96842e2bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:37.715021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241953a-6125-4c72-8bb7-e7835b678d7a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:37.756600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a4ef0-a266-4cff-b825-e81558fb7cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:37.757625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a4ef0-a266-4cff-b825-e81558fb7cb0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:37.758060 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a4ef0-a266-4cff-b825-e81558fb7cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:37.759058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a4ef0-a266-4cff-b825-e81558fb7cb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:37.770273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a4ef0-a266-4cff-b825-e81558fb7cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:37.771841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a4ef0-a266-4cff-b825-e81558fb7cb0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-ec6a4ef0-a266-4cff-b825-e81558fb7cb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:37.790306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:37.791844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:37.792936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:37.792936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:37.792936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:37.792936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:37.797872 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f96bd-fb3a-4b38-b6bd-cfc96842e2bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:37.798682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 320/654] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:37.799631 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a4ef0-a266-4cff-b825-e81558fb7cb0 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:37.799837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f96bd-fb3a-4b38-b6bd-cfc96842e2bf None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:37.809932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:37.917145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a4ef0-a266-4cff-b825-e81558fb7cb0 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:37.948617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 335/655] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:37.948617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f96bd-fb3a-4b38-b6bd-cfc96842e2bf None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:37.959128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:37.964829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e299-7a51-40e3-bc08-9c93696a9bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:37.966128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e299-7a51-40e3-bc08-9c93696a9bcb None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:37.966857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e299-7a51-40e3-bc08-9c93696a9bcb None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:37.968044 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e299-7a51-40e3-bc08-9c93696a9bcb None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:37.969429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5e299-7a51-40e3-bc08-9c93696a9bcb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:37.969942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5e299-7a51-40e3-bc08-9c93696a9bcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:37.972035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5e299-7a51-40e3-bc08-9c93696a9bcb None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:37.997842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 321/656] 10.222.0.39 () {56 vars in 1137 bytes} [Tue May 31 20:39:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:37.997842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e299-7a51-40e3-bc08-9c93696a9bcb None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:38.077760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f96bd-fb3a-4b38-b6bd-cfc96842e2bf None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:38.079845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:38.125446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549587e8-44bc-48d9-b860-2ec5e1e5568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:38.126387 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549587e8-44bc-48d9-b860-2ec5e1e5568a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:38.126820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549587e8-44bc-48d9-b860-2ec5e1e5568a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:38.127206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e299-7a51-40e3-bc08-9c93696a9bcb None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:38.127433 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549587e8-44bc-48d9-b860-2ec5e1e5568a None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:38.128342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549587e8-44bc-48d9-b860-2ec5e1e5568a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:38.129052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549587e8-44bc-48d9-b860-2ec5e1e5568a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:38.131499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549587e8-44bc-48d9-b860-2ec5e1e5568a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:38.153218 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 336/657] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:38.154861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549587e8-44bc-48d9-b860-2ec5e1e5568a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:38.169068 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d152e-51f0-45e4-bb75-d4b5debad226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:38.170058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d152e-51f0-45e4-bb75-d4b5debad226 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:38.170414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d152e-51f0-45e4-bb75-d4b5debad226 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:38.171098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d152e-51f0-45e4-bb75-d4b5debad226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:38.184735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d152e-51f0-45e4-bb75-d4b5debad226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:38.186994 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d152e-51f0-45e4-bb75-d4b5debad226 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-607d152e-51f0-45e4-bb75-d4b5debad226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:38.210482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:38.211586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:38.212506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:38.212506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:38.212506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:38.212506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:38.217063 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 322/658] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:38.218593 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d152e-51f0-45e4-bb75-d4b5debad226 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:38.242380 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:38.280328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549587e8-44bc-48d9-b860-2ec5e1e5568a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:38.317778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee995f76-31f8-49c1-8c77-76aa2908913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:38.318446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995f76-31f8-49c1-8c77-76aa2908913c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:38.318706 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995f76-31f8-49c1-8c77-76aa2908913c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:38.318978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995f76-31f8-49c1-8c77-76aa2908913c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:38.331871 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d152e-51f0-45e4-bb75-d4b5debad226 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:38.349477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:38.369981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3de98-0bbe-4c68-92cf-8b53d42fdf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:38.370871 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3de98-0bbe-4c68-92cf-8b53d42fdf8e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:38.371263 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3de98-0bbe-4c68-92cf-8b53d42fdf8e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:38.371606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3de98-0bbe-4c68-92cf-8b53d42fdf8e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:38.380386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3de98-0bbe-4c68-92cf-8b53d42fdf8e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:38.382077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3de98-0bbe-4c68-92cf-8b53d42fdf8e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:38.393716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee995f76-31f8-49c1-8c77-76aa2908913c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:38.395171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee995f76-31f8-49c1-8c77-76aa2908913c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-c8c3de98-0bbe-4c68-92cf-8b53d42fdf8e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:38.397398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:38.398345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:38.399872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:38.399872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:38.399872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:38.399872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:38.399872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:38.399872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:38.399872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:38.399872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:38.399872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 31 20:39:38.399872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:38.399872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 323/659] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:38.400468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3de98-0bbe-4c68-92cf-8b53d42fdf8e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:38.468042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:38.506877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 337/660] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:38.506877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8692f88-e0b0-4ec5-b9ba-59eb60aed62a None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:38.506877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8692f88-e0b0-4ec5-b9ba-59eb60aed62a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:38.506877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8692f88-e0b0-4ec5-b9ba-59eb60aed62a None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:38.506877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 338/661] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:38.506877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8692f88-e0b0-4ec5-b9ba-59eb60aed62a None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:38.518308 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3de98-0bbe-4c68-92cf-8b53d42fdf8e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:38.553711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4934e-764b-42b5-8bea-34332063d94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:38.554361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4934e-764b-42b5-8bea-34332063d94f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:38.554639 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4934e-764b-42b5-8bea-34332063d94f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:38.554909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4934e-764b-42b5-8bea-34332063d94f None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:38.555648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4934e-764b-42b5-8bea-34332063d94f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:38.555951 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4934e-764b-42b5-8bea-34332063d94f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:38.557329 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4934e-764b-42b5-8bea-34332063d94f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:38.575570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 324/662] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:38.576442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4934e-764b-42b5-8bea-34332063d94f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:38.613396 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:38.621437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8692f88-e0b0-4ec5-b9ba-59eb60aed62a None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:38.666055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f896198-5c80-4507-90f9-903833e5baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:38.667169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f896198-5c80-4507-90f9-903833e5baba None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:38.667637 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f896198-5c80-4507-90f9-903833e5baba None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:38.668106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f896198-5c80-4507-90f9-903833e5baba None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:38.669429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f896198-5c80-4507-90f9-903833e5baba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:38.669845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f896198-5c80-4507-90f9-903833e5baba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:38.672251 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f896198-5c80-4507-90f9-903833e5baba None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:38.705677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 339/663] 10.222.0.39 () {56 vars in 1139 bytes} [Tue May 31 20:39:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:38.705863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4934e-764b-42b5-8bea-34332063d94f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:38.705943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df45d7-fb7a-4926-8581-2cc4fc98626c None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:38.705943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df45d7-fb7a-4926-8581-2cc4fc98626c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:38.705943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df45d7-fb7a-4926-8581-2cc4fc98626c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:38.726300 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-43df45d7-fb7a-4926-8581-2cc4fc98626c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:38.728248 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-43df45d7-fb7a-4926-8581-2cc4fc98626c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:38.749502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc468fa-4bc4-4b55-bff1-9c2a52ffaef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:38.750319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc468fa-4bc4-4b55-bff1-9c2a52ffaef9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:38.750605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc468fa-4bc4-4b55-bff1-9c2a52ffaef9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:38.750883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc468fa-4bc4-4b55-bff1-9c2a52ffaef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:38.755996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:38.762788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc468fa-4bc4-4b55-bff1-9c2a52ffaef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:38.764454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc468fa-4bc4-4b55-bff1-9c2a52ffaef9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-1bc468fa-4bc4-4b55-bff1-9c2a52ffaef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:38.784197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:38.785173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:38.786123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:38.786123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:38.786123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:38.786123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:38.786123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 325/664] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:38.786396 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc468fa-4bc4-4b55-bff1-9c2a52ffaef9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:38.821540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 340/665] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:38.822409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df45d7-fb7a-4926-8581-2cc4fc98626c None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:38.887807 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:38.899362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc468fa-4bc4-4b55-bff1-9c2a52ffaef9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:38.934476 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df45d7-fb7a-4926-8581-2cc4fc98626c None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:38.935873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0966b5-237b-45bc-90b4-8ff85b9581bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:38.936657 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0966b5-237b-45bc-90b4-8ff85b9581bf None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:38.936935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0966b5-237b-45bc-90b4-8ff85b9581bf None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:38.937215 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0966b5-237b-45bc-90b4-8ff85b9581bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:38.943940 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0966b5-237b-45bc-90b4-8ff85b9581bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:38.945388 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0966b5-237b-45bc-90b4-8ff85b9581bf None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-3e0966b5-237b-45bc-90b4-8ff85b9581bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:38.959653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:38.960594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:38.962321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:38.962321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:38.962321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:38.962321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:38.962321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:38.962321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:38.962321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:38.962321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:38.962321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 326/666] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:38.962321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0966b5-237b-45bc-90b4-8ff85b9581bf None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:38.977339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc3aaa-446d-49d5-af19-5bfd8d4dc573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:38.977952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc3aaa-446d-49d5-af19-5bfd8d4dc573 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:38.978238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc3aaa-446d-49d5-af19-5bfd8d4dc573 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:38.978520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc3aaa-446d-49d5-af19-5bfd8d4dc573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:39.004906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:39.052505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc3aaa-446d-49d5-af19-5bfd8d4dc573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:39.054010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc3aaa-446d-49d5-af19-5bfd8d4dc573 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:39.069297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0966b5-237b-45bc-90b4-8ff85b9581bf None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:39.106850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb1ec0-2413-41a4-bc14-ccc5b158eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:39.107516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb1ec0-2413-41a4-bc14-ccc5b158eee6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:39.107798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb1ec0-2413-41a4-bc14-ccc5b158eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:39.108079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb1ec0-2413-41a4-bc14-ccc5b158eee6 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:39.108796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb1ec0-2413-41a4-bc14-ccc5b158eee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:39.109105 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb1ec0-2413-41a4-bc14-ccc5b158eee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:39.110503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb1ec0-2413-41a4-bc14-ccc5b158eee6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:39.121944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 327/667] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:39.122716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb1ec0-2413-41a4-bc14-ccc5b158eee6 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:39.133152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:39.156909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 341/668] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:39.157874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc3aaa-446d-49d5-af19-5bfd8d4dc573 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:39.215005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:39.223569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb1ec0-2413-41a4-bc14-ccc5b158eee6 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:39.258922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc3aaa-446d-49d5-af19-5bfd8d4dc573 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:39.259760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b1401-7cf8-49ab-9d76-34ed15884df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:39.260557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b1401-7cf8-49ab-9d76-34ed15884df9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:39.260842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b1401-7cf8-49ab-9d76-34ed15884df9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:39.261852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b1401-7cf8-49ab-9d76-34ed15884df9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:39.271224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b1401-7cf8-49ab-9d76-34ed15884df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-a59b1401-7cf8-49ab-9d76-34ed15884df9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:39.279453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:39.280436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:39.281280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:39.281280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:39.281280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:39.281280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:39.281280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:39.281280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:39.281280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:39.281280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:39.281280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:39.281280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:39.281280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:39.281280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:39.281280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 328/669] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:39.282017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555101a-fd99-4159-a019-facc97ba73fe None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:39.282551 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555101a-fd99-4159-a019-facc97ba73fe None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:39.282551 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555101a-fd99-4159-a019-facc97ba73fe None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:39.283638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 329/670] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:39.284327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555101a-fd99-4159-a019-facc97ba73fe None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:39.298342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6e461-4e3d-471b-b839-775f192849c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:39.298998 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6e461-4e3d-471b-b839-775f192849c0 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:39.299284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6e461-4e3d-471b-b839-775f192849c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:39.299558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6e461-4e3d-471b-b839-775f192849c0 None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:39.300335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6e461-4e3d-471b-b839-775f192849c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:39.300640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6e461-4e3d-471b-b839-775f192849c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:39.302145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6e461-4e3d-471b-b839-775f192849c0 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:39.319501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 342/671] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:39.319501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6e461-4e3d-471b-b839-775f192849c0 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:39.358146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:39.392648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555101a-fd99-4159-a019-facc97ba73fe None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:39.413933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6e461-4e3d-471b-b839-775f192849c0 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:39.426714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff387f-e1e0-4705-8e3b-be4861732ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:39.427501 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff387f-e1e0-4705-8e3b-be4861732ebc None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:39.427786 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff387f-e1e0-4705-8e3b-be4861732ebc None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:39.428060 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff387f-e1e0-4705-8e3b-be4861732ebc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:39.431563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:39.436921 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff387f-e1e0-4705-8e3b-be4861732ebc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:39.438622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff387f-e1e0-4705-8e3b-be4861732ebc None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:39.453316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c7645-b875-405d-88b2-c5895737bc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-27ff387f-e1e0-4705-8e3b-be4861732ebc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:39.453883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:39.455090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:39.456163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:39.456163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:39.456163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:39.456163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:39.456163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:39.456163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:39.456163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:39.456163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:39.456696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c7645-b875-405d-88b2-c5895737bc1e None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:39.456696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c7645-b875-405d-88b2-c5895737bc1e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:39.456696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c7645-b875-405d-88b2-c5895737bc1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:39.457151 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 330/672] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:39.458329 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff387f-e1e0-4705-8e3b-be4861732ebc None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:39.466162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c7645-b875-405d-88b2-c5895737bc1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:39.467776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c7645-b875-405d-88b2-c5895737bc1e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-437c7645-b875-405d-88b2-c5895737bc1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:39.485506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:39.486429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:39.487325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:39.487325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:39.487325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:39.487325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:39.487325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 343/673] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:39.487921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e2b0-60c0-4981-bf98-474229666196 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:39.488227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e2b0-60c0-4981-bf98-474229666196 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:39.488415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e2b0-60c0-4981-bf98-474229666196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:39.504658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-8d09e2b0-60c0-4981-bf98-474229666196 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:39.505868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8d09e2b0-60c0-4981-bf98-474229666196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:39.561257 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff387f-e1e0-4705-8e3b-be4861732ebc None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:39.571940 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 344/674] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:39.573026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09e2b0-60c0-4981-bf98-474229666196 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:39.588062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:39.596086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc099df1-ba6d-4da2-bb40-499091643744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:39.596767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc099df1-ba6d-4da2-bb40-499091643744 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:39.597033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc099df1-ba6d-4da2-bb40-499091643744 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:39.597309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc099df1-ba6d-4da2-bb40-499091643744 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:39.599438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc099df1-ba6d-4da2-bb40-499091643744 None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:39.599438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc099df1-ba6d-4da2-bb40-499091643744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:39.599717 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc099df1-ba6d-4da2-bb40-499091643744 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:39.608659 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 331/675] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:39.609620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc099df1-ba6d-4da2-bb40-499091643744 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:39.672746 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:39.675611 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09e2b0-60c0-4981-bf98-474229666196 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:39.709280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc099df1-ba6d-4da2-bb40-499091643744 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:39.709963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91619c6-65bf-4bc6-b4c1-cacdbefe03b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:39.710621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91619c6-65bf-4bc6-b4c1-cacdbefe03b4 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:39.710902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91619c6-65bf-4bc6-b4c1-cacdbefe03b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:39.711724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91619c6-65bf-4bc6-b4c1-cacdbefe03b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:39.712562 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91619c6-65bf-4bc6-b4c1-cacdbefe03b4 None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=01a22cd803304a19a58bfbe17addb11f) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:39.712874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91619c6-65bf-4bc6-b4c1-cacdbefe03b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:39.714339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91619c6-65bf-4bc6-b4c1-cacdbefe03b4 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:39.720589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 345/676] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:39 2022] GET /identity/v3/role_assignments?user.id=01a22cd803304a19a58bfbe17addb11f&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:39.721202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91619c6-65bf-4bc6-b4c1-cacdbefe03b4 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:39.761872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f3e3d-4da6-4e02-bfae-4edfa9d2f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:39.762548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f3e3d-4da6-4e02-bfae-4edfa9d2f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:39.762832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f3e3d-4da6-4e02-bfae-4edfa9d2f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:39.763104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f3e3d-4da6-4e02-bfae-4edfa9d2f4d6 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:39.763907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f3e3d-4da6-4e02-bfae-4edfa9d2f4d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:39.764217 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f3e3d-4da6-4e02-bfae-4edfa9d2f4d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:39.765809 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f3e3d-4da6-4e02-bfae-4edfa9d2f4d6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:39.782392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 332/677] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:39.783271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f3e3d-4da6-4e02-bfae-4edfa9d2f4d6 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:39.852591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91619c6-65bf-4bc6-b4c1-cacdbefe03b4 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:39.854873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:39.900236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b070fa-b251-4879-b82a-4c4957c55815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:39.901084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b070fa-b251-4879-b82a-4c4957c55815 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:39.901340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b070fa-b251-4879-b82a-4c4957c55815 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:39.901651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b070fa-b251-4879-b82a-4c4957c55815 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:39.902384 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b070fa-b251-4879-b82a-4c4957c55815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:39.902687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b070fa-b251-4879-b82a-4c4957c55815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:39.904104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b070fa-b251-4879-b82a-4c4957c55815 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:39.912804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f3e3d-4da6-4e02-bfae-4edfa9d2f4d6 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:39.919101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 346/678] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:39.919101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b070fa-b251-4879-b82a-4c4957c55815 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:39.947765 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:39.958593 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a036e09-809f-4478-98cc-eb7eecd138d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:39.972595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a036e09-809f-4478-98cc-eb7eecd138d7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:39.972595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a036e09-809f-4478-98cc-eb7eecd138d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:39.972595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a036e09-809f-4478-98cc-eb7eecd138d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:39.972595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a036e09-809f-4478-98cc-eb7eecd138d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-6a036e09-809f-4478-98cc-eb7eecd138d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:39.978944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:39.979891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 333/679] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:39.980730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a036e09-809f-4478-98cc-eb7eecd138d7 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:40.036832 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b070fa-b251-4879-b82a-4c4957c55815 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:40.071700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee2d1c-33ac-41b9-82d4-2c2ae8cb1967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:40.072737 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee2d1c-33ac-41b9-82d4-2c2ae8cb1967 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:40.073026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee2d1c-33ac-41b9-82d4-2c2ae8cb1967 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:40.073293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee2d1c-33ac-41b9-82d4-2c2ae8cb1967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:40.083780 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee2d1c-33ac-41b9-82d4-2c2ae8cb1967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:40.085216 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee2d1c-33ac-41b9-82d4-2c2ae8cb1967 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:40.097485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a036e09-809f-4478-98cc-eb7eecd138d7 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-d1ee2d1c-33ac-41b9-82d4-2c2ae8cb1967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:40.103140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:40.104031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:40.104938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:40.104938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:40.104938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:40.104938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:40.108717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 347/680] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:40.109428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:40.109726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee2d1c-33ac-41b9-82d4-2c2ae8cb1967 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:40.136205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf12d49-b831-482a-b724-402acb5de30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:40.136859 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12d49-b831-482a-b724-402acb5de30b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:40.137146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12d49-b831-482a-b724-402acb5de30b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:40.137490 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12d49-b831-482a-b724-402acb5de30b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:40.138316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf12d49-b831-482a-b724-402acb5de30b None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=7cfcecd035214e2181622eb6b30ddf62) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:40.138636 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf12d49-b831-482a-b724-402acb5de30b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:40.140191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf12d49-b831-482a-b724-402acb5de30b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:40.146304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 334/681] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:39 2022] GET /identity/v3/role_assignments?user.id=7cfcecd035214e2181622eb6b30ddf62&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:40.150297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf12d49-b831-482a-b724-402acb5de30b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:40.194961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:40.223811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee2d1c-33ac-41b9-82d4-2c2ae8cb1967 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:40.277309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1f511-8153-4066-81f7-f9be58b9954f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:40.278516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf12d49-b831-482a-b724-402acb5de30b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:40.278634 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1f511-8153-4066-81f7-f9be58b9954f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:40.279060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1f511-8153-4066-81f7-f9be58b9954f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:40.279509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1f511-8153-4066-81f7-f9be58b9954f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:40.289283 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1f511-8153-4066-81f7-f9be58b9954f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:40.290921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1f511-8153-4066-81f7-f9be58b9954f None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-47b1f511-8153-4066-81f7-f9be58b9954f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:40.312976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:40.314003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:40.314991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:40.314991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:40.314991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:40.314991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:40.314991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:40.314991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:40.314991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:40.314991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:40.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 348/682] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:40.320087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1f511-8153-4066-81f7-f9be58b9954f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:40.329264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b778f4-4757-4550-8231-de611277939b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:40.330315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b778f4-4757-4550-8231-de611277939b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:40.330806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b778f4-4757-4550-8231-de611277939b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:40.331228 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b778f4-4757-4550-8231-de611277939b None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:40.332150 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b778f4-4757-4550-8231-de611277939b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:40.332625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b778f4-4757-4550-8231-de611277939b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:40.334488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b778f4-4757-4550-8231-de611277939b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:40.349975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 335/683] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:40.350770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b778f4-4757-4550-8231-de611277939b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:40.395413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:40.449966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1f511-8153-4066-81f7-f9be58b9954f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:40.487318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e710c61-fd47-41dc-bfc1-3b5798b27536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:40.487988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e710c61-fd47-41dc-bfc1-3b5798b27536 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:40.488276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e710c61-fd47-41dc-bfc1-3b5798b27536 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:40.488542 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b778f4-4757-4550-8231-de611277939b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:40.488661 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e710c61-fd47-41dc-bfc1-3b5798b27536 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:40.489275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e710c61-fd47-41dc-bfc1-3b5798b27536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:40.489619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e710c61-fd47-41dc-bfc1-3b5798b27536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:40.491997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e710c61-fd47-41dc-bfc1-3b5798b27536 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:40.494400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:40.507592 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 349/684] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:40.508741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e710c61-fd47-41dc-bfc1-3b5798b27536 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:40.535592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f91ac9-7043-4710-bc58-928136f93497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:40.536768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f91ac9-7043-4710-bc58-928136f93497 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:40.537053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f91ac9-7043-4710-bc58-928136f93497 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:40.537324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f91ac9-7043-4710-bc58-928136f93497 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:40.538427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f91ac9-7043-4710-bc58-928136f93497 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:40.538744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f91ac9-7043-4710-bc58-928136f93497 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:40.541711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f91ac9-7043-4710-bc58-928136f93497 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:40.561471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 336/685] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:40.562364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f91ac9-7043-4710-bc58-928136f93497 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:40.642721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e710c61-fd47-41dc-bfc1-3b5798b27536 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:40.673809 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:40.680164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f91ac9-7043-4710-bc58-928136f93497 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:40.680353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8019139-9585-410c-be5c-7645deeb0615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:40.681144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8019139-9585-410c-be5c-7645deeb0615 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:40.681459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8019139-9585-410c-be5c-7645deeb0615 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:40.681735 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8019139-9585-410c-be5c-7645deeb0615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:40.695033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8019139-9585-410c-be5c-7645deeb0615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:40.696541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8019139-9585-410c-be5c-7645deeb0615 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-d8019139-9585-410c-be5c-7645deeb0615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:40.714757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:40.715885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:40.716970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:40.716970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:40.716970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:40.716970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:40.716970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 350/686] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:40.717263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8019139-9585-410c-be5c-7645deeb0615 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:40.719290 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdb19a-514c-49fc-ad4a-00ed55ef07b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:40.720251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdb19a-514c-49fc-ad4a-00ed55ef07b0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:40.720702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdb19a-514c-49fc-ad4a-00ed55ef07b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:40.721132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdb19a-514c-49fc-ad4a-00ed55ef07b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:40.729736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babdb19a-514c-49fc-ad4a-00ed55ef07b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:40.731380 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babdb19a-514c-49fc-ad4a-00ed55ef07b0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-babdb19a-514c-49fc-ad4a-00ed55ef07b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:40.747261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:40.748444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:40.749645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:40.749645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:40.749645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:40.749645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:40.749645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:40.749645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:40.749645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:40.749645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:40.749645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 20:39:40.749645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:40.751753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 337/687] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:40.752847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdb19a-514c-49fc-ad4a-00ed55ef07b0 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:40.768919 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:40.834234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8019139-9585-410c-be5c-7645deeb0615 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:40.871501 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdb19a-514c-49fc-ad4a-00ed55ef07b0 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:40.874860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40dc57-322b-4b86-82d5-4136381fd6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:40.875200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40dc57-322b-4b86-82d5-4136381fd6f6 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:40.875488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40dc57-322b-4b86-82d5-4136381fd6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:40.875766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40dc57-322b-4b86-82d5-4136381fd6f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:40.876598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40dc57-322b-4b86-82d5-4136381fd6f6 None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=16a77c08d2844e7cb81ac1370c527cdf) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:40.876914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40dc57-322b-4b86-82d5-4136381fd6f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:40.878587 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40dc57-322b-4b86-82d5-4136381fd6f6 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:40.886166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 351/688] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:40 2022] GET /identity/v3/role_assignments?user.id=16a77c08d2844e7cb81ac1370c527cdf&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:40.887164 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40dc57-322b-4b86-82d5-4136381fd6f6 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:40.927165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660d14b-e302-4584-9cb4-2096090cb0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:40.928526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660d14b-e302-4584-9cb4-2096090cb0ca None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:40.929043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660d14b-e302-4584-9cb4-2096090cb0ca None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:40.929554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660d14b-e302-4584-9cb4-2096090cb0ca None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:40.931051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660d14b-e302-4584-9cb4-2096090cb0ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:40.931584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660d14b-e302-4584-9cb4-2096090cb0ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:40.933168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660d14b-e302-4584-9cb4-2096090cb0ca None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:40.962339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 338/689] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:40.969406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660d14b-e302-4584-9cb4-2096090cb0ca None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:41.013432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:41.052036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40dc57-322b-4b86-82d5-4136381fd6f6 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:41.077811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:41.132038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556d01c-a828-4b0f-8ddc-ad7207117e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:41.132720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556d01c-a828-4b0f-8ddc-ad7207117e8c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:41.133583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556d01c-a828-4b0f-8ddc-ad7207117e8c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:41.133848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556d01c-a828-4b0f-8ddc-ad7207117e8c None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:41.134687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556d01c-a828-4b0f-8ddc-ad7207117e8c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:41.134995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556d01c-a828-4b0f-8ddc-ad7207117e8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:41.136459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556d01c-a828-4b0f-8ddc-ad7207117e8c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:41.161347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 352/690] 10.222.0.39 () {56 vars in 1135 bytes} [Tue May 31 20:39:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:41.171083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556d01c-a828-4b0f-8ddc-ad7207117e8c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:41.174092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660d14b-e302-4584-9cb4-2096090cb0ca None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:41.227958 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71951cf1-7222-4113-8012-8274e2533157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:41.230093 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71951cf1-7222-4113-8012-8274e2533157 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:41.230686 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71951cf1-7222-4113-8012-8274e2533157 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:41.231376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71951cf1-7222-4113-8012-8274e2533157 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:41.243767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71951cf1-7222-4113-8012-8274e2533157 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:41.245203 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71951cf1-7222-4113-8012-8274e2533157 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-71951cf1-7222-4113-8012-8274e2533157 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:41.261874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:41.262841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:41.263768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:41.263768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:41.263768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:41.263768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:41.263768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:41.263768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:41.263768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:41.263768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:41.263768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:39:41.263768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:41.267567 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 339/691] 10.222.0.39 () {56 vars in 1093 bytes} [Tue May 31 20:39:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:41.268751 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71951cf1-7222-4113-8012-8274e2533157 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:41.313582 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556d01c-a828-4b0f-8ddc-ad7207117e8c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:41.351970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbed5f-ec95-4898-94dd-96895d47e409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:41.353617 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:41.354624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbed5f-ec95-4898-94dd-96895d47e409 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:41.355117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbed5f-ec95-4898-94dd-96895d47e409 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:41.355664 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbed5f-ec95-4898-94dd-96895d47e409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:41.379066 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71951cf1-7222-4113-8012-8274e2533157 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:41.395984 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:41.415956 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d20b1-2d69-4a40-bbe5-3a05bcaedce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:41.416525 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d20b1-2d69-4a40-bbe5-3a05bcaedce0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:41.416811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d20b1-2d69-4a40-bbe5-3a05bcaedce0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:41.417096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d20b1-2d69-4a40-bbe5-3a05bcaedce0 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:41.418008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d20b1-2d69-4a40-bbe5-3a05bcaedce0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:41.418313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d20b1-2d69-4a40-bbe5-3a05bcaedce0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:41.419826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d20b1-2d69-4a40-bbe5-3a05bcaedce0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:41.439454 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbed5f-ec95-4898-94dd-96895d47e409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:41.441246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbed5f-ec95-4898-94dd-96895d47e409 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:41.443382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 340/692] 10.222.0.39 () {56 vars in 1133 bytes} [Tue May 31 20:39:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:41.446309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d20b1-2d69-4a40-bbe5-3a05bcaedce0 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:41.555187 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d20b1-2d69-4a40-bbe5-3a05bcaedce0 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:41.556288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 353/693] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:41.561896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbed5f-ec95-4898-94dd-96895d47e409 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:41.599397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cc80f-f571-4f93-8468-d61a4a415b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:41.600046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cc80f-f571-4f93-8468-d61a4a415b57 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:41.600451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cc80f-f571-4f93-8468-d61a4a415b57 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:41.600942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cc80f-f571-4f93-8468-d61a4a415b57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:41.604486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:41.684057 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:41.725011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbed5f-ec95-4898-94dd-96895d47e409 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:41.738518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cc80f-f571-4f93-8468-d61a4a415b57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:41.740028 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cc80f-f571-4f93-8468-d61a4a415b57 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:41.772865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407408e-ee3a-44ac-8159-d9f00242f00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:41.773777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407408e-ee3a-44ac-8159-d9f00242f00d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:41.774061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407408e-ee3a-44ac-8159-d9f00242f00d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:41.774332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407408e-ee3a-44ac-8159-d9f00242f00d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:41.792326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407408e-ee3a-44ac-8159-d9f00242f00d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:41.794775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407408e-ee3a-44ac-8159-d9f00242f00d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-c407408e-ee3a-44ac-8159-d9f00242f00d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:41.830410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:41.831398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:41.832304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:41.832304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:41.832304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:41.832304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:41.833099 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 354/694] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:41.847810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407408e-ee3a-44ac-8159-d9f00242f00d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:41.929825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 341/695] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:41.931969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cc80f-f571-4f93-8468-d61a4a415b57 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:41.971676 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:42.088703 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407408e-ee3a-44ac-8159-d9f00242f00d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:42.122883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cc80f-f571-4f93-8468-d61a4a415b57 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:42.132133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:42.150130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b212e-8d80-4ec4-b50a-b6d224566623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:42.150800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b212e-8d80-4ec4-b50a-b6d224566623 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:42.153547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b212e-8d80-4ec4-b50a-b6d224566623 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:42.153547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b212e-8d80-4ec4-b50a-b6d224566623 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:42.153547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b212e-8d80-4ec4-b50a-b6d224566623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:42.153547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b212e-8d80-4ec4-b50a-b6d224566623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:42.153957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b212e-8d80-4ec4-b50a-b6d224566623 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:42.167387 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 355/696] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:42.177402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b212e-8d80-4ec4-b50a-b6d224566623 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:42.187270 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5ee15-2c47-4b13-aea2-fde83488b7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:42.188070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5ee15-2c47-4b13-aea2-fde83488b7ce None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:42.188357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5ee15-2c47-4b13-aea2-fde83488b7ce None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:42.188635 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5ee15-2c47-4b13-aea2-fde83488b7ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:42.207629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5ee15-2c47-4b13-aea2-fde83488b7ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:42.210371 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5ee15-2c47-4b13-aea2-fde83488b7ce None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-40f5ee15-2c47-4b13-aea2-fde83488b7ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:42.236242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:42.237288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:42.238233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:42.238233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:42.238233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:42.238233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:42.239029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 342/697] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:42.240570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6a08f-f5fe-4609-b765-a0fb77760f02 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:42.240859 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6a08f-f5fe-4609-b765-a0fb77760f02 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:42.241571 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6a08f-f5fe-4609-b765-a0fb77760f02 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:42.243641 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 343/698] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:42.246645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6a08f-f5fe-4609-b765-a0fb77760f02 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:42.296387 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b212e-8d80-4ec4-b50a-b6d224566623 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:42.333700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510432ff-0ab5-48f3-9f7e-321ffda3e30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:42.334542 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510432ff-0ab5-48f3-9f7e-321ffda3e30e None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:42.334827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510432ff-0ab5-48f3-9f7e-321ffda3e30e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:42.335099 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510432ff-0ab5-48f3-9f7e-321ffda3e30e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:42.342298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510432ff-0ab5-48f3-9f7e-321ffda3e30e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:42.343678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510432ff-0ab5-48f3-9f7e-321ffda3e30e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:42.350030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-510432ff-0ab5-48f3-9f7e-321ffda3e30e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:42.358023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:42.368978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:42.370126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:42.370126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:42.370126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:42.370126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:42.370126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:42.370126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:42.370126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:42.370126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:42.370126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 356/699] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:42.370126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d05f1-a276-4455-9545-8873249cdbcd None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:42.370126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d05f1-a276-4455-9545-8873249cdbcd None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:42.370780 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d05f1-a276-4455-9545-8873249cdbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:42.371792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6a08f-f5fe-4609-b765-a0fb77760f02 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:42.379199 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-5a7d05f1-a276-4455-9545-8873249cdbcd None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:42.380425 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5a7d05f1-a276-4455-9545-8873249cdbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:42.409944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91eb35-178e-4024-834a-5ecdda803be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:42.410860 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91eb35-178e-4024-834a-5ecdda803be7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:42.411294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91eb35-178e-4024-834a-5ecdda803be7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:42.411743 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91eb35-178e-4024-834a-5ecdda803be7 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:42.412616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91eb35-178e-4024-834a-5ecdda803be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:42.413153 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91eb35-178e-4024-834a-5ecdda803be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:42.415337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91eb35-178e-4024-834a-5ecdda803be7 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:42.419673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:42.435493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 344/700] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:42.436801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91eb35-178e-4024-834a-5ecdda803be7 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:42.465494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 357/701] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:42.466486 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d05f1-a276-4455-9545-8873249cdbcd None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:42.557192 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91eb35-178e-4024-834a-5ecdda803be7 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:42.586250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d05f1-a276-4455-9545-8873249cdbcd None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:42.595895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985bc54-8b42-4b3e-a8ad-8d5ef0be66f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:42.596835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985bc54-8b42-4b3e-a8ad-8d5ef0be66f6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:42.597304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985bc54-8b42-4b3e-a8ad-8d5ef0be66f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:42.597849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985bc54-8b42-4b3e-a8ad-8d5ef0be66f6 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:42.598778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985bc54-8b42-4b3e-a8ad-8d5ef0be66f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:42.599322 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985bc54-8b42-4b3e-a8ad-8d5ef0be66f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:42.600996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985bc54-8b42-4b3e-a8ad-8d5ef0be66f6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:42.615800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 345/702] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:42.617646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985bc54-8b42-4b3e-a8ad-8d5ef0be66f6 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:42.625266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae43e6-c77e-4343-8869-15e88efba18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:42.626138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae43e6-c77e-4343-8869-15e88efba18d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:42.626416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae43e6-c77e-4343-8869-15e88efba18d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:42.626687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae43e6-c77e-4343-8869-15e88efba18d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:42.628733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:42.634131 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae43e6-c77e-4343-8869-15e88efba18d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:42.635618 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae43e6-c77e-4343-8869-15e88efba18d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-0aae43e6-c77e-4343-8869-15e88efba18d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:42.650948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:42.652094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:42.653579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:42.653579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:42.653579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:42.653579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:42.653579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:42.653579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:42.653579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:42.653579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:42.656896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 358/703] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:42.657948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae43e6-c77e-4343-8869-15e88efba18d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:42.690887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:42.740631 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985bc54-8b42-4b3e-a8ad-8d5ef0be66f6 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:42.777530 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41780c4-240e-4751-84a6-2492032e4191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:42.778607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41780c4-240e-4751-84a6-2492032e4191 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:42.778902 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41780c4-240e-4751-84a6-2492032e4191 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:42.779181 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41780c4-240e-4751-84a6-2492032e4191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:42.780293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae43e6-c77e-4343-8869-15e88efba18d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:42.790527 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41780c4-240e-4751-84a6-2492032e4191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:42.791985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41780c4-240e-4751-84a6-2492032e4191 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e41780c4-240e-4751-84a6-2492032e4191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:42.814645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:42.815606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:42.816485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:42.816485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:42.816485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:42.816485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:42.816485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 346/704] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:42.816765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41780c4-240e-4751-84a6-2492032e4191 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:42.827496 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794096a4-b3f9-4f95-a994-396acd2c41ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:42.828210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794096a4-b3f9-4f95-a994-396acd2c41ff None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:42.828538 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794096a4-b3f9-4f95-a994-396acd2c41ff None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:42.830738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794096a4-b3f9-4f95-a994-396acd2c41ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:42.830738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794096a4-b3f9-4f95-a994-396acd2c41ff None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=90867ac821dd4adb8d52075fbd85caba) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:42.830738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794096a4-b3f9-4f95-a994-396acd2c41ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:42.831579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794096a4-b3f9-4f95-a994-396acd2c41ff None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:42.845419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 359/705] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:42 2022] GET /identity/v3/role_assignments?user.id=90867ac821dd4adb8d52075fbd85caba&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:42.845419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee26514-2542-427b-925e-203c004a9873 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:42.845419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee26514-2542-427b-925e-203c004a9873 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:42.845419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee26514-2542-427b-925e-203c004a9873 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:42.845419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 360/706] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:42.845419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee26514-2542-427b-925e-203c004a9873 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:42.889568 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:42.938392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41780c4-240e-4751-84a6-2492032e4191 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:42.959445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:42.961200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee26514-2542-427b-925e-203c004a9873 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:42.996822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13817b-da23-45b6-bdc8-00280a90e2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:42.998116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13817b-da23-45b6-bdc8-00280a90e2f4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:42.998721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13817b-da23-45b6-bdc8-00280a90e2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:42.999230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13817b-da23-45b6-bdc8-00280a90e2f4 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:43.000309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13817b-da23-45b6-bdc8-00280a90e2f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:43.000967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13817b-da23-45b6-bdc8-00280a90e2f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:43.002413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c24a7-8009-4fc0-b5f1-736b2144de46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:43.003078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c24a7-8009-4fc0-b5f1-736b2144de46 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:43.003359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c24a7-8009-4fc0-b5f1-736b2144de46 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:43.003632 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c24a7-8009-4fc0-b5f1-736b2144de46 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:43.004030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13817b-da23-45b6-bdc8-00280a90e2f4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:43.004353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c24a7-8009-4fc0-b5f1-736b2144de46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:43.004659 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c24a7-8009-4fc0-b5f1-736b2144de46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:43.006167 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c24a7-8009-4fc0-b5f1-736b2144de46 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:43.019575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 361/707] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:43.021036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 347/708] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:43.028406 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efec6a-328b-41f1-ae99-a02d70044209 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:43.028628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13817b-da23-45b6-bdc8-00280a90e2f4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:43.028712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efec6a-328b-41f1-ae99-a02d70044209 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:43.028712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efec6a-328b-41f1-ae99-a02d70044209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:43.044805 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-c3efec6a-328b-41f1-ae99-a02d70044209 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:43.046143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c3efec6a-328b-41f1-ae99-a02d70044209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:43.125132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 362/709] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:43.130349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efec6a-328b-41f1-ae99-a02d70044209 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:43.154840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13817b-da23-45b6-bdc8-00280a90e2f4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:43.179131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:43.200195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdfcfc-db3f-4015-a09b-2c9c25d687fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:43.201062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdfcfc-db3f-4015-a09b-2c9c25d687fe None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:43.202808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdfcfc-db3f-4015-a09b-2c9c25d687fe None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:43.202808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdfcfc-db3f-4015-a09b-2c9c25d687fe None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:43.202808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdfcfc-db3f-4015-a09b-2c9c25d687fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:43.205799 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdfcfc-db3f-4015-a09b-2c9c25d687fe None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:43.249229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:43.265649 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efec6a-328b-41f1-ae99-a02d70044209 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:43.295188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 348/710] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:39:43 2022] POST /identity/v3/users => generated 254 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:39:43.296107 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdfcfc-db3f-4015-a09b-2c9c25d687fe None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:43.316451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ce112-b114-4c88-a21f-cc49754a143e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:43.317202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ce112-b114-4c88-a21f-cc49754a143e None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:43.317560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ce112-b114-4c88-a21f-cc49754a143e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:43.317884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ce112-b114-4c88-a21f-cc49754a143e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:43.319038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ce112-b114-4c88-a21f-cc49754a143e None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=8c86c12743bd4ee8843dba4a7af5d7a0) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:43.319414 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ce112-b114-4c88-a21f-cc49754a143e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:43.325455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ce112-b114-4c88-a21f-cc49754a143e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:43.330320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 363/711] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:43 2022] GET /identity/v3/role_assignments?user.id=8c86c12743bd4ee8843dba4a7af5d7a0&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:43.449549 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdfcfc-db3f-4015-a09b-2c9c25d687fe None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:43.489722 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfad366-832e-4016-b0f6-e0d703fe0861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:43.490552 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfad366-832e-4016-b0f6-e0d703fe0861 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:43.490832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfad366-832e-4016-b0f6-e0d703fe0861 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:43.491105 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfad366-832e-4016-b0f6-e0d703fe0861 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:43.491861 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfad366-832e-4016-b0f6-e0d703fe0861 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:43.494074 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfad366-832e-4016-b0f6-e0d703fe0861 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-6cfad366-832e-4016-b0f6-e0d703fe0861 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:43.510362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:43.511529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:43.512449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 349/712] 10.222.0.39 () {56 vars in 1129 bytes} [Tue May 31 20:39:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:43.520502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ce112-b114-4c88-a21f-cc49754a143e None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:43.652046 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ce112-b114-4c88-a21f-cc49754a143e None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:43.689669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a29c21-c44a-4b8b-aedb-49d1b030d7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:43.690337 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a29c21-c44a-4b8b-aedb-49d1b030d7e6 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:43.690622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a29c21-c44a-4b8b-aedb-49d1b030d7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:43.690894 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a29c21-c44a-4b8b-aedb-49d1b030d7e6 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:43.691599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a29c21-c44a-4b8b-aedb-49d1b030d7e6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:43.691906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a29c21-c44a-4b8b-aedb-49d1b030d7e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:43.693275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a29c21-c44a-4b8b-aedb-49d1b030d7e6 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:43.698538 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 364/713] 10.222.0.39 () {56 vars in 1124 bytes} [Tue May 31 20:39:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:43.704174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfad366-832e-4016-b0f6-e0d703fe0861 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:43.750850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:43.818277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfad366-832e-4016-b0f6-e0d703fe0861 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:43.856570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a484a-2527-4f62-b6a5-7ddfbfc17d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:43.857237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a484a-2527-4f62-b6a5-7ddfbfc17d7b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:43.857550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a484a-2527-4f62-b6a5-7ddfbfc17d7b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:43.857829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a484a-2527-4f62-b6a5-7ddfbfc17d7b None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:43.858534 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a484a-2527-4f62-b6a5-7ddfbfc17d7b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:43.858841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a484a-2527-4f62-b6a5-7ddfbfc17d7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:43.860218 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a484a-2527-4f62-b6a5-7ddfbfc17d7b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:43.866323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 350/714] 10.222.0.39 () {56 vars in 1124 bytes} [Tue May 31 20:39:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:43.871568 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d819a39-507f-489c-8d09-a066b6db63a2 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:43.871859 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d819a39-507f-489c-8d09-a066b6db63a2 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:43.872164 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d819a39-507f-489c-8d09-a066b6db63a2 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:43.873802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 365/715] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:43.879909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61822265-43f2-470a-b358-8ca1521fa9db None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:43.880555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61822265-43f2-470a-b358-8ca1521fa9db None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:43.881032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61822265-43f2-470a-b358-8ca1521fa9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:43.917091 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-61822265-43f2-470a-b358-8ca1521fa9db None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:43.918711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-61822265-43f2-470a-b358-8ca1521fa9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:44.036017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 351/716] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:44.064586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d819a39-507f-489c-8d09-a066b6db63a2 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:44.086579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:44.200446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d819a39-507f-489c-8d09-a066b6db63a2 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:44.237501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e4cb9-b87f-40d8-940d-4385cf5aa734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:44.238307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e4cb9-b87f-40d8-940d-4385cf5aa734 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:44.238687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e4cb9-b87f-40d8-940d-4385cf5aa734 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:44.238968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e4cb9-b87f-40d8-940d-4385cf5aa734 None admin] PATH_INFO: `/v3/services/network` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:44.239621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e4cb9-b87f-40d8-940d-4385cf5aa734 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:44.241007 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e4cb9-b87f-40d8-940d-4385cf5aa734 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-105e4cb9-b87f-40d8-940d-4385cf5aa734 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:44.255724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:44.256729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:44.257621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 366/717] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:44 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:44.263652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61822265-43f2-470a-b358-8ca1521fa9db None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:44.300538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:44.400428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61822265-43f2-470a-b358-8ca1521fa9db None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:44.441986 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ae388-cb39-43fb-abde-fb74f66ed8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:44.442646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae388-cb39-43fb-abde-fb74f66ed8be None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:44.442924 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae388-cb39-43fb-abde-fb74f66ed8be None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:44.443195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae388-cb39-43fb-abde-fb74f66ed8be None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:44.443896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ae388-cb39-43fb-abde-fb74f66ed8be None admin] RBAC: Adding query filter params (name=network) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:44.444199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ae388-cb39-43fb-abde-fb74f66ed8be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:44.445619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ae388-cb39-43fb-abde-fb74f66ed8be None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:44.453046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 352/718] 10.222.0.39 () {56 vars in 1112 bytes} [Tue May 31 20:39:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:44.458618 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e4cb9-b87f-40d8-940d-4385cf5aa734 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:44.560793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:44.587965 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e4cb9-b87f-40d8-940d-4385cf5aa734 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:44.642397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e0b93-1917-4302-b82f-cc177a703075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:44.643092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e0b93-1917-4302-b82f-cc177a703075 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:44.643381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e0b93-1917-4302-b82f-cc177a703075 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:44.643658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e0b93-1917-4302-b82f-cc177a703075 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:44.644377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e0b93-1917-4302-b82f-cc177a703075 None admin] RBAC: Adding query filter params (type=network) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:44.644686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e0b93-1917-4302-b82f-cc177a703075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:44.646129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e0b93-1917-4302-b82f-cc177a703075 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:44.657783 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 367/719] 10.222.0.39 () {56 vars in 1112 bytes} [Tue May 31 20:39:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:45.717128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfd177-5bf8-4eae-a019-eaf27c1b4bd0 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:45.717701 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfd177-5bf8-4eae-a019-eaf27c1b4bd0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:45.717701 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfd177-5bf8-4eae-a019-eaf27c1b4bd0 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:45.719321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 353/720] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:45.724789 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaacbc3-f6f6-48d7-b72e-1cb332f31b19 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:45.725191 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaacbc3-f6f6-48d7-b72e-1cb332f31b19 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:45.725359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaacbc3-f6f6-48d7-b72e-1cb332f31b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:45.743458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-8eaacbc3-f6f6-48d7-b72e-1cb332f31b19 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:45.744662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8eaacbc3-f6f6-48d7-b72e-1cb332f31b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:45.821996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 368/721] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:39:45.842250 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfd177-5bf8-4eae-a019-eaf27c1b4bd0 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:45.977831 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:45.982239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfd177-5bf8-4eae-a019-eaf27c1b4bd0 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:46.028390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf984f0-1a36-4dfe-9401-210213f52af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:46.029173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf984f0-1a36-4dfe-9401-210213f52af7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:46.029477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf984f0-1a36-4dfe-9401-210213f52af7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:46.029749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf984f0-1a36-4dfe-9401-210213f52af7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:46.049115 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf984f0-1a36-4dfe-9401-210213f52af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-0cf984f0-1a36-4dfe-9401-210213f52af7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:46.056637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:46.057575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:46.058425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:46.058425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:46.058425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:46.058425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:46.058425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:46.058425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:46.058425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:46.058425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:46.058425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:46.058425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:46.058425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:46.058425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:46.058425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 354/722] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:46.063982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaacbc3-f6f6-48d7-b72e-1cb332f31b19 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:46.204276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:46.245100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaacbc3-f6f6-48d7-b72e-1cb332f31b19 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:46.292461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cb059-d5b1-46db-ae86-fe24aeb149d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:46.293134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cb059-d5b1-46db-ae86-fe24aeb149d0 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:46.293436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cb059-d5b1-46db-ae86-fe24aeb149d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:46.293717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cb059-d5b1-46db-ae86-fe24aeb149d0 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:46.294470 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cb059-d5b1-46db-ae86-fe24aeb149d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:46.294775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cb059-d5b1-46db-ae86-fe24aeb149d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:46.296149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cb059-d5b1-46db-ae86-fe24aeb149d0 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:46.315853 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 369/723] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:46.320986 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf984f0-1a36-4dfe-9401-210213f52af7 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:46.367441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbee1e-8b77-4669-97b9-34bd66f5307d None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:46.368024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbee1e-8b77-4669-97b9-34bd66f5307d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:46.368483 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbee1e-8b77-4669-97b9-34bd66f5307d None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:46.371266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 370/724] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:46.375816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccb000-4cb6-4ef1-8e27-41b154ceb644 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:46.376306 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccb000-4cb6-4ef1-8e27-41b154ceb644 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:46.376762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccb000-4cb6-4ef1-8e27-41b154ceb644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:46.394286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-3fccb000-4cb6-4ef1-8e27-41b154ceb644 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:46.395851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3fccb000-4cb6-4ef1-8e27-41b154ceb644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:46.481620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 371/725] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:46.501492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccb000-4cb6-4ef1-8e27-41b154ceb644 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:46.558311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf984f0-1a36-4dfe-9401-210213f52af7 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:46.571582 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:46.593144 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc6a90-5f17-419e-8960-ea8f63734a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:46.594147 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6a90-5f17-419e-8960-ea8f63734a69 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:46.594577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6a90-5f17-419e-8960-ea8f63734a69 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:46.594989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6a90-5f17-419e-8960-ea8f63734a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:46.606478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc6a90-5f17-419e-8960-ea8f63734a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:46.608083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc6a90-5f17-419e-8960-ea8f63734a69 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:46.614667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccb000-4cb6-4ef1-8e27-41b154ceb644 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-8fdc6a90-5f17-419e-8960-ea8f63734a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:46.626603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:46.627718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:46.628837 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:46.628837 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:46.628837 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:46.628837 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:46.630639 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 355/726] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:46.632029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ef6ab-b372-4ed3-a6c3-7a47443f2e95 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:46.633036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ef6ab-b372-4ed3-a6c3-7a47443f2e95 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:46.633477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ef6ab-b372-4ed3-a6c3-7a47443f2e95 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:46.635158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 356/727] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:46.636541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ef6ab-b372-4ed3-a6c3-7a47443f2e95 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:46.648723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:46.664374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b175677-98fd-4d73-ba46-d300f8e9811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:46.665182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b175677-98fd-4d73-ba46-d300f8e9811d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:46.665503 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b175677-98fd-4d73-ba46-d300f8e9811d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:46.665778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b175677-98fd-4d73-ba46-d300f8e9811d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:46.678306 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b175677-98fd-4d73-ba46-d300f8e9811d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-4b175677-98fd-4d73-ba46-d300f8e9811d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:46.687174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:46.688326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:46.689397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:46.689397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:46.689397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:46.689397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:46.689397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:46.689397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:46.689397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:46.689397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:46.689397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:46.689397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:46.689397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:46.689397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:46.692003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 372/728] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:46.693444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1f2ca-fbff-41d5-988c-ff3590092c5d None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:46.693900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1f2ca-fbff-41d5-988c-ff3590092c5d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:46.694435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1f2ca-fbff-41d5-988c-ff3590092c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:46.713074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-17c1f2ca-fbff-41d5-988c-ff3590092c5d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:46.714512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-17c1f2ca-fbff-41d5-988c-ff3590092c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:46.748574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ef6ab-b372-4ed3-a6c3-7a47443f2e95 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:46.784622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4056cda-51cb-4729-8e98-325be89a5870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:46.785664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4056cda-51cb-4729-8e98-325be89a5870 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:46.786146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4056cda-51cb-4729-8e98-325be89a5870 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:46.786615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4056cda-51cb-4729-8e98-325be89a5870 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:46.787560 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4056cda-51cb-4729-8e98-325be89a5870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:46.788062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4056cda-51cb-4729-8e98-325be89a5870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:46.790290 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4056cda-51cb-4729-8e98-325be89a5870 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:46.797772 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 373/729] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:46.798696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1f2ca-fbff-41d5-988c-ff3590092c5d None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:46.803406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 357/730] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:46.814668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4056cda-51cb-4729-8e98-325be89a5870 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:46.865095 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:46.888291 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:46.918982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1f2ca-fbff-41d5-988c-ff3590092c5d None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:46.925543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4056cda-51cb-4729-8e98-325be89a5870 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:46.957416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d565e14-4327-457f-87e3-7a52e21fa6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:46.958129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565e14-4327-457f-87e3-7a52e21fa6fe None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:46.958440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565e14-4327-457f-87e3-7a52e21fa6fe None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:46.958721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565e14-4327-457f-87e3-7a52e21fa6fe None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:46.959564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d565e14-4327-457f-87e3-7a52e21fa6fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:46.959876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d565e14-4327-457f-87e3-7a52e21fa6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:46.961299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d565e14-4327-457f-87e3-7a52e21fa6fe None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:46.967764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2691c5-3a7b-4336-b90a-3bab31147258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:46.968729 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2691c5-3a7b-4336-b90a-3bab31147258 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:46.969152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2691c5-3a7b-4336-b90a-3bab31147258 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:46.969599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2691c5-3a7b-4336-b90a-3bab31147258 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:46.970747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 374/731] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:46.972091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ae027-93ae-4b9c-b45f-497a726286d3 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:46.972373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ae027-93ae-4b9c-b45f-497a726286d3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:46.972648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ae027-93ae-4b9c-b45f-497a726286d3 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:46.978635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 375/732] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:46.979477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ae027-93ae-4b9c-b45f-497a726286d3 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:46.983207 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2691c5-3a7b-4336-b90a-3bab31147258 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:46.984646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2691c5-3a7b-4336-b90a-3bab31147258 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-2d2691c5-3a7b-4336-b90a-3bab31147258 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:47.000171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:47.001332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:47.002432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:47.002432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:47.002432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:47.002432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:47.002432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:47.002432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:47.002432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:47.002432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:47.002432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 20:39:47.002432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:47.008974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 358/733] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:47.009830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2691c5-3a7b-4336-b90a-3bab31147258 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:47.088143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ae027-93ae-4b9c-b45f-497a726286d3 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:47.104594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:47.122063 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2691c5-3a7b-4336-b90a-3bab31147258 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:47.127423 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68898d39-91cb-49c1-9b1b-7461f7a4282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:47.128351 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68898d39-91cb-49c1-9b1b-7461f7a4282f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:47.128636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68898d39-91cb-49c1-9b1b-7461f7a4282f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:47.129043 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68898d39-91cb-49c1-9b1b-7461f7a4282f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:47.142547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68898d39-91cb-49c1-9b1b-7461f7a4282f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-68898d39-91cb-49c1-9b1b-7461f7a4282f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:47.151660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:47.153533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 376/734] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:47.154915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1d258-bea1-4f7f-ac5e-49e0fc6f7c57 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:47.156202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1d258-bea1-4f7f-ac5e-49e0fc6f7c57 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:47.156202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1d258-bea1-4f7f-ac5e-49e0fc6f7c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:47.157519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:47.167727 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01958-9b3b-4ac6-9dae-6da29d0c43ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:47.169128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01958-9b3b-4ac6-9dae-6da29d0c43ee None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:47.172376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01958-9b3b-4ac6-9dae-6da29d0c43ee None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:47.172376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01958-9b3b-4ac6-9dae-6da29d0c43ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:47.174404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a3e1d258-bea1-4f7f-ac5e-49e0fc6f7c57 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:47.175602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a3e1d258-bea1-4f7f-ac5e-49e0fc6f7c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:47.181608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e01958-9b3b-4ac6-9dae-6da29d0c43ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:47.183070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e01958-9b3b-4ac6-9dae-6da29d0c43ee None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e6e01958-9b3b-4ac6-9dae-6da29d0c43ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:47.202047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:47.203067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:47.203976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:47.203976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:47.203976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:47.203976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:47.203976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 359/735] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:47.203976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01958-9b3b-4ac6-9dae-6da29d0c43ee None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:47.252793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 377/736] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:47.254189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1d258-bea1-4f7f-ac5e-49e0fc6f7c57 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:47.326442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01958-9b3b-4ac6-9dae-6da29d0c43ee None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:47.363074 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547e51f-2463-4b3d-b273-077146200c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:47.363764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547e51f-2463-4b3d-b273-077146200c45 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:47.364045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547e51f-2463-4b3d-b273-077146200c45 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:47.364316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547e51f-2463-4b3d-b273-077146200c45 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:47.365141 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547e51f-2463-4b3d-b273-077146200c45 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:47.365478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547e51f-2463-4b3d-b273-077146200c45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:47.367544 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547e51f-2463-4b3d-b273-077146200c45 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:47.378982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1d258-bea1-4f7f-ac5e-49e0fc6f7c57 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:47.381303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:47.392021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 360/737] 10.222.0.39 () {56 vars in 1135 bytes} [Tue May 31 20:39:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:47.392021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547e51f-2463-4b3d-b273-077146200c45 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:47.414555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f2f12-21af-4e6e-8ab4-21836c011f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:47.415313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f2f12-21af-4e6e-8ab4-21836c011f79 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:47.415598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f2f12-21af-4e6e-8ab4-21836c011f79 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:47.415872 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f2f12-21af-4e6e-8ab4-21836c011f79 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:47.416614 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f2f12-21af-4e6e-8ab4-21836c011f79 None admin] RBAC: Adding query filter params (name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:47.416925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f2f12-21af-4e6e-8ab4-21836c011f79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:47.418320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f2f12-21af-4e6e-8ab4-21836c011f79 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:47.426812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 378/738] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:47.427587 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f2f12-21af-4e6e-8ab4-21836c011f79 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:47.440543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:47.500195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547e51f-2463-4b3d-b273-077146200c45 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:47.528979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f2f12-21af-4e6e-8ab4-21836c011f79 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:47.537492 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff1bac-3a9f-41f3-97b4-9ded841f0342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:47.538156 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff1bac-3a9f-41f3-97b4-9ded841f0342 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:47.538443 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff1bac-3a9f-41f3-97b4-9ded841f0342 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:47.538716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff1bac-3a9f-41f3-97b4-9ded841f0342 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:47.539460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff1bac-3a9f-41f3-97b4-9ded841f0342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:47.539784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff1bac-3a9f-41f3-97b4-9ded841f0342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:47.541236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff1bac-3a9f-41f3-97b4-9ded841f0342 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:47.553358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 361/739] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:47.554796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff1bac-3a9f-41f3-97b4-9ded841f0342 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:47.565983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f35e8d-0d5c-461d-801d-855431804ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:47.566644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f35e8d-0d5c-461d-801d-855431804ee3 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:47.566929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f35e8d-0d5c-461d-801d-855431804ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:47.567209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f35e8d-0d5c-461d-801d-855431804ee3 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:47.567924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f35e8d-0d5c-461d-801d-855431804ee3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:47.569307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f35e8d-0d5c-461d-801d-855431804ee3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:47.650945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:47.653365 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 379/740] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:39:47 2022] POST /identity/v3/services => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:39:47.660138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e24246-e1eb-4cea-8617-af3ea0c56a56 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:47.660138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e24246-e1eb-4cea-8617-af3ea0c56a56 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:47.660138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e24246-e1eb-4cea-8617-af3ea0c56a56 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:47.660138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 380/741] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:47.660138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e24246-e1eb-4cea-8617-af3ea0c56a56 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:47.660527 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff1bac-3a9f-41f3-97b4-9ded841f0342 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:47.714109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:47.738852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70d3b6-367e-4158-8b7c-e00f1f534f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:47.739838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70d3b6-367e-4158-8b7c-e00f1f534f89 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:47.740238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70d3b6-367e-4158-8b7c-e00f1f534f89 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:47.740616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70d3b6-367e-4158-8b7c-e00f1f534f89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:47.828013 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e24246-e1eb-4cea-8617-af3ea0c56a56 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:47.846422 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70d3b6-367e-4158-8b7c-e00f1f534f89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:47.847920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70d3b6-367e-4158-8b7c-e00f1f534f89 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:47.874930 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b4906-eea0-453e-9f72-c466eb2287ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:47.876260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b4906-eea0-453e-9f72-c466eb2287ed None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:47.876260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b4906-eea0-453e-9f72-c466eb2287ed None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:47.876430 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b4906-eea0-453e-9f72-c466eb2287ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:47.889012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b4906-eea0-453e-9f72-c466eb2287ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:47.890652 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b4906-eea0-453e-9f72-c466eb2287ed None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-fd7b4906-eea0-453e-9f72-c466eb2287ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:47.912974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:47.914435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:47.915344 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:47.915344 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:47.915344 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:47.915344 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:47.915344 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 381/742] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:47.916133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b4906-eea0-453e-9f72-c466eb2287ed None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:47.959811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:47.971692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 362/743] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:47 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:39:47.971692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90ede-5eec-46a6-a704-c657ba4836f6 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:47.971692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90ede-5eec-46a6-a704-c657ba4836f6 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:47.971692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90ede-5eec-46a6-a704-c657ba4836f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:47.987229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-39c90ede-5eec-46a6-a704-c657ba4836f6 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:47.989004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-39c90ede-5eec-46a6-a704-c657ba4836f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:48.016130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:48.040109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b4906-eea0-453e-9f72-c466eb2287ed None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:48.065450 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 363/744] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:39:48.066730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c90ede-5eec-46a6-a704-c657ba4836f6 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:48.091986 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94269dc4-22a7-461f-a717-b039ed4d3a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:48.093249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94269dc4-22a7-461f-a717-b039ed4d3a93 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:48.093576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94269dc4-22a7-461f-a717-b039ed4d3a93 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:48.093862 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94269dc4-22a7-461f-a717-b039ed4d3a93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:48.102442 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94269dc4-22a7-461f-a717-b039ed4d3a93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:48.103911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94269dc4-22a7-461f-a717-b039ed4d3a93 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-94269dc4-22a7-461f-a717-b039ed4d3a93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:48.121781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:48.122786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:48.123782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:48.123782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:48.123782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:48.123782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:48.123782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:48.123782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:48.123782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:48.123782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:48.123782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:39:48.123782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:48.129655 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 382/745] 10.222.0.39 () {56 vars in 1093 bytes} [Tue May 31 20:39:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:48.130547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94269dc4-22a7-461f-a717-b039ed4d3a93 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:48.183319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c90ede-5eec-46a6-a704-c657ba4836f6 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:48.216162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:48.228061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6a16d-09e0-42b5-afb4-df31385b6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:48.228725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6a16d-09e0-42b5-afb4-df31385b6376 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:48.229013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6a16d-09e0-42b5-afb4-df31385b6376 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:48.229281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6a16d-09e0-42b5-afb4-df31385b6376 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:48.230030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6a16d-09e0-42b5-afb4-df31385b6376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:48.230336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6a16d-09e0-42b5-afb4-df31385b6376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:48.231768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6a16d-09e0-42b5-afb4-df31385b6376 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:48.242453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94269dc4-22a7-461f-a717-b039ed4d3a93 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:48.249128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 364/746] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:48.249953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6a16d-09e0-42b5-afb4-df31385b6376 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:48.282301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814d7e9-bea9-492e-ba31-f4bbb2b68b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:48.283327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814d7e9-bea9-492e-ba31-f4bbb2b68b81 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:48.283761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814d7e9-bea9-492e-ba31-f4bbb2b68b81 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:48.284188 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814d7e9-bea9-492e-ba31-f4bbb2b68b81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:48.292536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:48.296749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814d7e9-bea9-492e-ba31-f4bbb2b68b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:48.298345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814d7e9-bea9-492e-ba31-f4bbb2b68b81 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-8814d7e9-bea9-492e-ba31-f4bbb2b68b81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:48.324515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:48.325563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:48.326449 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:48.326449 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:48.326449 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:48.326449 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:48.328111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 383/747] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:48.329025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814d7e9-bea9-492e-ba31-f4bbb2b68b81 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:48.373132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6a16d-09e0-42b5-afb4-df31385b6376 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:48.411679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cae101-8d31-427b-ad05-2db31e98f49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:48.412340 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cae101-8d31-427b-ad05-2db31e98f49f None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:48.412625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cae101-8d31-427b-ad05-2db31e98f49f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:48.413054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cae101-8d31-427b-ad05-2db31e98f49f None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:48.414293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cae101-8d31-427b-ad05-2db31e98f49f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:48.415807 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cae101-8d31-427b-ad05-2db31e98f49f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:48.435835 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814d7e9-bea9-492e-ba31-f4bbb2b68b81 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:48.469729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7ae3a-5b63-4143-9660-abb35a3d4fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:48.470398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7ae3a-5b63-4143-9660-abb35a3d4fe6 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:48.470683 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7ae3a-5b63-4143-9660-abb35a3d4fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:48.471686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7ae3a-5b63-4143-9660-abb35a3d4fe6 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:48.471790 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7ae3a-5b63-4143-9660-abb35a3d4fe6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:48.472085 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7ae3a-5b63-4143-9660-abb35a3d4fe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:48.473576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7ae3a-5b63-4143-9660-abb35a3d4fe6 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:48.492312 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 384/748] 10.222.0.39 () {56 vars in 1133 bytes} [Tue May 31 20:39:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:48.494980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7ae3a-5b63-4143-9660-abb35a3d4fe6 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:48.501063 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 365/749] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:39:48 2022] POST /identity/v3/services => generated 240 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:39:48.501927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cae101-8d31-427b-ad05-2db31e98f49f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:48.565629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:48.573562 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:48.628738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7ae3a-5b63-4143-9660-abb35a3d4fe6 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:48.658316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cae101-8d31-427b-ad05-2db31e98f49f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:48.685314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b92a60-7d10-4284-896e-e807fa52f255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:48.686510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b92a60-7d10-4284-896e-e807fa52f255 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:48.686956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b92a60-7d10-4284-896e-e807fa52f255 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:48.687386 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b92a60-7d10-4284-896e-e807fa52f255 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:48.700597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b92a60-7d10-4284-896e-e807fa52f255 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:48.702660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b92a60-7d10-4284-896e-e807fa52f255 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:48.708085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429834c6-d93c-45ff-8f53-471248dd4d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:48.709185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429834c6-d93c-45ff-8f53-471248dd4d93 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:48.709731 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429834c6-d93c-45ff-8f53-471248dd4d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:48.710589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429834c6-d93c-45ff-8f53-471248dd4d93 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:48.711328 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429834c6-d93c-45ff-8f53-471248dd4d93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:48.712210 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429834c6-d93c-45ff-8f53-471248dd4d93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:48.713055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429834c6-d93c-45ff-8f53-471248dd4d93 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-a6b92a60-7d10-4284-896e-e807fa52f255 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:48.725761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:48.726762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:48.727740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:48.727740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:48.727740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:48.727740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:48.727740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:48.727740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:48.727740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:48.727740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:48.727740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:39:48.727740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:48.727740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 385/750] 10.222.0.39 () {56 vars in 1117 bytes} [Tue May 31 20:39:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:48.728326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b92a60-7d10-4284-896e-e807fa52f255 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:48.731777 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 366/751] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:48.737584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429834c6-d93c-45ff-8f53-471248dd4d93 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:48.858255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b92a60-7d10-4284-896e-e807fa52f255 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:48.874681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:48.877787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429834c6-d93c-45ff-8f53-471248dd4d93 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:48.878273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:48.912210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f478c00-2504-4201-8603-6abcb9ca1d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:48.913766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f478c00-2504-4201-8603-6abcb9ca1d31 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:48.914160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f478c00-2504-4201-8603-6abcb9ca1d31 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:48.914532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f478c00-2504-4201-8603-6abcb9ca1d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:48.917249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717735d-f094-4147-92c3-c06b42e9bbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:48.918600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717735d-f094-4147-92c3-c06b42e9bbfc None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:48.919054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717735d-f094-4147-92c3-c06b42e9bbfc None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:48.919500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717735d-f094-4147-92c3-c06b42e9bbfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:48.928352 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f478c00-2504-4201-8603-6abcb9ca1d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:48.929891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717735d-f094-4147-92c3-c06b42e9bbfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:48.930566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f478c00-2504-4201-8603-6abcb9ca1d31 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:48.931343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717735d-f094-4147-92c3-c06b42e9bbfc None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e717735d-f094-4147-92c3-c06b42e9bbfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:48.946760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:48.947643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:48.948599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:48.948599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:48.948599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:48.948599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:48.948599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:48.948599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:48.948599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:48.948599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:48.948599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 367/752] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:48.949918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717735d-f094-4147-92c3-c06b42e9bbfc None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-8f478c00-2504-4201-8603-6abcb9ca1d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:48.951656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:48.953327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:48.954903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:48.954903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:48.954903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:48.954903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:48.954903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 386/753] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:48.957745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f478c00-2504-4201-8603-6abcb9ca1d31 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:49.062194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717735d-f094-4147-92c3-c06b42e9bbfc None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:49.092332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f478c00-2504-4201-8603-6abcb9ca1d31 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:49.101773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7096b-3453-4a3b-a658-58ba6b15e9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:49.102547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7096b-3453-4a3b-a658-58ba6b15e9ab None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:49.102834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7096b-3453-4a3b-a658-58ba6b15e9ab None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:49.103106 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7096b-3453-4a3b-a658-58ba6b15e9ab None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:49.104043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7096b-3453-4a3b-a658-58ba6b15e9ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:49.104366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7096b-3453-4a3b-a658-58ba6b15e9ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:49.105972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7096b-3453-4a3b-a658-58ba6b15e9ab None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:49.125758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 368/754] 10.222.0.39 () {56 vars in 1149 bytes} [Tue May 31 20:39:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:49.126680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7096b-3453-4a3b-a658-58ba6b15e9ab None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:49.135109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59639f5-e5d3-41aa-a9c3-679b1ee7c990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:49.135774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59639f5-e5d3-41aa-a9c3-679b1ee7c990 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:49.136056 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59639f5-e5d3-41aa-a9c3-679b1ee7c990 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:49.136912 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59639f5-e5d3-41aa-a9c3-679b1ee7c990 None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:49.137745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59639f5-e5d3-41aa-a9c3-679b1ee7c990 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:49.138061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59639f5-e5d3-41aa-a9c3-679b1ee7c990 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:49.140462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59639f5-e5d3-41aa-a9c3-679b1ee7c990 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:49.148370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:49.157508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 387/755] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:49.158963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59639f5-e5d3-41aa-a9c3-679b1ee7c990 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:49.188540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:49.238367 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7096b-3453-4a3b-a658-58ba6b15e9ab None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:49.272544 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59639f5-e5d3-41aa-a9c3-679b1ee7c990 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:49.276243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21712ed-4a8f-4a4b-afa6-21ef223b86c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:49.277140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21712ed-4a8f-4a4b-afa6-21ef223b86c5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:49.277599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21712ed-4a8f-4a4b-afa6-21ef223b86c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:49.278023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21712ed-4a8f-4a4b-afa6-21ef223b86c5 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:49.279043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21712ed-4a8f-4a4b-afa6-21ef223b86c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:49.279500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21712ed-4a8f-4a4b-afa6-21ef223b86c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:49.281084 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21712ed-4a8f-4a4b-afa6-21ef223b86c5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:49.295865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 369/756] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:49.297045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21712ed-4a8f-4a4b-afa6-21ef223b86c5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:49.310135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b822ce9-cbdd-4944-bedc-cb590aed1cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:49.310968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b822ce9-cbdd-4944-bedc-cb590aed1cd1 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:49.311328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b822ce9-cbdd-4944-bedc-cb590aed1cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:49.311679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b822ce9-cbdd-4944-bedc-cb590aed1cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:49.385989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b822ce9-cbdd-4944-bedc-cb590aed1cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:49.387380 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:49.388298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b822ce9-cbdd-4944-bedc-cb590aed1cd1 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:49.410227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:49.412817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21712ed-4a8f-4a4b-afa6-21ef223b86c5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:49.450156 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272e556-702e-4e2c-9ff9-75b9aa067391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:49.451104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272e556-702e-4e2c-9ff9-75b9aa067391 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:49.451583 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272e556-702e-4e2c-9ff9-75b9aa067391 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:49.452042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272e556-702e-4e2c-9ff9-75b9aa067391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:49.453052 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272e556-702e-4e2c-9ff9-75b9aa067391 None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=90867ac821dd4adb8d52075fbd85caba) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:49.453602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272e556-702e-4e2c-9ff9-75b9aa067391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:49.455230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272e556-702e-4e2c-9ff9-75b9aa067391 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:49.462214 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 370/757] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:49 2022] GET /identity/v3/role_assignments?user.id=90867ac821dd4adb8d52075fbd85caba&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:49.463251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272e556-702e-4e2c-9ff9-75b9aa067391 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:49.497778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 388/758] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:39:49.510631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b822ce9-cbdd-4944-bedc-cb590aed1cd1 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:49.582296 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272e556-702e-4e2c-9ff9-75b9aa067391 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:49.621531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14507e3e-fe0d-4856-b0ca-1ff5bc4e4f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:49.622870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14507e3e-fe0d-4856-b0ca-1ff5bc4e4f77 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:49.623382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14507e3e-fe0d-4856-b0ca-1ff5bc4e4f77 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:49.623875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14507e3e-fe0d-4856-b0ca-1ff5bc4e4f77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:49.632693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14507e3e-fe0d-4856-b0ca-1ff5bc4e4f77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:49.634675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14507e3e-fe0d-4856-b0ca-1ff5bc4e4f77 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-14507e3e-fe0d-4856-b0ca-1ff5bc4e4f77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:49.651251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:49.652227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:49.653135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:49.653135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:49.653135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:49.653135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:49.653135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:49.653135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:49.653135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:49.653135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:49.655796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 371/759] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:49.661065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14507e3e-fe0d-4856-b0ca-1ff5bc4e4f77 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:49.679483 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:49.802186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b822ce9-cbdd-4944-bedc-cb590aed1cd1 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:49.807228 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14507e3e-fe0d-4856-b0ca-1ff5bc4e4f77 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:49.847900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:49.868222 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4944643-a9cb-4525-a5d3-1211001c0e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:49.868889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4944643-a9cb-4525-a5d3-1211001c0e57 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:49.869175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4944643-a9cb-4525-a5d3-1211001c0e57 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:49.869479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4944643-a9cb-4525-a5d3-1211001c0e57 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:49.870270 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4944643-a9cb-4525-a5d3-1211001c0e57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:49.870584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4944643-a9cb-4525-a5d3-1211001c0e57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:49.872040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4944643-a9cb-4525-a5d3-1211001c0e57 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:49.878026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e13b7-efe5-4dae-83b4-2ca499011752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:49.878869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e13b7-efe5-4dae-83b4-2ca499011752 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:49.879160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e13b7-efe5-4dae-83b4-2ca499011752 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:49.879436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e13b7-efe5-4dae-83b4-2ca499011752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:49.895983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e13b7-efe5-4dae-83b4-2ca499011752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:49.896522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 372/760] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:49.897863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e13b7-efe5-4dae-83b4-2ca499011752 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:49.898053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4944643-a9cb-4525-a5d3-1211001c0e57 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-c98e13b7-efe5-4dae-83b4-2ca499011752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:49.918728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:49.919713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:49.920657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:49.920657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:49.920657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:49.920657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:49.920657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 389/761] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:49.925677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e13b7-efe5-4dae-83b4-2ca499011752 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:50.029725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:50.062241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e13b7-efe5-4dae-83b4-2ca499011752 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:50.110540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4944643-a9cb-4525-a5d3-1211001c0e57 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:50.127065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb8513-354e-4273-8b7c-0b583a50e17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:50.127740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb8513-354e-4273-8b7c-0b583a50e17b None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:50.128021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb8513-354e-4273-8b7c-0b583a50e17b None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:50.128300 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb8513-354e-4273-8b7c-0b583a50e17b None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:50.129022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb8513-354e-4273-8b7c-0b583a50e17b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:50.129336 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb8513-354e-4273-8b7c-0b583a50e17b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:50.130756 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb8513-354e-4273-8b7c-0b583a50e17b None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:50.158485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 390/762] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:50.159376 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb8513-354e-4273-8b7c-0b583a50e17b None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:50.181798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75006901-d666-4d35-a258-6d602e021e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:50.182689 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75006901-d666-4d35-a258-6d602e021e88 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:50.182972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75006901-d666-4d35-a258-6d602e021e88 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:50.183248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75006901-d666-4d35-a258-6d602e021e88 None admin] PATH_INFO: `/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/8c86c12743bd4ee8843dba4a7af5d7a0/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:50.187410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75006901-d666-4d35-a258-6d602e021e88 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d14229f6554a34bf9084d36cffe8ac, user_id=8c86c12743bd4ee8843dba4a7af5d7a0, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:50.188869 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75006901-d666-4d35-a258-6d602e021e88 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:50.209276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:50.259538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 373/763] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:39:49 2022] PUT /identity/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/8c86c12743bd4ee8843dba4a7af5d7a0/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:39:50.261020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa38d2c-8d99-452a-9d65-239421493d66 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:50.273917 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa38d2c-8d99-452a-9d65-239421493d66 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:50.274386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa38d2c-8d99-452a-9d65-239421493d66 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:50.280258 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 374/764] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:50 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:50.291234 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17516d97-4e64-4a44-bedd-6f1646b9fe38 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:50.291688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17516d97-4e64-4a44-bedd-6f1646b9fe38 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:50.292132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17516d97-4e64-4a44-bedd-6f1646b9fe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:50.294910 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb8513-354e-4273-8b7c-0b583a50e17b None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:50.335281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-17516d97-4e64-4a44-bedd-6f1646b9fe38 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:50.336701 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-17516d97-4e64-4a44-bedd-6f1646b9fe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:50.345562 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e700773-bc08-42af-ae6f-573f6fb37740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:50.347511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e700773-bc08-42af-ae6f-573f6fb37740 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:50.348024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e700773-bc08-42af-ae6f-573f6fb37740 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:50.348465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e700773-bc08-42af-ae6f-573f6fb37740 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:50.357783 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e700773-bc08-42af-ae6f-573f6fb37740 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:50.359540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e700773-bc08-42af-ae6f-573f6fb37740 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-2e700773-bc08-42af-ae6f-573f6fb37740 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:50.377819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:50.378989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:50.380026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:50.380026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:50.380026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:50.380026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:50.380026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:50.380026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:50.380026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:50.380026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:50.382821 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 391/765] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:50.387903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e700773-bc08-42af-ae6f-573f6fb37740 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:50.512651 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 375/766] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:39:50.554747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:50.556344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17516d97-4e64-4a44-bedd-6f1646b9fe38 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:50.568175 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e700773-bc08-42af-ae6f-573f6fb37740 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:50.614222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5eed4-652f-42c3-b7d8-4189ae9ae78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:50.614977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5eed4-652f-42c3-b7d8-4189ae9ae78e None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:50.615169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5eed4-652f-42c3-b7d8-4189ae9ae78e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:50.615412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5eed4-652f-42c3-b7d8-4189ae9ae78e None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:50.616802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5eed4-652f-42c3-b7d8-4189ae9ae78e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:50.617117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5eed4-652f-42c3-b7d8-4189ae9ae78e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:50.619195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5eed4-652f-42c3-b7d8-4189ae9ae78e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:50.619766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:50.634577 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 392/767] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:50.642508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5eed4-652f-42c3-b7d8-4189ae9ae78e None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:50.708811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17516d97-4e64-4a44-bedd-6f1646b9fe38 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:50.771067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc7d5d-e0ae-4e2a-9c79-0b7742f48480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:50.772327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7d5d-e0ae-4e2a-9c79-0b7742f48480 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:50.772756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7d5d-e0ae-4e2a-9c79-0b7742f48480 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:50.773177 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7d5d-e0ae-4e2a-9c79-0b7742f48480 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:50.774287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc7d5d-e0ae-4e2a-9c79-0b7742f48480 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:50.776758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc7d5d-e0ae-4e2a-9c79-0b7742f48480 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e3cc7d5d-e0ae-4e2a-9c79-0b7742f48480 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:50.790723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:50.791887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:39:50.792927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:50.801045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 376/768] 10.222.0.39 () {56 vars in 1129 bytes} [Tue May 31 20:39:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:50.802650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc7d5d-e0ae-4e2a-9c79-0b7742f48480 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:50.875736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5eed4-652f-42c3-b7d8-4189ae9ae78e None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:50.945482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc7d5d-e0ae-4e2a-9c79-0b7742f48480 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:50.949262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba1ba1-1767-4539-ad6f-c6495d77dbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:50.950453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba1ba1-1767-4539-ad6f-c6495d77dbbd None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:50.950959 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba1ba1-1767-4539-ad6f-c6495d77dbbd None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:50.951432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba1ba1-1767-4539-ad6f-c6495d77dbbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:50.961411 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba1ba1-1767-4539-ad6f-c6495d77dbbd None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=9ba18c72dcba4cc4aa863783f325e780) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:50.962048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:50.962616 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba1ba1-1767-4539-ad6f-c6495d77dbbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:50.964906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba1ba1-1767-4539-ad6f-c6495d77dbbd None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:50.973895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 393/769] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:50 2022] GET /identity/v3/role_assignments?user.id=9ba18c72dcba4cc4aa863783f325e780&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:50.992895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83e5b2-c32d-4289-947b-43a8e8756dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:50.993710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83e5b2-c32d-4289-947b-43a8e8756dd4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:50.994103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83e5b2-c32d-4289-947b-43a8e8756dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:50.994475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83e5b2-c32d-4289-947b-43a8e8756dd4 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:50.995302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83e5b2-c32d-4289-947b-43a8e8756dd4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:50.995677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83e5b2-c32d-4289-947b-43a8e8756dd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:51.000158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83e5b2-c32d-4289-947b-43a8e8756dd4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:51.007747 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 377/770] 10.222.0.39 () {56 vars in 1124 bytes} [Tue May 31 20:39:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:51.013728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba1ba1-1767-4539-ad6f-c6495d77dbbd None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:51.047972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:51.050257 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35ebce-b020-4e11-a388-a05ea4f55697 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:51.050399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35ebce-b020-4e11-a388-a05ea4f55697 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:51.050567 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35ebce-b020-4e11-a388-a05ea4f55697 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:51.056104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 378/771] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:39:51.058008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17346394-aa0b-4e18-9d4f-68d3a970e6cc None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:51.058303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17346394-aa0b-4e18-9d4f-68d3a970e6cc None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:51.058584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17346394-aa0b-4e18-9d4f-68d3a970e6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:51.096853 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-17346394-aa0b-4e18-9d4f-68d3a970e6cc None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:51.098288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-17346394-aa0b-4e18-9d4f-68d3a970e6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:51.210438 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba1ba1-1767-4539-ad6f-c6495d77dbbd None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:51.219515 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 379/772] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:39:51.244473 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17346394-aa0b-4e18-9d4f-68d3a970e6cc None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:51.249345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d2c52-50d4-48c2-970f-ab9927371d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:51.250338 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d2c52-50d4-48c2-970f-ab9927371d5d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:51.250857 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d2c52-50d4-48c2-970f-ab9927371d5d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:51.251337 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d2c52-50d4-48c2-970f-ab9927371d5d None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:51.252247 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d2c52-50d4-48c2-970f-ab9927371d5d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:51.252810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d2c52-50d4-48c2-970f-ab9927371d5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:51.254543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d2c52-50d4-48c2-970f-ab9927371d5d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:51.264128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 394/773] 10.222.0.39 () {56 vars in 1124 bytes} [Tue May 31 20:39:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:51.269590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d2c52-50d4-48c2-970f-ab9927371d5d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:51.385663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17346394-aa0b-4e18-9d4f-68d3a970e6cc None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:51.398576 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:51.404851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:51.427477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f809bf6-caa5-4443-bb2a-59f6b6532f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:51.430044 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f809bf6-caa5-4443-bb2a-59f6b6532f9b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:51.430535 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f809bf6-caa5-4443-bb2a-59f6b6532f9b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:51.431639 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f809bf6-caa5-4443-bb2a-59f6b6532f9b None admin] PATH_INFO: `/v3/services/network` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:51.432496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f809bf6-caa5-4443-bb2a-59f6b6532f9b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:51.435530 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f809bf6-caa5-4443-bb2a-59f6b6532f9b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:51.439664 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d2c52-50d4-48c2-970f-ab9927371d5d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-7f809bf6-caa5-4443-bb2a-59f6b6532f9b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:51.456313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:51.457409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:51.458602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 380/774] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:51 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:51.463912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f809bf6-caa5-4443-bb2a-59f6b6532f9b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:51.496474 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb89510-4a7c-4004-9487-aaf52460fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:51.497543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89510-4a7c-4004-9487-aaf52460fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:51.497834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89510-4a7c-4004-9487-aaf52460fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:51.498110 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89510-4a7c-4004-9487-aaf52460fdd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:51.498963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb89510-4a7c-4004-9487-aaf52460fdd2 None admin] RBAC: Adding query filter params (interface=public, service_id=dff04835af6c4087be95caa57fc7dd98, region_id=RegionOne) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:51.499305 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb89510-4a7c-4004-9487-aaf52460fdd2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:51.500682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb89510-4a7c-4004-9487-aaf52460fdd2 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:51.510262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 395/775] 10.222.0.39 () {56 vars in 1251 bytes} [Tue May 31 20:39:51 2022] GET /identity/v3/endpoints?service_id=dff04835af6c4087be95caa57fc7dd98&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:51.516178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb89510-4a7c-4004-9487-aaf52460fdd2 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:51.643942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb89510-4a7c-4004-9487-aaf52460fdd2 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:51.703931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f809bf6-caa5-4443-bb2a-59f6b6532f9b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:51.720695 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464648-04fc-453f-9f00-d723e19d829a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:51.721286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464648-04fc-453f-9f00-d723e19d829a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:51.721589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464648-04fc-453f-9f00-d723e19d829a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:51.721864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464648-04fc-453f-9f00-d723e19d829a None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:51.722539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37464648-04fc-453f-9f00-d723e19d829a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:51.723900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37464648-04fc-453f-9f00-d723e19d829a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:51.734596 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 396/776] 10.222.0.39 () {56 vars in 1087 bytes} [Tue May 31 20:39:51 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:51.769474 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd650f-9f75-4892-be30-4f5f51580a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:51.770144 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd650f-9f75-4892-be30-4f5f51580a17 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:51.770426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd650f-9f75-4892-be30-4f5f51580a17 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:51.770699 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd650f-9f75-4892-be30-4f5f51580a17 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:51.771400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd650f-9f75-4892-be30-4f5f51580a17 None admin] RBAC: Adding query filter params (name=network) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:51.771704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd650f-9f75-4892-be30-4f5f51580a17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:51.773623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd650f-9f75-4892-be30-4f5f51580a17 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:51.784678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464648-04fc-453f-9f00-d723e19d829a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:51.785897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 381/777] 10.222.0.39 () {56 vars in 1112 bytes} [Tue May 31 20:39:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:51.806317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:51.925795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464648-04fc-453f-9f00-d723e19d829a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:51.964327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b244d-bb67-487d-8ac4-65f88e5e2238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:51.965922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b244d-bb67-487d-8ac4-65f88e5e2238 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:51.966434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b244d-bb67-487d-8ac4-65f88e5e2238 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:51.966926 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b244d-bb67-487d-8ac4-65f88e5e2238 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:51.967864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b244d-bb67-487d-8ac4-65f88e5e2238 None admin] RBAC: Adding query filter params (type=network) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:51.968429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b244d-bb67-487d-8ac4-65f88e5e2238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:51.970058 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b244d-bb67-487d-8ac4-65f88e5e2238 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:51.976941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 397/778] 10.222.0.39 () {56 vars in 1112 bytes} [Tue May 31 20:39:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:51.978717 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323d12c-4b7c-4c25-be38-a0c00873ff55 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:51.979203 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323d12c-4b7c-4c25-be38-a0c00873ff55 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:51.979376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323d12c-4b7c-4c25-be38-a0c00873ff55 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:51.980833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 382/779] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:51.986035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323d12c-4b7c-4c25-be38-a0c00873ff55 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:51.986820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1fa21-49de-4171-a9f3-304930dfcb28 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:51.987419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1fa21-49de-4171-a9f3-304930dfcb28 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:51.987936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1fa21-49de-4171-a9f3-304930dfcb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:52.006493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-30b1fa21-49de-4171-a9f3-304930dfcb28 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:52.008479 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-30b1fa21-49de-4171-a9f3-304930dfcb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:52.044807 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:52.080389 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 398/780] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:39:52.106885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1fa21-49de-4171-a9f3-304930dfcb28 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:52.108848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:52.118602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323d12c-4b7c-4c25-be38-a0c00873ff55 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:52.172033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a7ea3-66cb-478b-8b50-bd66775fc502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:52.173059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a7ea3-66cb-478b-8b50-bd66775fc502 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:52.173603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a7ea3-66cb-478b-8b50-bd66775fc502 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:52.174129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a7ea3-66cb-478b-8b50-bd66775fc502 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:52.175331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a7ea3-66cb-478b-8b50-bd66775fc502 None admin] RBAC: Adding query filter params (interface=public, service_id=891cce3583964e70abdada1f96232212, region_id=RegionOne) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:52.175897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a7ea3-66cb-478b-8b50-bd66775fc502 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:52.177644 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a7ea3-66cb-478b-8b50-bd66775fc502 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:52.199323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 383/781] 10.222.0.39 () {56 vars in 1251 bytes} [Tue May 31 20:39:51 2022] GET /identity/v3/endpoints?service_id=891cce3583964e70abdada1f96232212&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:52.206269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a7ea3-66cb-478b-8b50-bd66775fc502 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:52.213420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1fa21-49de-4171-a9f3-304930dfcb28 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:52.250493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec8af4-4e82-4e8e-ab82-27d3d72b5723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:52.251210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec8af4-4e82-4e8e-ab82-27d3d72b5723 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:52.251491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec8af4-4e82-4e8e-ab82-27d3d72b5723 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:52.251768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec8af4-4e82-4e8e-ab82-27d3d72b5723 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:52.263280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec8af4-4e82-4e8e-ab82-27d3d72b5723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-51ec8af4-4e82-4e8e-ab82-27d3d72b5723 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:52.272979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:52.274284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:52.275594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:52.275594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:52.275594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:52.275594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:52.275594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:52.275594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:52.275594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:52.275594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:52.275594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:52.275594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:52.275594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:52.275594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:52.278904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 399/782] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:52.280974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec8af4-4e82-4e8e-ab82-27d3d72b5723 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:52.373826 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:52.392979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec8af4-4e82-4e8e-ab82-27d3d72b5723 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:52.437258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13474c33-1dc3-43a4-8810-86359e120ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:52.437980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13474c33-1dc3-43a4-8810-86359e120ac5 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:52.438263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13474c33-1dc3-43a4-8810-86359e120ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:52.438541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13474c33-1dc3-43a4-8810-86359e120ac5 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:52.440644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13474c33-1dc3-43a4-8810-86359e120ac5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:52.440960 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13474c33-1dc3-43a4-8810-86359e120ac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:52.443424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13474c33-1dc3-43a4-8810-86359e120ac5 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:52.463737 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 400/783] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:52.471423 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13474c33-1dc3-43a4-8810-86359e120ac5 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:52.482787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a7ea3-66cb-478b-8b50-bd66775fc502 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:52.484413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:52.539245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51332387-51b3-4a74-9b8d-d9d9a6344378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:52.539827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51332387-51b3-4a74-9b8d-d9d9a6344378 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:52.540111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51332387-51b3-4a74-9b8d-d9d9a6344378 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:52.540383 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51332387-51b3-4a74-9b8d-d9d9a6344378 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:52.541059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51332387-51b3-4a74-9b8d-d9d9a6344378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:52.542476 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51332387-51b3-4a74-9b8d-d9d9a6344378 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:52.559996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 384/784] 10.222.0.39 () {56 vars in 1087 bytes} [Tue May 31 20:39:52 2022] GET /identity/v3/services => generated 772 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:52.606023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13474c33-1dc3-43a4-8810-86359e120ac5 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:52.633205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:52.644362 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ddc48-59a0-4974-a0da-7f793f1d3512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:52.647739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ddc48-59a0-4974-a0da-7f793f1d3512 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:52.647739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ddc48-59a0-4974-a0da-7f793f1d3512 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:52.647739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ddc48-59a0-4974-a0da-7f793f1d3512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:52.657230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ddc48-59a0-4974-a0da-7f793f1d3512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:52.658732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ddc48-59a0-4974-a0da-7f793f1d3512 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-048ddc48-59a0-4974-a0da-7f793f1d3512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:52.683915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:52.686861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:52.693012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:52.693012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:52.693012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:52.693012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:52.693012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 401/785] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:52.694721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51332387-51b3-4a74-9b8d-d9d9a6344378 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:52.869486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51332387-51b3-4a74-9b8d-d9d9a6344378 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:52.920810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc22e9-7e81-4feb-991b-0778ad1203b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:52.921928 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc22e9-7e81-4feb-991b-0778ad1203b0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:52.922433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc22e9-7e81-4feb-991b-0778ad1203b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:52.922901 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc22e9-7e81-4feb-991b-0778ad1203b0 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:52.923834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc22e9-7e81-4feb-991b-0778ad1203b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:52.924337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc22e9-7e81-4feb-991b-0778ad1203b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:52.925937 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc22e9-7e81-4feb-991b-0778ad1203b0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:52.948126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 385/786] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:52.954525 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ddc48-59a0-4974-a0da-7f793f1d3512 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:53.075179 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ddc48-59a0-4974-a0da-7f793f1d3512 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:53.112993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d712725-2238-4718-b8fa-67f5128d9e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:53.114161 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d712725-2238-4718-b8fa-67f5128d9e92 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:53.114641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d712725-2238-4718-b8fa-67f5128d9e92 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:53.115108 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d712725-2238-4718-b8fa-67f5128d9e92 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:53.123383 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d712725-2238-4718-b8fa-67f5128d9e92 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:53.125112 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d712725-2238-4718-b8fa-67f5128d9e92 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:53.140262 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06c1f2-1a73-4dd6-abaf-58be190c7134 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:53.140791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06c1f2-1a73-4dd6-abaf-58be190c7134 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:53.140791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06c1f2-1a73-4dd6-abaf-58be190c7134 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-4d712725-2238-4718-b8fa-67f5128d9e92 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:53.141501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:53.142417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:53.143750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:53.143750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:53.143750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:53.143750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:53.143750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:53.143750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:53.143750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:53.143750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:53.143750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 20:39:53.143750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:53.144287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 386/787] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:53.146088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 402/788] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:53.147751 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bd6cb-4923-46e9-afdf-9f72cbab8311 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:53.148038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bd6cb-4923-46e9-afdf-9f72cbab8311 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:53.148314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bd6cb-4923-46e9-afdf-9f72cbab8311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:53.154959 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d712725-2238-4718-b8fa-67f5128d9e92 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:53.168019 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-860bd6cb-4923-46e9-afdf-9f72cbab8311 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:53.173814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-860bd6cb-4923-46e9-afdf-9f72cbab8311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:53.201876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:53.215827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:53.296471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d712725-2238-4718-b8fa-67f5128d9e92 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:53.337147 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 387/789] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:39:53.343814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003c941-637d-4544-b99e-5c914c4e3d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:53.344535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003c941-637d-4544-b99e-5c914c4e3d2f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:53.344820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003c941-637d-4544-b99e-5c914c4e3d2f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:53.345096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003c941-637d-4544-b99e-5c914c4e3d2f None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:53.346027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003c941-637d-4544-b99e-5c914c4e3d2f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:53.346342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003c941-637d-4544-b99e-5c914c4e3d2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:53.347907 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003c941-637d-4544-b99e-5c914c4e3d2f None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:53.378434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 403/790] 10.222.0.39 () {56 vars in 1135 bytes} [Tue May 31 20:39:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:53.384128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bd6cb-4923-46e9-afdf-9f72cbab8311 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:53.435330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003c941-637d-4544-b99e-5c914c4e3d2f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:53.554077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bd6cb-4923-46e9-afdf-9f72cbab8311 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:53.601486 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:53.613891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003c941-637d-4544-b99e-5c914c4e3d2f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:53.655517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b7c59-0199-4172-a9c0-b44efbac1998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:53.657131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b7c59-0199-4172-a9c0-b44efbac1998 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:53.657854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b7c59-0199-4172-a9c0-b44efbac1998 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:53.658570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b7c59-0199-4172-a9c0-b44efbac1998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:53.691107 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b7c59-0199-4172-a9c0-b44efbac1998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:53.694681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b7c59-0199-4172-a9c0-b44efbac1998 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:53.702287 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee1f4a-a3e5-4cd1-9dd0-693dc4f77a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:53.703851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee1f4a-a3e5-4cd1-9dd0-693dc4f77a51 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:53.705558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee1f4a-a3e5-4cd1-9dd0-693dc4f77a51 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:53.706347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee1f4a-a3e5-4cd1-9dd0-693dc4f77a51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:53.721372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee1f4a-a3e5-4cd1-9dd0-693dc4f77a51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-2eee1f4a-a3e5-4cd1-9dd0-693dc4f77a51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:53.729766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:53.731227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:53.732585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:53.732585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:53.732585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:53.732585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:53.732585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:53.732585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:53.732585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:53.732585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:53.732585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:53.732585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:53.732585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:53.732585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:53.732585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 404/791] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:53.733753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1980d-3ba3-458b-b8df-2f3e9e503396 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:53.733753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1980d-3ba3-458b-b8df-2f3e9e503396 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:53.733753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1980d-3ba3-458b-b8df-2f3e9e503396 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:53.738715 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 405/792] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:53.739490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1980d-3ba3-458b-b8df-2f3e9e503396 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-850b7c59-0199-4172-a9c0-b44efbac1998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:53.741774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:53.743128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:53.744584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:53.744584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:53.744584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:53.744584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:53.748801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 388/793] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:53.750915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c088b-fb01-4a52-b3ee-257bf93aa466 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:53.751539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c088b-fb01-4a52-b3ee-257bf93aa466 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:53.752115 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c088b-fb01-4a52-b3ee-257bf93aa466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:53.781818 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-125c088b-fb01-4a52-b3ee-257bf93aa466 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:53.783229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-125c088b-fb01-4a52-b3ee-257bf93aa466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:53.785937 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:53.869804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 389/794] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:39:53.870912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c088b-fb01-4a52-b3ee-257bf93aa466 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:53.902755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1980d-3ba3-458b-b8df-2f3e9e503396 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:53.967454 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf17561-ef00-4081-8f38-719c1c2c68ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:53.968805 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf17561-ef00-4081-8f38-719c1c2c68ce None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:53.969545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf17561-ef00-4081-8f38-719c1c2c68ce None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:53.970205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf17561-ef00-4081-8f38-719c1c2c68ce None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:53.971791 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf17561-ef00-4081-8f38-719c1c2c68ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:53.972486 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf17561-ef00-4081-8f38-719c1c2c68ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:53.975250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf17561-ef00-4081-8f38-719c1c2c68ce None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:53.991461 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c088b-fb01-4a52-b3ee-257bf93aa466 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:53.992636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 406/795] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:53.994400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf17561-ef00-4081-8f38-719c1c2c68ce None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:54.023890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:54.030683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e17bd-d68d-4b82-a154-c9ba06c6c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:54.031022 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e17bd-d68d-4b82-a154-c9ba06c6c37b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:54.031360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e17bd-d68d-4b82-a154-c9ba06c6c37b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:54.031690 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e17bd-d68d-4b82-a154-c9ba06c6c37b None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:54.032526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e17bd-d68d-4b82-a154-c9ba06c6c37b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:54.032844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e17bd-d68d-4b82-a154-c9ba06c6c37b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:54.034431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e17bd-d68d-4b82-a154-c9ba06c6c37b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:54.041996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:54.052372 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 390/796] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:54.054064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e17bd-d68d-4b82-a154-c9ba06c6c37b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:54.164568 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf17561-ef00-4081-8f38-719c1c2c68ce None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:54.168798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e17bd-d68d-4b82-a154-c9ba06c6c37b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:54.212555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d30053-de89-4749-afbe-8d181b56369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:54.213370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d30053-de89-4749-afbe-8d181b56369e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:54.213682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d30053-de89-4749-afbe-8d181b56369e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:54.213960 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d30053-de89-4749-afbe-8d181b56369e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:54.227258 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d30053-de89-4749-afbe-8d181b56369e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:54.228835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d30053-de89-4749-afbe-8d181b56369e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:54.231620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a65e78-ceb3-4ba8-9fdc-69baa9fe0639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:54.233137 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a65e78-ceb3-4ba8-9fdc-69baa9fe0639 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:54.233876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a65e78-ceb3-4ba8-9fdc-69baa9fe0639 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:54.234562 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a65e78-ceb3-4ba8-9fdc-69baa9fe0639 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-d0d30053-de89-4749-afbe-8d181b56369e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:54.247873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:54.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:54.251213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:54.251213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:54.251213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:54.251213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:54.251213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 391/797] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:54.251213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d30053-de89-4749-afbe-8d181b56369e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:54.255827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a65e78-ceb3-4ba8-9fdc-69baa9fe0639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-05a65e78-ceb3-4ba8-9fdc-69baa9fe0639 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:54.271031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:54.273111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:54.274532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:54.274532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:54.274532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:54.274532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:54.274532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:54.274532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:54.274532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:54.274532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:54.274532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:54.274532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:54.274532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:39:54.274532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:54.285474 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 407/798] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:39:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:54.287929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a65e78-ceb3-4ba8-9fdc-69baa9fe0639 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:54.305839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:54.362713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d30053-de89-4749-afbe-8d181b56369e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:54.399629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb8df3-5328-4691-89b2-220067ff12a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:54.400425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8df3-5328-4691-89b2-220067ff12a3 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:54.400703 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8df3-5328-4691-89b2-220067ff12a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:54.400977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8df3-5328-4691-89b2-220067ff12a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:54.410508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb8df3-5328-4691-89b2-220067ff12a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:54.411972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb8df3-5328-4691-89b2-220067ff12a3 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e8cb8df3-5328-4691-89b2-220067ff12a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:54.430087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:54.431648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:54.433079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:54.433079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:54.433079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:54.433079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:54.433079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:54.433079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:54.433079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:54.433079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:54.436563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 392/799] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:54.437627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb8df3-5328-4691-89b2-220067ff12a3 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:54.440596 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:54.477655 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a65e78-ceb3-4ba8-9fdc-69baa9fe0639 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:54.538065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07c739-f474-47a2-98ab-608800d7170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:54.538759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07c739-f474-47a2-98ab-608800d7170d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:54.539042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07c739-f474-47a2-98ab-608800d7170d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:54.539320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07c739-f474-47a2-98ab-608800d7170d None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:54.540049 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07c739-f474-47a2-98ab-608800d7170d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:54.540355 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07c739-f474-47a2-98ab-608800d7170d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:54.541775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07c739-f474-47a2-98ab-608800d7170d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:54.561002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 408/800] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:54.561002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07c739-f474-47a2-98ab-608800d7170d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:54.572663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb8df3-5328-4691-89b2-220067ff12a3 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:54.591459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:54.626190 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32cc12-ed6e-4b2c-90ba-b23b6ec629e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:54.627684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32cc12-ed6e-4b2c-90ba-b23b6ec629e1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:54.629232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32cc12-ed6e-4b2c-90ba-b23b6ec629e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:54.629701 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32cc12-ed6e-4b2c-90ba-b23b6ec629e1 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:54.630861 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32cc12-ed6e-4b2c-90ba-b23b6ec629e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:54.631408 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32cc12-ed6e-4b2c-90ba-b23b6ec629e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:54.633611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32cc12-ed6e-4b2c-90ba-b23b6ec629e1 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:54.649597 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 393/801] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:39:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:54.651893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ded05-5af7-46d2-aa56-221ceed43f53 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:54.652345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ded05-5af7-46d2-aa56-221ceed43f53 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:54.652800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ded05-5af7-46d2-aa56-221ceed43f53 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:54.654906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 394/802] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:54.655996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ded05-5af7-46d2-aa56-221ceed43f53 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:54.672178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07c739-f474-47a2-98ab-608800d7170d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:54.711014 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ed125-37e1-4d22-a62a-0f038cc3e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:54.711925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ed125-37e1-4d22-a62a-0f038cc3e2f8 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:54.712358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ed125-37e1-4d22-a62a-0f038cc3e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:54.712773 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ed125-37e1-4d22-a62a-0f038cc3e2f8 None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:54.713789 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ed125-37e1-4d22-a62a-0f038cc3e2f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:54.714088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ed125-37e1-4d22-a62a-0f038cc3e2f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:54.715851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ed125-37e1-4d22-a62a-0f038cc3e2f8 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:54.719841 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:54.730909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 409/803] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:54.731648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ed125-37e1-4d22-a62a-0f038cc3e2f8 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:54.790053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ded05-5af7-46d2-aa56-221ceed43f53 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:54.824586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1470844-0ee4-4ab1-a99e-5c665d6a456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:54.825370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1470844-0ee4-4ab1-a99e-5c665d6a456a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:54.825674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1470844-0ee4-4ab1-a99e-5c665d6a456a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:54.825941 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1470844-0ee4-4ab1-a99e-5c665d6a456a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:54.833673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1470844-0ee4-4ab1-a99e-5c665d6a456a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:54.835644 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1470844-0ee4-4ab1-a99e-5c665d6a456a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-d1470844-0ee4-4ab1-a99e-5c665d6a456a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:54.851613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:54.854005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:54.855609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:54.855609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:54.855609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:54.855609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:54.855609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:54.855609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:54.855609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:54.855609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:54.855609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:39:54.855609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:54.855609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 395/804] 10.222.0.39 () {56 vars in 1093 bytes} [Tue May 31 20:39:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:54.855609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88abdf9-2498-4a50-a315-4066f0951896 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:54.855609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88abdf9-2498-4a50-a315-4066f0951896 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:54.857876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88abdf9-2498-4a50-a315-4066f0951896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:54.864703 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ed125-37e1-4d22-a62a-0f038cc3e2f8 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:54.878609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e88abdf9-2498-4a50-a315-4066f0951896 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:54.880358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e88abdf9-2498-4a50-a315-4066f0951896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:54.902378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e02fe7-0cf9-46a3-a2fd-c07b6d9f5462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:54.903329 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e02fe7-0cf9-46a3-a2fd-c07b6d9f5462 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:54.903609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e02fe7-0cf9-46a3-a2fd-c07b6d9f5462 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:54.903878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e02fe7-0cf9-46a3-a2fd-c07b6d9f5462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:54.908440 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:54.916753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e02fe7-0cf9-46a3-a2fd-c07b6d9f5462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:54.918199 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e02fe7-0cf9-46a3-a2fd-c07b6d9f5462 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-d9e02fe7-0cf9-46a3-a2fd-c07b6d9f5462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:54.936400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:54.937407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:54.938313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:54.938313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:54.938313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:54.938313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:54.938313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 410/805] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:54.939078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e02fe7-0cf9-46a3-a2fd-c07b6d9f5462 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:54.961419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 396/806] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:39:54.961419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88abdf9-2498-4a50-a315-4066f0951896 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:55.012367 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:55.065456 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e02fe7-0cf9-46a3-a2fd-c07b6d9f5462 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:55.067195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88abdf9-2498-4a50-a315-4066f0951896 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:55.099046 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65f635-9b2e-472f-9dba-28b37883cbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:55.100500 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f635-9b2e-472f-9dba-28b37883cbe6 None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:55.100784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f635-9b2e-472f-9dba-28b37883cbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:55.101059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f635-9b2e-472f-9dba-28b37883cbe6 None admin] PATH_INFO: `/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/90867ac821dd4adb8d52075fbd85caba/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:55.103053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65f635-9b2e-472f-9dba-28b37883cbe6 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d14229f6554a34bf9084d36cffe8ac, user_id=90867ac821dd4adb8d52075fbd85caba, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:55.104485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65f635-9b2e-472f-9dba-28b37883cbe6 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:55.106864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cb314-544b-45c5-a580-86c2139c0b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:55.107825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cb314-544b-45c5-a580-86c2139c0b3c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:55.108260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cb314-544b-45c5-a580-86c2139c0b3c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:55.108534 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cb314-544b-45c5-a580-86c2139c0b3c None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:55.109357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cb314-544b-45c5-a580-86c2139c0b3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:55.109684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cb314-544b-45c5-a580-86c2139c0b3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:55.111106 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cb314-544b-45c5-a580-86c2139c0b3c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:55.129083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 397/807] 10.222.0.39 () {56 vars in 1133 bytes} [Tue May 31 20:39:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:55.129925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cb314-544b-45c5-a580-86c2139c0b3c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:55.152093 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:55.185663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 411/808] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:39:54 2022] PUT /identity/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/90867ac821dd4adb8d52075fbd85caba/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:39:55.186694 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65f635-9b2e-472f-9dba-28b37883cbe6 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:55.258694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cb314-544b-45c5-a580-86c2139c0b3c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:55.308002 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a5f9c-b77e-410f-9ae9-218ec3eab982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:55.308760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a5f9c-b77e-410f-9ae9-218ec3eab982 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:55.308961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a5f9c-b77e-410f-9ae9-218ec3eab982 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:55.309228 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a5f9c-b77e-410f-9ae9-218ec3eab982 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:55.310001 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a5f9c-b77e-410f-9ae9-218ec3eab982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:55.310300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a5f9c-b77e-410f-9ae9-218ec3eab982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:55.311702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a5f9c-b77e-410f-9ae9-218ec3eab982 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:55.329264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 398/809] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:55.329264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a5f9c-b77e-410f-9ae9-218ec3eab982 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:55.340944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65f635-9b2e-472f-9dba-28b37883cbe6 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:55.352563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:55.382417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d53b1f-1340-4dad-9b87-ca83516c77ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:55.383809 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d53b1f-1340-4dad-9b87-ca83516c77ad None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:55.384093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d53b1f-1340-4dad-9b87-ca83516c77ad None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:55.384663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d53b1f-1340-4dad-9b87-ca83516c77ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:55.385488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d53b1f-1340-4dad-9b87-ca83516c77ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:55.387617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d53b1f-1340-4dad-9b87-ca83516c77ad None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-56d53b1f-1340-4dad-9b87-ca83516c77ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:55.401253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:55.404106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:55.404957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 412/810] 10.222.0.39 () {56 vars in 1129 bytes} [Tue May 31 20:39:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:55.405860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d560-7717-4cb1-8c91-d6ece1f53e20 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:55.405860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d560-7717-4cb1-8c91-d6ece1f53e20 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:55.405860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d560-7717-4cb1-8c91-d6ece1f53e20 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:55.410817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 413/811] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:55.413493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d560-7717-4cb1-8c91-d6ece1f53e20 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:55.424118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:55.446606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a5f9c-b77e-410f-9ae9-218ec3eab982 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:55.485651 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2257d-22d2-473d-b0d0-d1a23490d20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:55.486424 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2257d-22d2-473d-b0d0-d1a23490d20d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:55.486711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2257d-22d2-473d-b0d0-d1a23490d20d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:55.486987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2257d-22d2-473d-b0d0-d1a23490d20d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:55.520836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d560-7717-4cb1-8c91-d6ece1f53e20 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:55.556290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b981988-8a27-4122-ba2b-a76f02fbd556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:55.557019 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981988-8a27-4122-ba2b-a76f02fbd556 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:55.557301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981988-8a27-4122-ba2b-a76f02fbd556 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:55.557604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981988-8a27-4122-ba2b-a76f02fbd556 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:55.558887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2257d-22d2-473d-b0d0-d1a23490d20d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:55.560339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2257d-22d2-473d-b0d0-d1a23490d20d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:55.565451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b981988-8a27-4122-ba2b-a76f02fbd556 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:55.567102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b981988-8a27-4122-ba2b-a76f02fbd556 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-6b981988-8a27-4122-ba2b-a76f02fbd556 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:55.582147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:55.583127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:55.584628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:55.584628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:55.584628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:55.584628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:55.584628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:55.584628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:55.584628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:55.584628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:55.584628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:39:55.584628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:55.591142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 414/812] 10.222.0.39 () {56 vars in 1117 bytes} [Tue May 31 20:39:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:55.592211 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b981988-8a27-4122-ba2b-a76f02fbd556 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:55.624504 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:55.643087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:55.663187 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 399/813] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:39:55.669271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bd5b0-29ba-4a3c-bc42-842bd2f34fe3 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:55.669591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bd5b0-29ba-4a3c-bc42-842bd2f34fe3 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:55.669870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bd5b0-29ba-4a3c-bc42-842bd2f34fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:55.687228 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-408bd5b0-29ba-4a3c-bc42-842bd2f34fe3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:55.688406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-408bd5b0-29ba-4a3c-bc42-842bd2f34fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:55.702245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b981988-8a27-4122-ba2b-a76f02fbd556 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:55.739552 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b529cb8-1106-4ca9-9e59-098f4f775888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:55.740241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b529cb8-1106-4ca9-9e59-098f4f775888 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:55.740525 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b529cb8-1106-4ca9-9e59-098f4f775888 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:55.740796 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b529cb8-1106-4ca9-9e59-098f4f775888 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:55.741528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b529cb8-1106-4ca9-9e59-098f4f775888 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:55.741840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b529cb8-1106-4ca9-9e59-098f4f775888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:55.743221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b529cb8-1106-4ca9-9e59-098f4f775888 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:55.747764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 415/814] 10.222.0.39 () {56 vars in 1124 bytes} [Tue May 31 20:39:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:55.748630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b529cb8-1106-4ca9-9e59-098f4f775888 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:55.773679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 400/815] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:39:55.774512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bd5b0-29ba-4a3c-bc42-842bd2f34fe3 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:55.849582 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:55.856316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b529cb8-1106-4ca9-9e59-098f4f775888 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:55.891923 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699477d2-fd32-461a-b257-c50281512c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:55.892594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699477d2-fd32-461a-b257-c50281512c47 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:55.892874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699477d2-fd32-461a-b257-c50281512c47 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:55.893143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699477d2-fd32-461a-b257-c50281512c47 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:55.893443 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bd5b0-29ba-4a3c-bc42-842bd2f34fe3 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:55.894014 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699477d2-fd32-461a-b257-c50281512c47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:55.894320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699477d2-fd32-461a-b257-c50281512c47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:55.897161 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699477d2-fd32-461a-b257-c50281512c47 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:55.906883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:55.914490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 416/816] 10.222.0.39 () {56 vars in 1149 bytes} [Tue May 31 20:39:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:55.915709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699477d2-fd32-461a-b257-c50281512c47 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:55.939186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a885a-0a93-4de9-81c7-d1a022a23682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:55.940312 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a885a-0a93-4de9-81c7-d1a022a23682 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:55.940882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a885a-0a93-4de9-81c7-d1a022a23682 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:55.941475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a885a-0a93-4de9-81c7-d1a022a23682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:55.953616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a885a-0a93-4de9-81c7-d1a022a23682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:55.955088 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a885a-0a93-4de9-81c7-d1a022a23682 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-1d0a885a-0a93-4de9-81c7-d1a022a23682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:55.975392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:55.976526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:55.977475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:55.977475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:55.977475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:55.977475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:55.977475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 401/817] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:55.977932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a885a-0a93-4de9-81c7-d1a022a23682 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:56.030961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699477d2-fd32-461a-b257-c50281512c47 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:56.067756 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf3dd8-4812-48bc-a9f6-e808c76de712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:56.068952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf3dd8-4812-48bc-a9f6-e808c76de712 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:56.069236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf3dd8-4812-48bc-a9f6-e808c76de712 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:56.069544 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf3dd8-4812-48bc-a9f6-e808c76de712 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:56.070255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf3dd8-4812-48bc-a9f6-e808c76de712 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:56.070811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf3dd8-4812-48bc-a9f6-e808c76de712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:56.072187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf3dd8-4812-48bc-a9f6-e808c76de712 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:56.081803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 417/818] 10.222.0.39 () {56 vars in 1124 bytes} [Tue May 31 20:39:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:56.081803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf3dd8-4812-48bc-a9f6-e808c76de712 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:56.104955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a885a-0a93-4de9-81c7-d1a022a23682 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:56.105901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:56.142412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804ad10-81b4-415d-8d0f-d80278605e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:56.144116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804ad10-81b4-415d-8d0f-d80278605e8b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:56.144400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804ad10-81b4-415d-8d0f-d80278605e8b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:56.144685 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804ad10-81b4-415d-8d0f-d80278605e8b None admin] PATH_INFO: `/v3/services/network` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:56.145332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804ad10-81b4-415d-8d0f-d80278605e8b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:56.147436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804ad10-81b4-415d-8d0f-d80278605e8b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-1804ad10-81b4-415d-8d0f-d80278605e8b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:56.159423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:56.160480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:56.161365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 402/819] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:55 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:56.163382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804ad10-81b4-415d-8d0f-d80278605e8b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:56.197909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:56.203735 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf3dd8-4812-48bc-a9f6-e808c76de712 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:56.243354 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dc007-4b9d-4fa5-812e-1e1a8468825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:56.244359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dc007-4b9d-4fa5-812e-1e1a8468825b None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:56.244723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dc007-4b9d-4fa5-812e-1e1a8468825b None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:56.245078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dc007-4b9d-4fa5-812e-1e1a8468825b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:56.256542 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dc007-4b9d-4fa5-812e-1e1a8468825b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:56.258042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dc007-4b9d-4fa5-812e-1e1a8468825b None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:56.275531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804ad10-81b4-415d-8d0f-d80278605e8b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-0c5dc007-4b9d-4fa5-812e-1e1a8468825b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:56.277316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:56.278419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:56.279349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:56.279349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:56.279349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:56.279349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:56.279349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 418/820] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:56.279735 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dc007-4b9d-4fa5-812e-1e1a8468825b None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:56.325719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f4a8b-110c-4bbb-97ac-84be2b37411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:56.326858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f4a8b-110c-4bbb-97ac-84be2b37411d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:56.327216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f4a8b-110c-4bbb-97ac-84be2b37411d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:56.327869 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f4a8b-110c-4bbb-97ac-84be2b37411d None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:56.328745 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f4a8b-110c-4bbb-97ac-84be2b37411d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:56.329127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f4a8b-110c-4bbb-97ac-84be2b37411d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:56.330609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f4a8b-110c-4bbb-97ac-84be2b37411d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:56.347676 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 403/821] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:56.347676 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f4a8b-110c-4bbb-97ac-84be2b37411d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:56.361127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:56.394690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dc007-4b9d-4fa5-812e-1e1a8468825b None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:56.438336 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f682be-0ff5-4938-8bac-db68bcf9591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:56.438606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:56.439071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f682be-0ff5-4938-8bac-db68bcf9591a None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:56.439357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f682be-0ff5-4938-8bac-db68bcf9591a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:56.439696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f682be-0ff5-4938-8bac-db68bcf9591a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:56.440440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f682be-0ff5-4938-8bac-db68bcf9591a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:56.441869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f682be-0ff5-4938-8bac-db68bcf9591a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:56.454895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f4a8b-110c-4bbb-97ac-84be2b37411d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:56.489873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe9689-7a90-411a-ad9d-a92190cb9ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:56.491046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe9689-7a90-411a-ad9d-a92190cb9ad1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:56.491330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe9689-7a90-411a-ad9d-a92190cb9ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:56.491601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe9689-7a90-411a-ad9d-a92190cb9ad1 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:56.492299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe9689-7a90-411a-ad9d-a92190cb9ad1 None admin] RBAC: Adding query filter params (name=network) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:56.492603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe9689-7a90-411a-ad9d-a92190cb9ad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:56.493990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe9689-7a90-411a-ad9d-a92190cb9ad1 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:56.498919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 404/822] 10.222.0.39 () {56 vars in 1112 bytes} [Tue May 31 20:39:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:56.512227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe9689-7a90-411a-ad9d-a92190cb9ad1 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:56.566363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 419/823] 10.222.0.39 () {60 vars in 1144 bytes} [Tue May 31 20:39:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:39:56.567159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f682be-0ff5-4938-8bac-db68bcf9591a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:56.612477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe9689-7a90-411a-ad9d-a92190cb9ad1 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:56.658581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e808f-6b36-47f0-a662-93f6d98ef475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:56.659681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e808f-6b36-47f0-a662-93f6d98ef475 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:56.660040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e808f-6b36-47f0-a662-93f6d98ef475 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:56.660388 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e808f-6b36-47f0-a662-93f6d98ef475 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:56.661725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e808f-6b36-47f0-a662-93f6d98ef475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:56.662670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e808f-6b36-47f0-a662-93f6d98ef475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:56.664771 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e808f-6b36-47f0-a662-93f6d98ef475 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:56.688608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 405/824] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:56.689742 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e808f-6b36-47f0-a662-93f6d98ef475 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:56.703899 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:56.728829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f682be-0ff5-4938-8bac-db68bcf9591a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:56.768553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:56.779864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71083f3-4f28-43ad-8764-f9aad632c25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:56.780853 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71083f3-4f28-43ad-8764-f9aad632c25a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:56.781424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71083f3-4f28-43ad-8764-f9aad632c25a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:56.781424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71083f3-4f28-43ad-8764-f9aad632c25a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:56.793019 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71083f3-4f28-43ad-8764-f9aad632c25a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:56.794857 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71083f3-4f28-43ad-8764-f9aad632c25a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-a71083f3-4f28-43ad-8764-f9aad632c25a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:56.815468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:56.816717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:56.817644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:56.817644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:56.817644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:56.817644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:56.817644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:56.817644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:56.817644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:56.817644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:56.818415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 420/825] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:56.819184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71083f3-4f28-43ad-8764-f9aad632c25a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:56.846462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e808f-6b36-47f0-a662-93f6d98ef475 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:56.894136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4caffa-1ff0-44a2-a196-db667ac2ed17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:56.894747 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4caffa-1ff0-44a2-a196-db667ac2ed17 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:56.895318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4caffa-1ff0-44a2-a196-db667ac2ed17 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:56.895604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4caffa-1ff0-44a2-a196-db667ac2ed17 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:56.896933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4caffa-1ff0-44a2-a196-db667ac2ed17 None admin] RBAC: Adding query filter params (type=network) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:56.897440 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4caffa-1ff0-44a2-a196-db667ac2ed17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:56.899534 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4caffa-1ff0-44a2-a196-db667ac2ed17 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:56.906867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 406/826] 10.222.0.39 () {56 vars in 1112 bytes} [Tue May 31 20:39:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:56.907739 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4caffa-1ff0-44a2-a196-db667ac2ed17 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:56.949901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71083f3-4f28-43ad-8764-f9aad632c25a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:56.993164 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ab6e8-fee6-4fa0-ae9e-e388e733edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:56.994009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ab6e8-fee6-4fa0-ae9e-e388e733edaf None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:56.994326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ab6e8-fee6-4fa0-ae9e-e388e733edaf None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:56.994676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ab6e8-fee6-4fa0-ae9e-e388e733edaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:56.999257 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:57.003020 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ab6e8-fee6-4fa0-ae9e-e388e733edaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:57.004568 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ab6e8-fee6-4fa0-ae9e-e388e733edaf None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-4f9ab6e8-fee6-4fa0-ae9e-e388e733edaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:57.020064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:57.021242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:57.022240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:57.022240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:57.022240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:57.022240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:57.022240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:57.022240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:57.022240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:57.022240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:57.022240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 421/827] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:57.022724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ab6e8-fee6-4fa0-ae9e-e388e733edaf None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:57.046008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4caffa-1ff0-44a2-a196-db667ac2ed17 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:57.081254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:57.093300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf4428-6f4a-4571-9ad6-024a10fb26e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:57.094211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf4428-6f4a-4571-9ad6-024a10fb26e9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:57.094804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf4428-6f4a-4571-9ad6-024a10fb26e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:57.095094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf4428-6f4a-4571-9ad6-024a10fb26e9 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:57.096164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf4428-6f4a-4571-9ad6-024a10fb26e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:57.096478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf4428-6f4a-4571-9ad6-024a10fb26e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:57.098650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf4428-6f4a-4571-9ad6-024a10fb26e9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:57.117543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 407/828] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:57.118453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf4428-6f4a-4571-9ad6-024a10fb26e9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:57.146550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ab6e8-fee6-4fa0-ae9e-e388e733edaf None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:57.185583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb08ca8-290e-4410-abdd-4c75e9c3efe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:57.186402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb08ca8-290e-4410-abdd-4c75e9c3efe2 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:57.186781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb08ca8-290e-4410-abdd-4c75e9c3efe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:57.187066 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb08ca8-290e-4410-abdd-4c75e9c3efe2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:57.187860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb08ca8-290e-4410-abdd-4c75e9c3efe2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:57.189276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb08ca8-290e-4410-abdd-4c75e9c3efe2 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:57.242436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf4428-6f4a-4571-9ad6-024a10fb26e9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:57.279058 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 422/829] 10.222.0.39 () {60 vars in 1144 bytes} [Tue May 31 20:39:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:39:57.280105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb08ca8-290e-4410-abdd-4c75e9c3efe2 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:57.284941 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:57.288940 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08be43f-a963-4a80-964a-7ccbb701d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:57.289917 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08be43f-a963-4a80-964a-7ccbb701d6ed None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:57.290432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08be43f-a963-4a80-964a-7ccbb701d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:57.290929 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08be43f-a963-4a80-964a-7ccbb701d6ed None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:57.291907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08be43f-a963-4a80-964a-7ccbb701d6ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:57.292527 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08be43f-a963-4a80-964a-7ccbb701d6ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:57.294279 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08be43f-a963-4a80-964a-7ccbb701d6ed None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:57.320022 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 408/830] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:57.326538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08be43f-a963-4a80-964a-7ccbb701d6ed None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:57.444153 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08be43f-a963-4a80-964a-7ccbb701d6ed None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:57.483302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7457-5c4a-41cc-811f-08d835d451d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:57.484711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7457-5c4a-41cc-811f-08d835d451d5 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:57.485238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7457-5c4a-41cc-811f-08d835d451d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:57.485773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7457-5c4a-41cc-811f-08d835d451d5 None admin] PATH_INFO: `/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/9ba18c72dcba4cc4aa863783f325e780/roles/1d87f67726f0470f81f36098070998b8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:57.504240 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef7457-5c4a-41cc-811f-08d835d451d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d14229f6554a34bf9084d36cffe8ac, user_id=9ba18c72dcba4cc4aa863783f325e780, role_id=1d87f67726f0470f81f36098070998b8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:57.506209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef7457-5c4a-41cc-811f-08d835d451d5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:57.507231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb08ca8-290e-4410-abdd-4c75e9c3efe2 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:57.509046 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:57.545847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a5b19-248f-4916-a99e-f96803d10d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:57.546522 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a5b19-248f-4916-a99e-f96803d10d8c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:57.546804 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a5b19-248f-4916-a99e-f96803d10d8c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:57.547080 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a5b19-248f-4916-a99e-f96803d10d8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:57.547927 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a5b19-248f-4916-a99e-f96803d10d8c None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=8c86c12743bd4ee8843dba4a7af5d7a0) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:57.548240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a5b19-248f-4916-a99e-f96803d10d8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:57.549745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a5b19-248f-4916-a99e-f96803d10d8c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:57.563428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 423/831] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:57 2022] GET /identity/v3/role_assignments?user.id=8c86c12743bd4ee8843dba4a7af5d7a0&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:57.563428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b541482-7d47-4e61-8f1a-07389f6e5267 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:57.563428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b541482-7d47-4e61-8f1a-07389f6e5267 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:57.563428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b541482-7d47-4e61-8f1a-07389f6e5267 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:57.565216 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 424/832] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:57.567143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a3589-65e5-4236-84d4-c48c863a14d9 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:57.568569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a3589-65e5-4236-84d4-c48c863a14d9 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:57.568569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a3589-65e5-4236-84d4-c48c863a14d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:57.583966 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 409/833] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:39:57 2022] PUT /identity/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/9ba18c72dcba4cc4aa863783f325e780/roles/1d87f67726f0470f81f36098070998b8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:39:57.595128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-7c2a3589-65e5-4236-84d4-c48c863a14d9 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:57.596453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7c2a3589-65e5-4236-84d4-c48c863a14d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:57.681365 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 425/834] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:39:57.707075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7457-5c4a-41cc-811f-08d835d451d5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:57.754181 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:57.844333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7457-5c4a-41cc-811f-08d835d451d5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:57.885818 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50f7c-2a70-4f53-82ab-4e7fa53d217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:57.887015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50f7c-2a70-4f53-82ab-4e7fa53d217a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:57.887297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50f7c-2a70-4f53-82ab-4e7fa53d217a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:57.887573 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50f7c-2a70-4f53-82ab-4e7fa53d217a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:57.900101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c50f7c-2a70-4f53-82ab-4e7fa53d217a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-88c50f7c-2a70-4f53-82ab-4e7fa53d217a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:39:57.907784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:57.908828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:57.909792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:57.909792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:57.909792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:57.909792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:57.909792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:39:57.909792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:39:57.909792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:39:57.909792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:39:57.909792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:39:57.909792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:39:57.909792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:39:57.909792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:57.909792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 410/835] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:57.915854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a3589-65e5-4236-84d4-c48c863a14d9 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:58.018059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:58.026083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a3589-65e5-4236-84d4-c48c863a14d9 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:58.062030 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c18cb-74ba-4ead-a65a-99df73c6e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:58.062701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c18cb-74ba-4ead-a65a-99df73c6e13d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:58.062980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c18cb-74ba-4ead-a65a-99df73c6e13d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:58.063254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c18cb-74ba-4ead-a65a-99df73c6e13d None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:58.064001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c18cb-74ba-4ead-a65a-99df73c6e13d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:58.064305 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c18cb-74ba-4ead-a65a-99df73c6e13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:58.065948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c18cb-74ba-4ead-a65a-99df73c6e13d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:58.076031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 426/836] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:39:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:58.082486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50f7c-2a70-4f53-82ab-4e7fa53d217a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:58.190566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:58.197488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50f7c-2a70-4f53-82ab-4e7fa53d217a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:58.234598 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c60677-db32-406f-9c0f-2cc1af74ed34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:58.235394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c60677-db32-406f-9c0f-2cc1af74ed34 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:58.235673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c60677-db32-406f-9c0f-2cc1af74ed34 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:58.235944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c60677-db32-406f-9c0f-2cc1af74ed34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:58.246487 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c60677-db32-406f-9c0f-2cc1af74ed34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:58.247952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c60677-db32-406f-9c0f-2cc1af74ed34 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-17c60677-db32-406f-9c0f-2cc1af74ed34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:58.266076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:58.267003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:58.268373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:58.268373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:58.268373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:58.268373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:58.268373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 411/837] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:58.274562 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c18cb-74ba-4ead-a65a-99df73c6e13d None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:58.392751 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c18cb-74ba-4ead-a65a-99df73c6e13d None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:58.428396 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81caae91-f819-4ca2-b868-013c9f9da10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:58.429317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caae91-f819-4ca2-b868-013c9f9da10a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:58.429796 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caae91-f819-4ca2-b868-013c9f9da10a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:58.430220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caae91-f819-4ca2-b868-013c9f9da10a None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:58.431148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81caae91-f819-4ca2-b868-013c9f9da10a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:58.431600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81caae91-f819-4ca2-b868-013c9f9da10a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:58.433179 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81caae91-f819-4ca2-b868-013c9f9da10a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:58.446704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 427/838] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:58.452485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c60677-db32-406f-9c0f-2cc1af74ed34 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:58.557823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c60677-db32-406f-9c0f-2cc1af74ed34 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:58.593399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14393f-3e17-41fe-90d6-8ea723db8533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:58.594196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14393f-3e17-41fe-90d6-8ea723db8533 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:58.594478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14393f-3e17-41fe-90d6-8ea723db8533 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:58.594752 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14393f-3e17-41fe-90d6-8ea723db8533 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:58.602809 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14393f-3e17-41fe-90d6-8ea723db8533 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:58.604232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14393f-3e17-41fe-90d6-8ea723db8533 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-ba14393f-3e17-41fe-90d6-8ea723db8533 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:39:58.619412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:58.620398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:58.621336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:58.621336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:58.621336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:39:58.621336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:39:58.621336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:39:58.621336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:39:58.621336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:39:58.621336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:39:58.621336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 20:39:58.621336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:58.621336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 412/839] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:39:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:58.628222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81caae91-f819-4ca2-b868-013c9f9da10a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:58.657797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:58.735286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81caae91-f819-4ca2-b868-013c9f9da10a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:58.780216 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b335960-0fb4-4d2c-8462-371c94b85b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:58.780893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b335960-0fb4-4d2c-8462-371c94b85b77 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:58.781174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b335960-0fb4-4d2c-8462-371c94b85b77 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:58.781509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b335960-0fb4-4d2c-8462-371c94b85b77 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:58.782351 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b335960-0fb4-4d2c-8462-371c94b85b77 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:58.782657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b335960-0fb4-4d2c-8462-371c94b85b77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:58.784101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b335960-0fb4-4d2c-8462-371c94b85b77 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:58.803874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 428/840] 10.222.0.39 () {56 vars in 1135 bytes} [Tue May 31 20:39:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:58.817919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14393f-3e17-41fe-90d6-8ea723db8533 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:58.823742 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:58.930952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14393f-3e17-41fe-90d6-8ea723db8533 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:58.969246 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f568294-e7db-488a-ae87-d4c3a382c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:58.969946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f568294-e7db-488a-ae87-d4c3a382c59f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:58.970233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f568294-e7db-488a-ae87-d4c3a382c59f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:58.970512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f568294-e7db-488a-ae87-d4c3a382c59f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:59.045140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f568294-e7db-488a-ae87-d4c3a382c59f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:59.046637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f568294-e7db-488a-ae87-d4c3a382c59f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:59.057628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:59.113840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693be158-e382-4a1f-ba17-cc034d238101 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:59.114139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693be158-e382-4a1f-ba17-cc034d238101 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:59.114331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693be158-e382-4a1f-ba17-cc034d238101 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:59.116502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 429/841] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:39:59.121196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5ba9-ac53-47de-a84f-91325e26c417 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:59.121622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5ba9-ac53-47de-a84f-91325e26c417 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:59.121994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5ba9-ac53-47de-a84f-91325e26c417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:59.139340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b75d5ba9-ac53-47de-a84f-91325e26c417 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:39:59.140667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b75d5ba9-ac53-47de-a84f-91325e26c417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:39:59.155008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 413/842] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:39:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:39:59.162909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f568294-e7db-488a-ae87-d4c3a382c59f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:59.216643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 430/843] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:39:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:39:59.239226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d5ba9-ac53-47de-a84f-91325e26c417 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:59.248166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:59.279818 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f568294-e7db-488a-ae87-d4c3a382c59f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:59.295886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:59.317353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21730cd3-ba05-4caa-92a8-b292e499b14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:59.318292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21730cd3-ba05-4caa-92a8-b292e499b14a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:59.318633 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21730cd3-ba05-4caa-92a8-b292e499b14a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:59.319025 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21730cd3-ba05-4caa-92a8-b292e499b14a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:59.330131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21730cd3-ba05-4caa-92a8-b292e499b14a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:59.332101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21730cd3-ba05-4caa-92a8-b292e499b14a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:59.348723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d5ba9-ac53-47de-a84f-91325e26c417 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-21730cd3-ba05-4caa-92a8-b292e499b14a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:39:59.351245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:59.352216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:59.353196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:39:59.353196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:39:59.353196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:39:59.353196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:59.353196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 414/844] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:59.360886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21730cd3-ba05-4caa-92a8-b292e499b14a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:59.386286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ee8f3-dc6a-43e5-a539-5b43ef847727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:59.387064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ee8f3-dc6a-43e5-a539-5b43ef847727 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:59.387356 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ee8f3-dc6a-43e5-a539-5b43ef847727 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:59.387642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ee8f3-dc6a-43e5-a539-5b43ef847727 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:59.388304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ee8f3-dc6a-43e5-a539-5b43ef847727 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:59.389724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ee8f3-dc6a-43e5-a539-5b43ef847727 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-689ee8f3-dc6a-43e5-a539-5b43ef847727 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:59.402693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:59.404195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:39:59.405537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:39:59.408951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 431/845] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:39:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:39:59.410187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ee8f3-dc6a-43e5-a539-5b43ef847727 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:59.470595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21730cd3-ba05-4caa-92a8-b292e499b14a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:59.485976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:59.506752 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34689c6e-c7f7-44a2-9c26-618cc485e198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:59.520814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34689c6e-c7f7-44a2-9c26-618cc485e198 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:59.520814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34689c6e-c7f7-44a2-9c26-618cc485e198 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:59.520814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34689c6e-c7f7-44a2-9c26-618cc485e198 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:59.520814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34689c6e-c7f7-44a2-9c26-618cc485e198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:59.520814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34689c6e-c7f7-44a2-9c26-618cc485e198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:59.520814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34689c6e-c7f7-44a2-9c26-618cc485e198 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:59.522351 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ee8f3-dc6a-43e5-a539-5b43ef847727 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:59.523609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 415/846] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:59.528405 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34689c6e-c7f7-44a2-9c26-618cc485e198 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:59.552700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:59.557963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6eee-662b-4bf7-990a-4741cb4b3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:59.558480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6eee-662b-4bf7-990a-4741cb4b3e92 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:59.558767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6eee-662b-4bf7-990a-4741cb4b3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:59.559046 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6eee-662b-4bf7-990a-4741cb4b3e92 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:59.559826 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e6eee-662b-4bf7-990a-4741cb4b3e92 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:59.560102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e6eee-662b-4bf7-990a-4741cb4b3e92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:59.561553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e6eee-662b-4bf7-990a-4741cb4b3e92 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:59.571833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 432/847] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:39:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:39:59.572824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6eee-662b-4bf7-990a-4741cb4b3e92 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:59.642944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34689c6e-c7f7-44a2-9c26-618cc485e198 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:59.684365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94125e-11d7-4787-a208-3a5d3d7442f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:59.685607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94125e-11d7-4787-a208-3a5d3d7442f5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:59.686114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94125e-11d7-4787-a208-3a5d3d7442f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:59.686605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94125e-11d7-4787-a208-3a5d3d7442f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:59.690112 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6eee-662b-4bf7-990a-4741cb4b3e92 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:59.695501 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94125e-11d7-4787-a208-3a5d3d7442f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:59.697216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94125e-11d7-4787-a208-3a5d3d7442f5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-7e94125e-11d7-4787-a208-3a5d3d7442f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:39:59.713194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:39:59.714186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:39:59.715079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:39:59.715079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:39:59.715079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:39:59.715079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:39:59.715079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:39:59.715079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:39:59.715079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:39:59.715079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:39:59.722170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 416/848] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:39:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:39:59.723227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94125e-11d7-4787-a208-3a5d3d7442f5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:39:59.726960 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd0466-57a4-4ed5-bde6-1f78c2875b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:59.727629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd0466-57a4-4ed5-bde6-1f78c2875b77 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:59.727915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd0466-57a4-4ed5-bde6-1f78c2875b77 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:59.728194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd0466-57a4-4ed5-bde6-1f78c2875b77 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:59.729695 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd0466-57a4-4ed5-bde6-1f78c2875b77 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:59.729695 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd0466-57a4-4ed5-bde6-1f78c2875b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:59.730839 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd0466-57a4-4ed5-bde6-1f78c2875b77 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:59.732135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:59.736518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 433/849] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:39:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:59.827449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:39:59.851008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94125e-11d7-4787-a208-3a5d3d7442f5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:39:59.891347 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f14b2-6f3a-4b4f-b8ca-6d3237da9e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:39:59.892440 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f14b2-6f3a-4b4f-b8ca-6d3237da9e9b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:39:59.893010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f14b2-6f3a-4b4f-b8ca-6d3237da9e9b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:39:59.893537 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f14b2-6f3a-4b4f-b8ca-6d3237da9e9b None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:39:59.894643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f14b2-6f3a-4b4f-b8ca-6d3237da9e9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:39:59.895197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f14b2-6f3a-4b4f-b8ca-6d3237da9e9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:39:59.896986 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f14b2-6f3a-4b4f-b8ca-6d3237da9e9b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:39:59.911126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 417/850] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:39:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:39:59.918550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd0466-57a4-4ed5-bde6-1f78c2875b77 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:00.006694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c13c0-ddd0-4d66-8914-d10ceec5bf8e None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:00.007047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c13c0-ddd0-4d66-8914-d10ceec5bf8e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:00.007256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c13c0-ddd0-4d66-8914-d10ceec5bf8e None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:00.009463 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 418/851] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:00.015619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd7dc4-4347-4653-976e-834b5a2ec709 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:00.015915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd7dc4-4347-4653-976e-834b5a2ec709 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:00.016600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd7dc4-4347-4653-976e-834b5a2ec709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:00.039425 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd0466-57a4-4ed5-bde6-1f78c2875b77 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:00.040304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ffcd7dc4-4347-4653-976e-834b5a2ec709 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:00.042819 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ffcd7dc4-4347-4653-976e-834b5a2ec709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:00.076455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b5311-075a-4aa8-b5d9-1b56a3cc6481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:00.077170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b5311-075a-4aa8-b5d9-1b56a3cc6481 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:00.077488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b5311-075a-4aa8-b5d9-1b56a3cc6481 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:00.077790 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b5311-075a-4aa8-b5d9-1b56a3cc6481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:00.078678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b5311-075a-4aa8-b5d9-1b56a3cc6481 None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=90867ac821dd4adb8d52075fbd85caba) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:00.079000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b5311-075a-4aa8-b5d9-1b56a3cc6481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:00.080454 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b5311-075a-4aa8-b5d9-1b56a3cc6481 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:00.087849 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 434/852] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:39:59 2022] GET /identity/v3/role_assignments?user.id=90867ac821dd4adb8d52075fbd85caba&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:00.119938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfabfb-7ec2-403a-ab14-83aabf86cba9 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:00.120275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfabfb-7ec2-403a-ab14-83aabf86cba9 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:00.120504 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfabfb-7ec2-403a-ab14-83aabf86cba9 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:00.122297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 435/853] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:40:00.130255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d602f0-77b5-485f-8fc7-43ff42f911f0 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:00.130904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d602f0-77b5-485f-8fc7-43ff42f911f0 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:00.131117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d602f0-77b5-485f-8fc7-43ff42f911f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:00.142906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 419/854] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:00.157361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-f8d602f0-77b5-485f-8fc7-43ff42f911f0 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:00.157361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-f8d602f0-77b5-485f-8fc7-43ff42f911f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:00.167255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd7dc4-4347-4653-976e-834b5a2ec709 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:00.228011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:00.240850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 436/855] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:00.263561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d602f0-77b5-485f-8fc7-43ff42f911f0 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:00.264544 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:00.316768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd7dc4-4347-4653-976e-834b5a2ec709 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:00.365904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb264c61-b873-4e5f-a739-890e0e30e42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:00.366499 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb264c61-b873-4e5f-a739-890e0e30e42c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:00.366785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb264c61-b873-4e5f-a739-890e0e30e42c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:00.367061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb264c61-b873-4e5f-a739-890e0e30e42c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:00.379339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb264c61-b873-4e5f-a739-890e0e30e42c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-eb264c61-b873-4e5f-a739-890e0e30e42c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:40:00.387772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:00.388778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:00.389693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:00.389693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:00.389693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:00.389693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:00.389693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:40:00.389693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:40:00.389693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:40:00.389693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:40:00.389693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:40:00.389693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:40:00.389693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:40:00.389693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:00.389693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 420/856] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:40:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:00.395124 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb264c61-b873-4e5f-a739-890e0e30e42c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:00.411162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d602f0-77b5-485f-8fc7-43ff42f911f0 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:00.450257 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034b86e-02f5-4a35-af82-39fd60cdc50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:00.451172 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034b86e-02f5-4a35-af82-39fd60cdc50b None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:00.451541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034b86e-02f5-4a35-af82-39fd60cdc50b None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:00.451884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034b86e-02f5-4a35-af82-39fd60cdc50b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:00.452711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034b86e-02f5-4a35-af82-39fd60cdc50b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:00.454146 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034b86e-02f5-4a35-af82-39fd60cdc50b None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-d034b86e-02f5-4a35-af82-39fd60cdc50b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:00.468125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:00.469145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:00.470045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 437/857] 10.222.0.39 () {56 vars in 1132 bytes} [Tue May 31 20:40:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:00.475820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034b86e-02f5-4a35-af82-39fd60cdc50b None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:00.524111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb264c61-b873-4e5f-a739-890e0e30e42c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:00.534904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:00.555607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:00.562053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e2ec5-85d4-4b2f-84b1-005affa5a146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:00.562936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2ec5-85d4-4b2f-84b1-005affa5a146 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:00.563376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2ec5-85d4-4b2f-84b1-005affa5a146 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:00.563797 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2ec5-85d4-4b2f-84b1-005affa5a146 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:00.564691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2ec5-85d4-4b2f-84b1-005affa5a146 None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:00.565157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2ec5-85d4-4b2f-84b1-005affa5a146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:00.566726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2ec5-85d4-4b2f-84b1-005affa5a146 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:00.576985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 421/858] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:40:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:00.583995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e2ec5-85d4-4b2f-84b1-005affa5a146 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:00.587932 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034b86e-02f5-4a35-af82-39fd60cdc50b None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:00.623399 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe335722-9066-46cd-a2f0-d4b68230e14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:00.624062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe335722-9066-46cd-a2f0-d4b68230e14e None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:00.624341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe335722-9066-46cd-a2f0-d4b68230e14e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:00.624614 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe335722-9066-46cd-a2f0-d4b68230e14e None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:00.625314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe335722-9066-46cd-a2f0-d4b68230e14e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:00.625664 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe335722-9066-46cd-a2f0-d4b68230e14e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:00.627042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe335722-9066-46cd-a2f0-d4b68230e14e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:00.637010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 438/859] 10.222.0.39 () {56 vars in 1126 bytes} [Tue May 31 20:40:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:00.638306 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe335722-9066-46cd-a2f0-d4b68230e14e None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:00.697511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e2ec5-85d4-4b2f-84b1-005affa5a146 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:00.736550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539ccce-5b2f-43c7-8767-bc37eb1cd795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:00.737507 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539ccce-5b2f-43c7-8767-bc37eb1cd795 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:00.737906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539ccce-5b2f-43c7-8767-bc37eb1cd795 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:00.738199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539ccce-5b2f-43c7-8767-bc37eb1cd795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:00.748888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe335722-9066-46cd-a2f0-d4b68230e14e None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:00.749780 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539ccce-5b2f-43c7-8767-bc37eb1cd795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:00.751492 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539ccce-5b2f-43c7-8767-bc37eb1cd795 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-1539ccce-5b2f-43c7-8767-bc37eb1cd795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:00.770249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:00.771779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:00.772702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:00.772702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:00.772702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:00.772702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:00.772923 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:00.773004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 422/860] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:00.780666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539ccce-5b2f-43c7-8767-bc37eb1cd795 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:00.794792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77eb6d3-c871-4794-9850-3a6035c4aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:00.795808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eb6d3-c871-4794-9850-3a6035c4aa51 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:00.796290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eb6d3-c871-4794-9850-3a6035c4aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:00.796680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eb6d3-c871-4794-9850-3a6035c4aa51 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:00.797535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77eb6d3-c871-4794-9850-3a6035c4aa51 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:00.797972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77eb6d3-c871-4794-9850-3a6035c4aa51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:00.799650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77eb6d3-c871-4794-9850-3a6035c4aa51 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:00.806639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 439/861] 10.222.0.39 () {56 vars in 1126 bytes} [Tue May 31 20:40:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:00.839825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:00.903013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539ccce-5b2f-43c7-8767-bc37eb1cd795 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:00.943517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66a9cd-738b-4608-a973-1c681ddceefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:00.944195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66a9cd-738b-4608-a973-1c681ddceefa None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:00.944482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66a9cd-738b-4608-a973-1c681ddceefa None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:00.944763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66a9cd-738b-4608-a973-1c681ddceefa None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:00.945793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66a9cd-738b-4608-a973-1c681ddceefa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:00.946106 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66a9cd-738b-4608-a973-1c681ddceefa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:00.947579 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66a9cd-738b-4608-a973-1c681ddceefa None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:00.962161 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 423/862] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:00.967745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77eb6d3-c871-4794-9850-3a6035c4aa51 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:01.089073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77eb6d3-c871-4794-9850-3a6035c4aa51 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:01.124748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666b9b5-b6a4-4ab2-b0a1-d07ada3685d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:01.125582 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b9b5-b6a4-4ab2-b0a1-d07ada3685d7 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:01.125866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b9b5-b6a4-4ab2-b0a1-d07ada3685d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:01.126140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b9b5-b6a4-4ab2-b0a1-d07ada3685d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:01.134438 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666b9b5-b6a4-4ab2-b0a1-d07ada3685d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:01.135904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666b9b5-b6a4-4ab2-b0a1-d07ada3685d7 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-6666b9b5-b6a4-4ab2-b0a1-d07ada3685d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:40:01.150770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:01.151777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:01.153113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:01.153113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:01.153113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:40:01.153113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:40:01.153113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:40:01.153113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:40:01.153113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:40:01.153113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:40:01.153113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:40:01.153113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:01.153113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 440/863] 10.222.0.39 () {56 vars in 1117 bytes} [Tue May 31 20:40:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:01.157822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66a9cd-738b-4608-a973-1c681ddceefa None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:01.265468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66a9cd-738b-4608-a973-1c681ddceefa None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:01.268146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:01.303225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93611eb-0f35-45f7-bf0a-22b6526fb4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:01.304266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93611eb-0f35-45f7-bf0a-22b6526fb4d6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:01.304770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93611eb-0f35-45f7-bf0a-22b6526fb4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:01.305256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93611eb-0f35-45f7-bf0a-22b6526fb4d6 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:01.306312 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93611eb-0f35-45f7-bf0a-22b6526fb4d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:01.306852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93611eb-0f35-45f7-bf0a-22b6526fb4d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:01.308486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93611eb-0f35-45f7-bf0a-22b6526fb4d6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:01.328927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 424/864] 10.222.0.39 () {56 vars in 1149 bytes} [Tue May 31 20:40:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:01.334551 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666b9b5-b6a4-4ab2-b0a1-d07ada3685d7 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:01.388499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:01.442997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666b9b5-b6a4-4ab2-b0a1-d07ada3685d7 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:01.479658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8f530-6811-46dc-b1f0-ea5d68d127b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:01.480314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8f530-6811-46dc-b1f0-ea5d68d127b0 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:01.480597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8f530-6811-46dc-b1f0-ea5d68d127b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:01.480873 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8f530-6811-46dc-b1f0-ea5d68d127b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:01.551621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8f530-6811-46dc-b1f0-ea5d68d127b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:01.553578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8f530-6811-46dc-b1f0-ea5d68d127b0 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:01.601098 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:01.658532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 441/865] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:40:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:40:01.666505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93611eb-0f35-45f7-bf0a-22b6526fb4d6 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:01.778153 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93611eb-0f35-45f7-bf0a-22b6526fb4d6 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:01.813843 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b6acc-ec26-4e40-ab19-0afed8ddd2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:01.814886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b6acc-ec26-4e40-ab19-0afed8ddd2a4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:01.815311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b6acc-ec26-4e40-ab19-0afed8ddd2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:01.815723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b6acc-ec26-4e40-ab19-0afed8ddd2a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:01.827798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b6acc-ec26-4e40-ab19-0afed8ddd2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:01.829571 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b6acc-ec26-4e40-ab19-0afed8ddd2a4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-a68b6acc-ec26-4e40-ab19-0afed8ddd2a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:01.847661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:01.848794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:01.849848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:01.849848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:01.849848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:01.849848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:01.855199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 425/866] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:01.856578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8f530-6811-46dc-b1f0-ea5d68d127b0 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:01.961266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8f530-6811-46dc-b1f0-ea5d68d127b0 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:01.997570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df31fd-a524-4db2-85ea-9ae8efb3a71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:01.998240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df31fd-a524-4db2-85ea-9ae8efb3a71d None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:01.998523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df31fd-a524-4db2-85ea-9ae8efb3a71d None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:01.998798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df31fd-a524-4db2-85ea-9ae8efb3a71d None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:01.999521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df31fd-a524-4db2-85ea-9ae8efb3a71d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:01.999829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df31fd-a524-4db2-85ea-9ae8efb3a71d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:02.001200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df31fd-a524-4db2-85ea-9ae8efb3a71d None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:02.013302 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 442/867] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:02.018813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b6acc-ec26-4e40-ab19-0afed8ddd2a4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:02.035835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:02.070550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e484160-ec1c-4474-9ff6-91dd530fb9b0 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:02.071175 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e484160-ec1c-4474-9ff6-91dd530fb9b0 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:02.071658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e484160-ec1c-4474-9ff6-91dd530fb9b0 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:02.073565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 443/868] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:02.078898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2793b-2136-4881-a7fb-7b3319f88143 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:02.079465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2793b-2136-4881-a7fb-7b3319f88143 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:02.079944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2793b-2136-4881-a7fb-7b3319f88143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:02.097767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:02.103512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-7ca2793b-2136-4881-a7fb-7b3319f88143 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:02.105452 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7ca2793b-2136-4881-a7fb-7b3319f88143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:02.132261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b6acc-ec26-4e40-ab19-0afed8ddd2a4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:02.169351 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b5a37-026b-43fb-9adf-62d68174da5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:02.170464 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b5a37-026b-43fb-9adf-62d68174da5a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:02.170952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b5a37-026b-43fb-9adf-62d68174da5a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:02.171398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b5a37-026b-43fb-9adf-62d68174da5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:02.179886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b5a37-026b-43fb-9adf-62d68174da5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:02.181650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b5a37-026b-43fb-9adf-62d68174da5a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:02.201401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 444/869] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-fe6b5a37-026b-43fb-9adf-62d68174da5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:40:02.201596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:02.202447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:02.203333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:40:02.203333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:40:02.203333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:40:02.203333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:40:02.203333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:40:02.203333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:40:02.203333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:02.203333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:02.203333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 426/870] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:02.209610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2793b-2136-4881-a7fb-7b3319f88143 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:02.220660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b5a37-026b-43fb-9adf-62d68174da5a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:02.315076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:02.341768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b5a37-026b-43fb-9adf-62d68174da5a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:02.351795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2793b-2136-4881-a7fb-7b3319f88143 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:02.381979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fe9cc-5bb9-4b75-a149-3b9bddd46805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:02.383060 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fe9cc-5bb9-4b75-a149-3b9bddd46805 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:02.383349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fe9cc-5bb9-4b75-a149-3b9bddd46805 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:02.383629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fe9cc-5bb9-4b75-a149-3b9bddd46805 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:02.384630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fe9cc-5bb9-4b75-a149-3b9bddd46805 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:02.386317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fe9cc-5bb9-4b75-a149-3b9bddd46805 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:02.395134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d02fbb-80f4-4d58-901e-60e6beee591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:02.396411 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02fbb-80f4-4d58-901e-60e6beee591a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:02.396775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02fbb-80f4-4d58-901e-60e6beee591a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:02.397120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02fbb-80f4-4d58-901e-60e6beee591a None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:02.398004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d02fbb-80f4-4d58-901e-60e6beee591a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:02.398474 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d02fbb-80f4-4d58-901e-60e6beee591a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:02.400138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d02fbb-80f4-4d58-901e-60e6beee591a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:02.401980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:02.413412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 445/871] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:02.418974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d02fbb-80f4-4d58-901e-60e6beee591a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:02.473775 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 427/872] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:40:02 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:40:02.541591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d02fbb-80f4-4d58-901e-60e6beee591a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:02.570304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c316ad4-331f-4d03-a2d2-310e7eb5ad66 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:02.570604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c316ad4-331f-4d03-a2d2-310e7eb5ad66 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:02.570894 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c316ad4-331f-4d03-a2d2-310e7eb5ad66 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:02.572594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 428/873] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:40:02.578255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd03817-c77d-4048-934c-e5f349de970b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:02.578548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd03817-c77d-4048-934c-e5f349de970b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:02.578828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd03817-c77d-4048-934c-e5f349de970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:02.590023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db3e33-7f59-4a50-bf07-41a83f9ab2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:02.591314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db3e33-7f59-4a50-bf07-41a83f9ab2f0 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:02.591836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db3e33-7f59-4a50-bf07-41a83f9ab2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:02.592300 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db3e33-7f59-4a50-bf07-41a83f9ab2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:02.593364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db3e33-7f59-4a50-bf07-41a83f9ab2f0 None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=9ba18c72dcba4cc4aa863783f325e780) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:02.593899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db3e33-7f59-4a50-bf07-41a83f9ab2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:02.595560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db3e33-7f59-4a50-bf07-41a83f9ab2f0 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:02.597345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-efd03817-c77d-4048-934c-e5f349de970b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:02.599353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-efd03817-c77d-4048-934c-e5f349de970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:02.604188 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 446/874] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:40:02 2022] GET /identity/v3/role_assignments?user.id=9ba18c72dcba4cc4aa863783f325e780&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:02.688077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 429/875] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:02.710832 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db3e33-7f59-4a50-bf07-41a83f9ab2f0 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:02.780139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:02.832372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db3e33-7f59-4a50-bf07-41a83f9ab2f0 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:02.870357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aa85c-ed99-498a-ac26-659ab2b52fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:02.871498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aa85c-ed99-498a-ac26-659ab2b52fb3 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:02.872001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aa85c-ed99-498a-ac26-659ab2b52fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:02.872471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aa85c-ed99-498a-ac26-659ab2b52fb3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:02.873291 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1aa85c-ed99-498a-ac26-659ab2b52fb3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:02.875043 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1aa85c-ed99-498a-ac26-659ab2b52fb3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-8d1aa85c-ed99-498a-ac26-659ab2b52fb3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:02.888707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:02.890031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:02.890898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:02.892893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 447/876] 10.222.0.39 () {56 vars in 1126 bytes} [Tue May 31 20:40:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:02.900152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd03817-c77d-4048-934c-e5f349de970b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:02.972345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:03.015251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd03817-c77d-4048-934c-e5f349de970b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:03.051910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8c1c8-7865-44f1-8931-4f1d285a72b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:03.052583 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c1c8-7865-44f1-8931-4f1d285a72b6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:03.052868 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c1c8-7865-44f1-8931-4f1d285a72b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:03.053152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c1c8-7865-44f1-8931-4f1d285a72b6 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:03.053889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8c1c8-7865-44f1-8931-4f1d285a72b6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:03.054199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8c1c8-7865-44f1-8931-4f1d285a72b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:03.055709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8c1c8-7865-44f1-8931-4f1d285a72b6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:03.061020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 430/877] 10.222.0.39 () {56 vars in 1122 bytes} [Tue May 31 20:40:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:03.066645 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aa85c-ed99-498a-ac26-659ab2b52fb3 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:03.175697 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aa85c-ed99-498a-ac26-659ab2b52fb3 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:03.197964 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:03.212971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa164376-f29d-4933-9953-9adfda864f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:03.213770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa164376-f29d-4933-9953-9adfda864f81 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:03.214058 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa164376-f29d-4933-9953-9adfda864f81 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:03.216922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa164376-f29d-4933-9953-9adfda864f81 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:03.216922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa164376-f29d-4933-9953-9adfda864f81 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:03.216922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa164376-f29d-4933-9953-9adfda864f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:03.216922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa164376-f29d-4933-9953-9adfda864f81 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:03.221738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 448/878] 10.222.0.39 () {56 vars in 1122 bytes} [Tue May 31 20:40:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:03.240189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc994-428a-4158-b72d-3d7e137f55b3 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:03.240535 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc994-428a-4158-b72d-3d7e137f55b3 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:03.240750 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc994-428a-4158-b72d-3d7e137f55b3 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:03.242524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 431/879] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:03.248017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226cdb4-2dc3-4f97-be35-d8ec8cb45230 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:03.248304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226cdb4-2dc3-4f97-be35-d8ec8cb45230 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:03.248584 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226cdb4-2dc3-4f97-be35-d8ec8cb45230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:03.267434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-0226cdb4-2dc3-4f97-be35-d8ec8cb45230 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:03.268633 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0226cdb4-2dc3-4f97-be35-d8ec8cb45230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:03.353536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 449/880] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:03 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:03.370118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fc994-428a-4158-b72d-3d7e137f55b3 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:03.490797 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fc994-428a-4158-b72d-3d7e137f55b3 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:03.518754 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:03.528134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cba8f1-36b3-4918-88a7-c5c091231a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:03.529048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cba8f1-36b3-4918-88a7-c5c091231a46 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:03.534952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cba8f1-36b3-4918-88a7-c5c091231a46 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:03.534952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cba8f1-36b3-4918-88a7-c5c091231a46 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:03.534952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cba8f1-36b3-4918-88a7-c5c091231a46 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:03.534952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cba8f1-36b3-4918-88a7-c5c091231a46 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:03.647407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 432/881] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:40:03 2022] POST /identity/v3/services => generated 269 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:40:04.889673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c165b35-8267-4bc6-9509-39ba796087ed None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:04.890201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c165b35-8267-4bc6-9509-39ba796087ed None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:04.890201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c165b35-8267-4bc6-9509-39ba796087ed None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:04.891821 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 450/882] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:04.897438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c98930-3dbd-4c07-a17a-5319c8ddb2e9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:04.897894 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c98930-3dbd-4c07-a17a-5319c8ddb2e9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:04.898075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c98930-3dbd-4c07-a17a-5319c8ddb2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:04.915691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c5c98930-3dbd-4c07-a17a-5319c8ddb2e9 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:04.916887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c5c98930-3dbd-4c07-a17a-5319c8ddb2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:04.994907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 433/883] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:05.018291 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c165b35-8267-4bc6-9509-39ba796087ed None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:05.124649 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c165b35-8267-4bc6-9509-39ba796087ed None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:05.138549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:05.159590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e0a25-74a5-4173-8ac3-6e4e789598e1 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:05.159590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e0a25-74a5-4173-8ac3-6e4e789598e1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:05.159590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e0a25-74a5-4173-8ac3-6e4e789598e1 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:05.159590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 434/884] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:40:05.163080 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bb7ab-36f7-47de-aa49-e05780f4d5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:05.165265 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8fc8-dee3-40e0-895d-f28634da337b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:05.165627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8fc8-dee3-40e0-895d-f28634da337b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:05.165905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8fc8-dee3-40e0-895d-f28634da337b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:05.169580 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bb7ab-36f7-47de-aa49-e05780f4d5d5 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:05.170102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bb7ab-36f7-47de-aa49-e05780f4d5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:05.170924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bb7ab-36f7-47de-aa49-e05780f4d5d5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:05.172862 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bb7ab-36f7-47de-aa49-e05780f4d5d5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:05.174520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bb7ab-36f7-47de-aa49-e05780f4d5d5 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:05.183828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-55af8fc8-dee3-40e0-895d-f28634da337b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:05.185010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-55af8fc8-dee3-40e0-895d-f28634da337b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-4f3bb7ab-36f7-47de-aa49-e05780f4d5d5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:05.190941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:05.192004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:40:05.192870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:05.199999 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 451/885] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:40:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:05.200687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bb7ab-36f7-47de-aa49-e05780f4d5d5 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:05.269720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 435/886] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:05.288929 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af8fc8-dee3-40e0-895d-f28634da337b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:05.322947 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bb7ab-36f7-47de-aa49-e05780f4d5d5 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:05.351843 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:05.359403 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d64de-f97a-4724-aa78-e7b9a24dc20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:05.360081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d64de-f97a-4724-aa78-e7b9a24dc20f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:05.360367 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d64de-f97a-4724-aa78-e7b9a24dc20f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:05.366077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d64de-f97a-4724-aa78-e7b9a24dc20f None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:05.366077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d64de-f97a-4724-aa78-e7b9a24dc20f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:05.366077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d64de-f97a-4724-aa78-e7b9a24dc20f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:05.366077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d64de-f97a-4724-aa78-e7b9a24dc20f None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:05.373115 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 452/887] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:40:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:05.374693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d64de-f97a-4724-aa78-e7b9a24dc20f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:05.420439 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:05.425039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af8fc8-dee3-40e0-895d-f28634da337b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:05.464869 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44cd59-0d91-4443-bde8-b341774f9898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:05.466077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44cd59-0d91-4443-bde8-b341774f9898 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:05.466539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44cd59-0d91-4443-bde8-b341774f9898 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:05.467015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44cd59-0d91-4443-bde8-b341774f9898 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:05.480028 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44cd59-0d91-4443-bde8-b341774f9898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:40:05.485286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d64de-f97a-4724-aa78-e7b9a24dc20f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-de44cd59-0d91-4443-bde8-b341774f9898 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:40:05.490603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:05.491660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:05.492491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:05.492491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:05.492491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:05.492491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:05.492491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:40:05.492491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:40:05.492491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:40:05.492491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:40:05.492491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:40:05.492491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:40:05.492491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:40:05.492491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:05.499428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 436/888] 10.222.0.39 () {56 vars in 1120 bytes} [Tue May 31 20:40:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:05.500527 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44cd59-0d91-4443-bde8-b341774f9898 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:05.523418 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea743b3-df02-4257-8258-b2721d1ad6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:05.524242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea743b3-df02-4257-8258-b2721d1ad6f3 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:05.524631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea743b3-df02-4257-8258-b2721d1ad6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:05.525032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea743b3-df02-4257-8258-b2721d1ad6f3 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:05.525904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea743b3-df02-4257-8258-b2721d1ad6f3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:05.526308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea743b3-df02-4257-8258-b2721d1ad6f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:05.527853 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea743b3-df02-4257-8258-b2721d1ad6f3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:05.537553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 453/889] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:40:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:05.540142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea743b3-df02-4257-8258-b2721d1ad6f3 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:05.615043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44cd59-0d91-4443-bde8-b341774f9898 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:05.618210 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:05.653813 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea743b3-df02-4257-8258-b2721d1ad6f3 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:05.654342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257f1c2-43d6-4fce-8a60-ccb6c56560c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:05.655012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257f1c2-43d6-4fce-8a60-ccb6c56560c4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:05.655293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257f1c2-43d6-4fce-8a60-ccb6c56560c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:05.655566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257f1c2-43d6-4fce-8a60-ccb6c56560c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:05.656309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257f1c2-43d6-4fce-8a60-ccb6c56560c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:05.656614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257f1c2-43d6-4fce-8a60-ccb6c56560c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:05.658048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257f1c2-43d6-4fce-8a60-ccb6c56560c4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:05.658412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:05.673113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 437/890] 10.222.0.39 () {56 vars in 1115 bytes} [Tue May 31 20:40:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:05.673113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4de04-4403-49d5-89fe-a37e5a32df4d None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:05.673113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4de04-4403-49d5-89fe-a37e5a32df4d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:05.673113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4de04-4403-49d5-89fe-a37e5a32df4d None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:05.673113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 438/891] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:05.674236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4de04-4403-49d5-89fe-a37e5a32df4d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:05.699974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac79d5a-713c-47fd-9bb0-c091dde290d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:05.700871 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79d5a-713c-47fd-9bb0-c091dde290d5 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:05.701289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79d5a-713c-47fd-9bb0-c091dde290d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:05.701760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79d5a-713c-47fd-9bb0-c091dde290d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:05.702685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac79d5a-713c-47fd-9bb0-c091dde290d5 None admin] RBAC: Adding query filter params (interface=public, service_id=2d5f2230237443fe8a00d8811ec59a18, region_id=RegionOne) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:05.703141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac79d5a-713c-47fd-9bb0-c091dde290d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:05.704711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac79d5a-713c-47fd-9bb0-c091dde290d5 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:05.710893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 454/892] 10.222.0.39 () {56 vars in 1251 bytes} [Tue May 31 20:40:05 2022] GET /identity/v3/endpoints?service_id=2d5f2230237443fe8a00d8811ec59a18&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:05.712294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686794-7fde-4ac3-9302-0907bc80d32e None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:05.712582 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686794-7fde-4ac3-9302-0907bc80d32e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:05.712855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686794-7fde-4ac3-9302-0907bc80d32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:05.730015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6e686794-7fde-4ac3-9302-0907bc80d32e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:05.731203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6e686794-7fde-4ac3-9302-0907bc80d32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:05.793144 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4de04-4403-49d5-89fe-a37e5a32df4d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:05.802890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 455/893] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:05.809687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686794-7fde-4ac3-9302-0907bc80d32e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:05.843010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bc8e2-c9c2-435f-af39-80c0e073f68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:05.843807 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bc8e2-c9c2-435f-af39-80c0e073f68c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:05.844090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bc8e2-c9c2-435f-af39-80c0e073f68c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:05.844364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bc8e2-c9c2-435f-af39-80c0e073f68c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:05.856112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bc8e2-c9c2-435f-af39-80c0e073f68c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:05.857672 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bc8e2-c9c2-435f-af39-80c0e073f68c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-121bc8e2-c9c2-435f-af39-80c0e073f68c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:05.876506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:05.877522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:05.878420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:05.878420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:05.878420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:05.878420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:05.878420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 439/894] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:05.878694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bc8e2-c9c2-435f-af39-80c0e073f68c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:05.901420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:05.920241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:05.924738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686794-7fde-4ac3-9302-0907bc80d32e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:05.965483 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd98db-c0d0-43fc-b511-39767603e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:05.966401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd98db-c0d0-43fc-b511-39767603e546 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:05.966679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd98db-c0d0-43fc-b511-39767603e546 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:05.966951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd98db-c0d0-43fc-b511-39767603e546 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:05.967623 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd98db-c0d0-43fc-b511-39767603e546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:05.968987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd98db-c0d0-43fc-b511-39767603e546 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:05.975152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 456/895] 10.222.0.39 () {56 vars in 1087 bytes} [Tue May 31 20:40:05 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:40:05.975916 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd98db-c0d0-43fc-b511-39767603e546 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:05.991015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bc8e2-c9c2-435f-af39-80c0e073f68c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:06.034042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2ea51-0f64-4137-8c11-8a92c0be8130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:06.034832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2ea51-0f64-4137-8c11-8a92c0be8130 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:06.035111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2ea51-0f64-4137-8c11-8a92c0be8130 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:06.035500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2ea51-0f64-4137-8c11-8a92c0be8130 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:06.037206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2ea51-0f64-4137-8c11-8a92c0be8130 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:06.038740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2ea51-0f64-4137-8c11-8a92c0be8130 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:06.097123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd98db-c0d0-43fc-b511-39767603e546 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:06.136405 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b24f4b-9e47-4330-a26e-199c07deece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:06.137180 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b24f4b-9e47-4330-a26e-199c07deece3 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:06.137491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b24f4b-9e47-4330-a26e-199c07deece3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:06.137775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b24f4b-9e47-4330-a26e-199c07deece3 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:06.145738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b24f4b-9e47-4330-a26e-199c07deece3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:06.145941 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 440/896] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:40:05 2022] POST /identity/v3/services => generated 241 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:40:06.146021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b24f4b-9e47-4330-a26e-199c07deece3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:06.146117 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d444d-dc74-4079-a6c8-5c866d54e135 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:06.146117 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d444d-dc74-4079-a6c8-5c866d54e135 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:06.146253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b24f4b-9e47-4330-a26e-199c07deece3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:06.146331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d444d-dc74-4079-a6c8-5c866d54e135 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:06.147857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 441/897] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:06.148491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50635b16-ab50-4994-87b7-465bfa578639 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:06.148787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50635b16-ab50-4994-87b7-465bfa578639 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:06.149083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50635b16-ab50-4994-87b7-465bfa578639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:06.169086 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 457/898] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:06.170306 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b24f4b-9e47-4330-a26e-199c07deece3 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:06.170419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-50635b16-ab50-4994-87b7-465bfa578639 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:06.171693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-50635b16-ab50-4994-87b7-465bfa578639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:06.206726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:06.273159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 442/899] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:06.315167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50635b16-ab50-4994-87b7-465bfa578639 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:06.333543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b24f4b-9e47-4330-a26e-199c07deece3 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:06.337910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:06.406011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f971c96-ae0e-4f0a-8f6a-782488359408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:06.406830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f971c96-ae0e-4f0a-8f6a-782488359408 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:06.407107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f971c96-ae0e-4f0a-8f6a-782488359408 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:06.407377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f971c96-ae0e-4f0a-8f6a-782488359408 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:06.415962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f971c96-ae0e-4f0a-8f6a-782488359408 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:06.419510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f971c96-ae0e-4f0a-8f6a-782488359408 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-6f971c96-ae0e-4f0a-8f6a-782488359408 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:40:06.434293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:06.435317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:06.436266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:06.436266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:06.436266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:40:06.436266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:40:06.436266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:40:06.436266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:40:06.436266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:40:06.436266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:40:06.436266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:40:06.436266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:06.436266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 458/900] 10.222.0.39 () {56 vars in 1117 bytes} [Tue May 31 20:40:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:06.440600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f971c96-ae0e-4f0a-8f6a-782488359408 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:06.469280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50635b16-ab50-4994-87b7-465bfa578639 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:06.506139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6adce9-04cf-412a-b0bd-03cbc5d33c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:06.507251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6adce9-04cf-412a-b0bd-03cbc5d33c31 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:06.507678 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6adce9-04cf-412a-b0bd-03cbc5d33c31 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:06.508120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6adce9-04cf-412a-b0bd-03cbc5d33c31 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:06.508918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6adce9-04cf-412a-b0bd-03cbc5d33c31 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:06.510630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6adce9-04cf-412a-b0bd-03cbc5d33c31 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-2b6adce9-04cf-412a-b0bd-03cbc5d33c31 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:06.523806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:06.524990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:40:06.525852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:06.528363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 443/901] 10.222.0.39 () {56 vars in 1132 bytes} [Tue May 31 20:40:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:06.534415 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6adce9-04cf-412a-b0bd-03cbc5d33c31 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:06.539086 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:06.558592 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f971c96-ae0e-4f0a-8f6a-782488359408 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:06.596304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274edfa9-56fc-4ee2-8eb5-a297310c04e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:06.596984 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274edfa9-56fc-4ee2-8eb5-a297310c04e5 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:06.597268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274edfa9-56fc-4ee2-8eb5-a297310c04e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:06.597575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274edfa9-56fc-4ee2-8eb5-a297310c04e5 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:06.598444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274edfa9-56fc-4ee2-8eb5-a297310c04e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:06.598764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274edfa9-56fc-4ee2-8eb5-a297310c04e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:06.600435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274edfa9-56fc-4ee2-8eb5-a297310c04e5 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:06.607757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:06.624651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 459/902] 10.222.0.39 () {56 vars in 1149 bytes} [Tue May 31 20:40:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:06.625593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274edfa9-56fc-4ee2-8eb5-a297310c04e5 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:06.643116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6adce9-04cf-412a-b0bd-03cbc5d33c31 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:06.681109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e675d-2362-4eb5-9b01-6dd5c026a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:06.682173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e675d-2362-4eb5-9b01-6dd5c026a641 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:06.682655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e675d-2362-4eb5-9b01-6dd5c026a641 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:06.683125 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e675d-2362-4eb5-9b01-6dd5c026a641 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:06.684043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e675d-2362-4eb5-9b01-6dd5c026a641 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:06.684547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e675d-2362-4eb5-9b01-6dd5c026a641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:06.686241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e675d-2362-4eb5-9b01-6dd5c026a641 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:06.696383 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 444/903] 10.222.0.39 () {56 vars in 1126 bytes} [Tue May 31 20:40:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:06.697666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e675d-2362-4eb5-9b01-6dd5c026a641 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:06.734652 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274edfa9-56fc-4ee2-8eb5-a297310c04e5 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:06.777520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ee4f6-fbf7-492d-a74c-dc646ca729b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:06.778182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ee4f6-fbf7-492d-a74c-dc646ca729b6 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:06.778467 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ee4f6-fbf7-492d-a74c-dc646ca729b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:06.778745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ee4f6-fbf7-492d-a74c-dc646ca729b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:06.791818 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:06.818689 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e675d-2362-4eb5-9b01-6dd5c026a641 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:06.853479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:06.859208 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d473bb-e6b0-4aae-88c2-126e10e3bdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:06.859858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d473bb-e6b0-4aae-88c2-126e10e3bdee None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:06.860140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d473bb-e6b0-4aae-88c2-126e10e3bdee None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:06.860418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d473bb-e6b0-4aae-88c2-126e10e3bdee None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:06.860797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ee4f6-fbf7-492d-a74c-dc646ca729b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:06.861130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d473bb-e6b0-4aae-88c2-126e10e3bdee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:06.861529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d473bb-e6b0-4aae-88c2-126e10e3bdee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:06.862817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ee4f6-fbf7-492d-a74c-dc646ca729b6 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:06.862948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d473bb-e6b0-4aae-88c2-126e10e3bdee None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:06.907053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 445/904] 10.222.0.39 () {56 vars in 1126 bytes} [Tue May 31 20:40:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:06.908403 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d473bb-e6b0-4aae-88c2-126e10e3bdee None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:06.995598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 460/905] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:40:06 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:40:06.996463 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ee4f6-fbf7-492d-a74c-dc646ca729b6 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:07.030452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d473bb-e6b0-4aae-88c2-126e10e3bdee None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:07.040262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:07.077135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd39fa-fc2b-4e88-be1d-8b2a66398092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:07.078514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd39fa-fc2b-4e88-be1d-8b2a66398092 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:07.079155 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd39fa-fc2b-4e88-be1d-8b2a66398092 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:07.079734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd39fa-fc2b-4e88-be1d-8b2a66398092 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:07.080765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd39fa-fc2b-4e88-be1d-8b2a66398092 None admin] RBAC: Adding query filter params (interface=public, service_id=9229131731b547029c96e76243bd7e53, region_id=RegionOne) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:07.082272 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd39fa-fc2b-4e88-be1d-8b2a66398092 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:07.085472 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd39fa-fc2b-4e88-be1d-8b2a66398092 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:07.097735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 446/906] 10.222.0.39 () {56 vars in 1251 bytes} [Tue May 31 20:40:06 2022] GET /identity/v3/endpoints?service_id=9229131731b547029c96e76243bd7e53&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:07.100158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd39fa-fc2b-4e88-be1d-8b2a66398092 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:07.110065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ee4f6-fbf7-492d-a74c-dc646ca729b6 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:07.147796 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21297993-f43b-4de2-b4b0-238e443041b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:07.149012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21297993-f43b-4de2-b4b0-238e443041b7 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:07.149125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21297993-f43b-4de2-b4b0-238e443041b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:07.149361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21297993-f43b-4de2-b4b0-238e443041b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:07.161681 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21297993-f43b-4de2-b4b0-238e443041b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:07.163292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21297993-f43b-4de2-b4b0-238e443041b7 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:07.179715 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-21297993-f43b-4de2-b4b0-238e443041b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:07.184672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:07.185598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:07.186487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:07.186487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:07.186487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:07.186487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:07.190949 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 461/907] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:07.191686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21297993-f43b-4de2-b4b0-238e443041b7 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:07.228042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd39fa-fc2b-4e88-be1d-8b2a66398092 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:07.263798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838ed23-fe57-41ab-a0a7-be5f796f8f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:07.264803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838ed23-fe57-41ab-a0a7-be5f796f8f70 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:07.265291 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838ed23-fe57-41ab-a0a7-be5f796f8f70 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:07.265788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838ed23-fe57-41ab-a0a7-be5f796f8f70 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:07.266660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838ed23-fe57-41ab-a0a7-be5f796f8f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:07.268238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838ed23-fe57-41ab-a0a7-be5f796f8f70 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:07.281414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 447/908] 10.222.0.39 () {56 vars in 1087 bytes} [Tue May 31 20:40:07 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 20:40:07.292539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:07.303962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21297993-f43b-4de2-b4b0-238e443041b7 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:07.344900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b4b16-0600-4d57-8595-f1e7ff213e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:07.345618 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4b16-0600-4d57-8595-f1e7ff213e37 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:07.345902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4b16-0600-4d57-8595-f1e7ff213e37 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:07.346180 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4b16-0600-4d57-8595-f1e7ff213e37 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:07.346919 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b4b16-0600-4d57-8595-f1e7ff213e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:07.347230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b4b16-0600-4d57-8595-f1e7ff213e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:07.349434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b4b16-0600-4d57-8595-f1e7ff213e37 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:07.362831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 462/909] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:07.371150 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838ed23-fe57-41ab-a0a7-be5f796f8f70 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:07.489464 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838ed23-fe57-41ab-a0a7-be5f796f8f70 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:07.516271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:07.528706 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd38df-47ee-4ef0-ae8a-6a91df8e57e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:07.529548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd38df-47ee-4ef0-ae8a-6a91df8e57e6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:07.529822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd38df-47ee-4ef0-ae8a-6a91df8e57e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:07.530094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd38df-47ee-4ef0-ae8a-6a91df8e57e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:07.537819 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd38df-47ee-4ef0-ae8a-6a91df8e57e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:07.539261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd38df-47ee-4ef0-ae8a-6a91df8e57e6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-16bd38df-47ee-4ef0-ae8a-6a91df8e57e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:40:07.554323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:07.555460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:07.556590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:40:07.556590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:40:07.556590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:40:07.556590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:40:07.556590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:40:07.556590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:40:07.556590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:07.556590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:07.559206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 448/910] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:40:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:07.564892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b4b16-0600-4d57-8595-f1e7ff213e37 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:07.670596 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b4b16-0600-4d57-8595-f1e7ff213e37 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:07.707359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f47a7-fa76-4661-885c-32d9a08fd3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:07.708509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f47a7-fa76-4661-885c-32d9a08fd3e6 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:07.709000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f47a7-fa76-4661-885c-32d9a08fd3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:07.709565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f47a7-fa76-4661-885c-32d9a08fd3e6 None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:07.710619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f47a7-fa76-4661-885c-32d9a08fd3e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:07.711131 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f47a7-fa76-4661-885c-32d9a08fd3e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:07.712763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f47a7-fa76-4661-885c-32d9a08fd3e6 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:07.726164 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 463/911] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:40:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:07.734666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd38df-47ee-4ef0-ae8a-6a91df8e57e6 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:07.839903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd38df-47ee-4ef0-ae8a-6a91df8e57e6 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:07.879036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0d7d9-73ab-4c11-9a7d-8385fef35be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:07.880264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0d7d9-73ab-4c11-9a7d-8385fef35be4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:07.880543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0d7d9-73ab-4c11-9a7d-8385fef35be4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:07.880817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0d7d9-73ab-4c11-9a7d-8385fef35be4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:07.881663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0d7d9-73ab-4c11-9a7d-8385fef35be4 None admin] RBAC: Adding query filter params (role.id=f800b518993746dfaa6c0f19e0e9bcb0, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=9ba18c72dcba4cc4aa863783f325e780) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:07.881975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0d7d9-73ab-4c11-9a7d-8385fef35be4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:07.883401 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0d7d9-73ab-4c11-9a7d-8385fef35be4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:07.889691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 449/912] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:40:07 2022] GET /identity/v3/role_assignments?user.id=9ba18c72dcba4cc4aa863783f325e780&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=f800b518993746dfaa6c0f19e0e9bcb0 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:08.332739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ff8d7-54c2-4be1-b2dc-5bc2de4e2461 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:08.333989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ff8d7-54c2-4be1-b2dc-5bc2de4e2461 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:08.333989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ff8d7-54c2-4be1-b2dc-5bc2de4e2461 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:08.334931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 464/913] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:08.340473 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c359c43-227c-469c-a35a-f4b76744c6bf None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:08.340902 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c359c43-227c-469c-a35a-f4b76744c6bf None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:08.341075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c359c43-227c-469c-a35a-f4b76744c6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:08.358530 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-8c359c43-227c-469c-a35a-f4b76744c6bf None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:08.359720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8c359c43-227c-469c-a35a-f4b76744c6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:08.409368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:08.434353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 450/914] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:08.458041 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ff8d7-54c2-4be1-b2dc-5bc2de4e2461 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:08.473141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:08.572423 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ff8d7-54c2-4be1-b2dc-5bc2de4e2461 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:08.588201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a79c1-3a73-4755-8414-ac85396cb808 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:08.588424 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a79c1-3a73-4755-8414-ac85396cb808 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:08.588704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a79c1-3a73-4755-8414-ac85396cb808 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:08.591481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 451/915] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:08.595781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f66c66-ae27-4bf7-a401-3229c13bd016 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:08.596072 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f66c66-ae27-4bf7-a401-3229c13bd016 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:08.596352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f66c66-ae27-4bf7-a401-3229c13bd016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:08.610874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260933e-55b3-4245-be5b-2c1cbf4e2e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:08.611906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260933e-55b3-4245-be5b-2c1cbf4e2e91 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:08.612334 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260933e-55b3-4245-be5b-2c1cbf4e2e91 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:08.612777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260933e-55b3-4245-be5b-2c1cbf4e2e91 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:08.614234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260933e-55b3-4245-be5b-2c1cbf4e2e91 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:08.614843 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e8f66c66-ae27-4bf7-a401-3229c13bd016 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:08.615969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260933e-55b3-4245-be5b-2c1cbf4e2e91 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:08.616089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e8f66c66-ae27-4bf7-a401-3229c13bd016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-c260933e-55b3-4245-be5b-2c1cbf4e2e91 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:08.629989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:08.631205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:40:08.632236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:08.634874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 465/916] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:40:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:08.643039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260933e-55b3-4245-be5b-2c1cbf4e2e91 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:08.705517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 452/917] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:08.722686 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f66c66-ae27-4bf7-a401-3229c13bd016 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:08.730181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:08.762593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260933e-55b3-4245-be5b-2c1cbf4e2e91 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:08.806124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b551b-29e2-4dce-8de9-d2d5fcc35464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:08.806798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b551b-29e2-4dce-8de9-d2d5fcc35464 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:08.807083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b551b-29e2-4dce-8de9-d2d5fcc35464 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:08.807363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b551b-29e2-4dce-8de9-d2d5fcc35464 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:08.808214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b551b-29e2-4dce-8de9-d2d5fcc35464 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:08.808538 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b551b-29e2-4dce-8de9-d2d5fcc35464 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:08.810750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b551b-29e2-4dce-8de9-d2d5fcc35464 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:08.816865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 466/918] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:40:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:08.822565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b551b-29e2-4dce-8de9-d2d5fcc35464 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:08.853328 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f66c66-ae27-4bf7-a401-3229c13bd016 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:08.864848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:08.892307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e25ef-3404-440a-a8af-b472cc33a9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:08.893445 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e25ef-3404-440a-a8af-b472cc33a9ad None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:08.894054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e25ef-3404-440a-a8af-b472cc33a9ad None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:08.894534 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e25ef-3404-440a-a8af-b472cc33a9ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:08.895611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e25ef-3404-440a-a8af-b472cc33a9ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:08.897175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e25ef-3404-440a-a8af-b472cc33a9ad None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-908e25ef-3404-440a-a8af-b472cc33a9ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:08.911874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:08.912915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:08.914016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:08.916749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 453/919] 10.222.0.39 () {56 vars in 1126 bytes} [Tue May 31 20:40:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:08.922654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e25ef-3404-440a-a8af-b472cc33a9ad None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:08.938348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b551b-29e2-4dce-8de9-d2d5fcc35464 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:08.986893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae6b96-6e6d-452e-a782-a93f448cd9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:08.988128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae6b96-6e6d-452e-a782-a93f448cd9c2 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:08.989144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae6b96-6e6d-452e-a782-a93f448cd9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:08.989763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae6b96-6e6d-452e-a782-a93f448cd9c2 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:08.990969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae6b96-6e6d-452e-a782-a93f448cd9c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:08.991708 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae6b96-6e6d-452e-a782-a93f448cd9c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:08.993770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae6b96-6e6d-452e-a782-a93f448cd9c2 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:09.005769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 467/920] 10.222.0.39 () {56 vars in 1114 bytes} [Tue May 31 20:40:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:09.007505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae6b96-6e6d-452e-a782-a93f448cd9c2 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:09.012816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:09.041756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e25ef-3404-440a-a8af-b472cc33a9ad None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:09.084189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c730b86-06a5-4aef-9cc8-bd6db3800026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:09.084778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c730b86-06a5-4aef-9cc8-bd6db3800026 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:09.085109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c730b86-06a5-4aef-9cc8-bd6db3800026 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:09.085429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c730b86-06a5-4aef-9cc8-bd6db3800026 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:09.086178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c730b86-06a5-4aef-9cc8-bd6db3800026 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:09.086493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c730b86-06a5-4aef-9cc8-bd6db3800026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:09.087871 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c730b86-06a5-4aef-9cc8-bd6db3800026 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:09.093448 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 454/921] 10.222.0.39 () {56 vars in 1122 bytes} [Tue May 31 20:40:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:09.101830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c730b86-06a5-4aef-9cc8-bd6db3800026 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:09.141841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:09.149551 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae6b96-6e6d-452e-a782-a93f448cd9c2 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:09.189727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729768b-593a-43c3-a850-4f1250f0cd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:09.190554 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729768b-593a-43c3-a850-4f1250f0cd65 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:09.190945 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729768b-593a-43c3-a850-4f1250f0cd65 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:09.191327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729768b-593a-43c3-a850-4f1250f0cd65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:09.192280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729768b-593a-43c3-a850-4f1250f0cd65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:09.194139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729768b-593a-43c3-a850-4f1250f0cd65 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:09.208361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c730b86-06a5-4aef-9cc8-bd6db3800026 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:09.244350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3fa73-c277-4665-a98b-7dace4f71ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:09.245011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3fa73-c277-4665-a98b-7dace4f71ca9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:09.245298 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3fa73-c277-4665-a98b-7dace4f71ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:09.245603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3fa73-c277-4665-a98b-7dace4f71ca9 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:09.246303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3fa73-c277-4665-a98b-7dace4f71ca9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:09.246613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3fa73-c277-4665-a98b-7dace4f71ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:09.247988 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3fa73-c277-4665-a98b-7dace4f71ca9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:09.253250 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 455/922] 10.222.0.39 () {56 vars in 1122 bytes} [Tue May 31 20:40:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:09.258951 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3fa73-c277-4665-a98b-7dace4f71ca9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:09.283880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 468/923] 10.222.0.39 () {60 vars in 1144 bytes} [Tue May 31 20:40:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:40:09.384064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:09.388480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3fa73-c277-4665-a98b-7dace4f71ca9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:09.432477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c26f0f-736d-4dee-aac6-c99cabd702a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:09.433146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c26f0f-736d-4dee-aac6-c99cabd702a4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:09.433516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c26f0f-736d-4dee-aac6-c99cabd702a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:09.433792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c26f0f-736d-4dee-aac6-c99cabd702a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:09.434617 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c26f0f-736d-4dee-aac6-c99cabd702a4 None admin] RBAC: Adding query filter params (interface=public, service_id=7bfd3de019674356bc417f2e9e521afe, region_id=RegionOne) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:09.434930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c26f0f-736d-4dee-aac6-c99cabd702a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:09.436396 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c26f0f-736d-4dee-aac6-c99cabd702a4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:09.443958 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 456/924] 10.222.0.39 () {56 vars in 1251 bytes} [Tue May 31 20:40:09 2022] GET /identity/v3/endpoints?service_id=7bfd3de019674356bc417f2e9e521afe&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:09.451794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729768b-593a-43c3-a850-4f1250f0cd65 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:09.522937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:09.570963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729768b-593a-43c3-a850-4f1250f0cd65 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:09.606870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad431b-1cd1-4fbf-adf9-04d84b4a56aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:09.607546 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad431b-1cd1-4fbf-adf9-04d84b4a56aa None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:09.607831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad431b-1cd1-4fbf-adf9-04d84b4a56aa None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:09.608103 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad431b-1cd1-4fbf-adf9-04d84b4a56aa None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:09.608787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad431b-1cd1-4fbf-adf9-04d84b4a56aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:09.610330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad431b-1cd1-4fbf-adf9-04d84b4a56aa None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:09.617623 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 469/925] 10.222.0.39 () {56 vars in 1087 bytes} [Tue May 31 20:40:09 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:40:09.796999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3036-611f-4aa4-b407-54ade58449ef None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:09.797291 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3036-611f-4aa4-b407-54ade58449ef None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:09.797602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3036-611f-4aa4-b407-54ade58449ef None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:09.799326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 457/926] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:09.805224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbddf9c-f674-4bac-9a5e-dee74d681382 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:09.805558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbddf9c-f674-4bac-9a5e-dee74d681382 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:09.805845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbddf9c-f674-4bac-9a5e-dee74d681382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:09.825001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-ffbddf9c-f674-4bac-9a5e-dee74d681382 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:09.826390 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ffbddf9c-f674-4bac-9a5e-dee74d681382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:09.905701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 470/927] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:09.929209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e3036-611f-4aa4-b407-54ade58449ef None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:10.043688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e3036-611f-4aa4-b407-54ade58449ef None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:10.079992 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124f51b-ebc6-4e94-a2ed-bf087c5006eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:10.080726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124f51b-ebc6-4e94-a2ed-bf087c5006eb None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:10.081013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124f51b-ebc6-4e94-a2ed-bf087c5006eb None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:10.081292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124f51b-ebc6-4e94-a2ed-bf087c5006eb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:10.082662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124f51b-ebc6-4e94-a2ed-bf087c5006eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:10.084055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124f51b-ebc6-4e94-a2ed-bf087c5006eb None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-5124f51b-ebc6-4e94-a2ed-bf087c5006eb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:10.096788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:10.098414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:10.099269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 458/928] 10.222.0.39 () {56 vars in 1132 bytes} [Tue May 31 20:40:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:10.106710 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbddf9c-f674-4bac-9a5e-dee74d681382 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:10.167360 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:10.218084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbddf9c-f674-4bac-9a5e-dee74d681382 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:10.219357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afba5e-d1bc-48cb-af9a-2bfdf0a9dee0 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:10.219646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afba5e-d1bc-48cb-af9a-2bfdf0a9dee0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:10.219925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afba5e-d1bc-48cb-af9a-2bfdf0a9dee0 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:10.222282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 459/929] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:10.227434 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d8f3d-09e9-4bff-99c8-098c4a051ece None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:10.227714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d8f3d-09e9-4bff-99c8-098c4a051ece None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:10.227987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d8f3d-09e9-4bff-99c8-098c4a051ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:10.247955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-971d8f3d-09e9-4bff-99c8-098c4a051ece None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:10.249318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-971d8f3d-09e9-4bff-99c8-098c4a051ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:10.257543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d4400-53cf-4452-88e5-078d92dcc6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:10.258532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d4400-53cf-4452-88e5-078d92dcc6d4 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:10.259012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d4400-53cf-4452-88e5-078d92dcc6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:10.259506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d4400-53cf-4452-88e5-078d92dcc6d4 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:10.260408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d4400-53cf-4452-88e5-078d92dcc6d4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:10.260907 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d4400-53cf-4452-88e5-078d92dcc6d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:10.262513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d4400-53cf-4452-88e5-078d92dcc6d4 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:10.268260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 471/930] 10.222.0.39 () {56 vars in 1126 bytes} [Tue May 31 20:40:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:10.273406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:10.274558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d4400-53cf-4452-88e5-078d92dcc6d4 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:10.340619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 460/931] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:10.364042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d8f3d-09e9-4bff-99c8-098c4a051ece None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:10.415041 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d4400-53cf-4452-88e5-078d92dcc6d4 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:10.439670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:10.465783 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68710764-1a87-4ecf-be05-60c9c619b347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:10.467737 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68710764-1a87-4ecf-be05-60c9c619b347 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:10.468314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68710764-1a87-4ecf-be05-60c9c619b347 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:10.468769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68710764-1a87-4ecf-be05-60c9c619b347 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:10.469950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68710764-1a87-4ecf-be05-60c9c619b347 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:10.470469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68710764-1a87-4ecf-be05-60c9c619b347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:10.473225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68710764-1a87-4ecf-be05-60c9c619b347 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:10.480297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 472/932] 10.222.0.39 () {56 vars in 1126 bytes} [Tue May 31 20:40:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:10.487033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68710764-1a87-4ecf-be05-60c9c619b347 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:10.494221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d8f3d-09e9-4bff-99c8-098c4a051ece None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:10.529943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97066b7e-3c3b-49cf-8779-9822ac05e692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:10.530752 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97066b7e-3c3b-49cf-8779-9822ac05e692 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:10.531029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97066b7e-3c3b-49cf-8779-9822ac05e692 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:10.531298 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97066b7e-3c3b-49cf-8779-9822ac05e692 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:10.542855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97066b7e-3c3b-49cf-8779-9822ac05e692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-97066b7e-3c3b-49cf-8779-9822ac05e692 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:40:10.551160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:10.552089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:10.552945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:10.552945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:10.552945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:10.552945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:10.552945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:40:10.552945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:40:10.552945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:40:10.552945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:40:10.552945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:40:10.552945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:40:10.552945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:40:10.552945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:10.557484 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 461/933] 10.222.0.39 () {56 vars in 1120 bytes} [Tue May 31 20:40:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:10.558346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97066b7e-3c3b-49cf-8779-9822ac05e692 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:10.575559 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:10.633820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68710764-1a87-4ecf-be05-60c9c619b347 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:10.672677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97066b7e-3c3b-49cf-8779-9822ac05e692 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:10.677861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4d9d1-2021-480b-841a-1a366a398416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:10.678887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d9d1-2021-480b-841a-1a366a398416 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:10.679393 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d9d1-2021-480b-841a-1a366a398416 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:10.679884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d9d1-2021-480b-841a-1a366a398416 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:10.680852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4d9d1-2021-480b-841a-1a366a398416 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:10.682730 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4d9d1-2021-480b-841a-1a366a398416 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:10.714122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035c2e0-2beb-4bff-a66a-fc99f72a5220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:10.714806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035c2e0-2beb-4bff-a66a-fc99f72a5220 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:10.715139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035c2e0-2beb-4bff-a66a-fc99f72a5220 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:10.715362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035c2e0-2beb-4bff-a66a-fc99f72a5220 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:10.716117 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035c2e0-2beb-4bff-a66a-fc99f72a5220 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:10.716423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035c2e0-2beb-4bff-a66a-fc99f72a5220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:10.717852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035c2e0-2beb-4bff-a66a-fc99f72a5220 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:10.727965 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 462/934] 10.222.0.39 () {56 vars in 1115 bytes} [Tue May 31 20:40:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:10.733489 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035c2e0-2beb-4bff-a66a-fc99f72a5220 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:10.773824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 473/935] 10.222.0.39 () {60 vars in 1144 bytes} [Tue May 31 20:40:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:40:10.828403 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:10.856184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035c2e0-2beb-4bff-a66a-fc99f72a5220 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:10.904513 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730a8ec-2b16-4a58-937f-0a5ed1cbbfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:10.905229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730a8ec-2b16-4a58-937f-0a5ed1cbbfec None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:10.905554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730a8ec-2b16-4a58-937f-0a5ed1cbbfec None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:10.905829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730a8ec-2b16-4a58-937f-0a5ed1cbbfec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:10.917808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730a8ec-2b16-4a58-937f-0a5ed1cbbfec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:10.919282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730a8ec-2b16-4a58-937f-0a5ed1cbbfec None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-4730a8ec-2b16-4a58-937f-0a5ed1cbbfec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:10.938590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:10.939620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:10.940517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:10.940517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:10.940517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:10.940517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:10.940517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 463/936] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:10.947661 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4d9d1-2021-480b-841a-1a366a398416 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:10.996336 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:11.064330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4d9d1-2021-480b-841a-1a366a398416 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:11.099539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f96c5-9797-4cb1-b396-b56d1258d7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:11.100208 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f96c5-9797-4cb1-b396-b56d1258d7ff None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:11.100539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f96c5-9797-4cb1-b396-b56d1258d7ff None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:11.100823 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f96c5-9797-4cb1-b396-b56d1258d7ff None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:11.101661 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f96c5-9797-4cb1-b396-b56d1258d7ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:11.101978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f96c5-9797-4cb1-b396-b56d1258d7ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:11.103355 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f96c5-9797-4cb1-b396-b56d1258d7ff None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:11.116361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 474/937] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:11.121711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730a8ec-2b16-4a58-937f-0a5ed1cbbfec None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:11.226258 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730a8ec-2b16-4a58-937f-0a5ed1cbbfec None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:11.254394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:11.265271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8e9ce-7939-49fe-a3d5-166bd41b8d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:11.277024 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8e9ce-7939-49fe-a3d5-166bd41b8d46 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:11.277024 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8e9ce-7939-49fe-a3d5-166bd41b8d46 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:11.277024 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8e9ce-7939-49fe-a3d5-166bd41b8d46 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:11.277024 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8e9ce-7939-49fe-a3d5-166bd41b8d46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:11.277355 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8e9ce-7939-49fe-a3d5-166bd41b8d46 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-b8e8e9ce-7939-49fe-a3d5-166bd41b8d46 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:40:11.293911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:11.295046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:11.296013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:11.296013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:11.296013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:40:11.296013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:40:11.296013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:40:11.296013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:40:11.296013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:40:11.296013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:40:11.296013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:40:11.296013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:11.300118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 464/938] 10.222.0.39 () {56 vars in 1117 bytes} [Tue May 31 20:40:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:11.303282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f96c5-9797-4cb1-b396-b56d1258d7ff None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:11.415819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:11.419485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f96c5-9797-4cb1-b396-b56d1258d7ff None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:11.460384 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21442f-5e5a-426a-8b22-a5c8de81601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:11.461082 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21442f-5e5a-426a-8b22-a5c8de81601a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:11.461365 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21442f-5e5a-426a-8b22-a5c8de81601a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:11.461748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21442f-5e5a-426a-8b22-a5c8de81601a None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:11.462623 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21442f-5e5a-426a-8b22-a5c8de81601a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:11.462937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21442f-5e5a-426a-8b22-a5c8de81601a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:11.464527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21442f-5e5a-426a-8b22-a5c8de81601a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:11.492804 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 475/939] 10.222.0.39 () {56 vars in 1149 bytes} [Tue May 31 20:40:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:11.494682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8e9ce-7939-49fe-a3d5-166bd41b8d46 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:11.609796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8e9ce-7939-49fe-a3d5-166bd41b8d46 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:11.647053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685db2b-5663-40ff-934b-33b5af4fa2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:11.647855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685db2b-5663-40ff-934b-33b5af4fa2d7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:11.648134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685db2b-5663-40ff-934b-33b5af4fa2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:11.648409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685db2b-5663-40ff-934b-33b5af4fa2d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:11.660675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685db2b-5663-40ff-934b-33b5af4fa2d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:11.662176 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685db2b-5663-40ff-934b-33b5af4fa2d7 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-f685db2b-5663-40ff-934b-33b5af4fa2d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:11.682950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:11.684157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:11.685268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:11.685268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:11.685268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:11.685268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:11.692585 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 465/940] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:11.694825 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21442f-5e5a-426a-8b22-a5c8de81601a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:11.803861 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557a1e3-6704-4505-a25a-de3819a6c107 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:11.804174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557a1e3-6704-4505-a25a-de3819a6c107 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:11.804356 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557a1e3-6704-4505-a25a-de3819a6c107 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:11.806027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 466/941] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:11.807816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21442f-5e5a-426a-8b22-a5c8de81601a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:11.811415 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0ab61-7a03-43b1-8e0e-98ef86bac193 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:11.811564 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0ab61-7a03-43b1-8e0e-98ef86bac193 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:11.811840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0ab61-7a03-43b1-8e0e-98ef86bac193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:11.831455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-37a0ab61-7a03-43b1-8e0e-98ef86bac193 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:11.833430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-37a0ab61-7a03-43b1-8e0e-98ef86bac193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:11.850967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba2454-3024-4755-8b31-c265d1ff88bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:11.851831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba2454-3024-4755-8b31-c265d1ff88bf None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:11.852121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba2454-3024-4755-8b31-c265d1ff88bf None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:11.854884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba2454-3024-4755-8b31-c265d1ff88bf None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:11.854884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba2454-3024-4755-8b31-c265d1ff88bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:11.854884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba2454-3024-4755-8b31-c265d1ff88bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:11.855847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba2454-3024-4755-8b31-c265d1ff88bf None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:11.872939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 476/942] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:11.879310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba2454-3024-4755-8b31-c265d1ff88bf None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:11.882699 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:11.905312 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:11.932558 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 467/943] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:11.963183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0ab61-7a03-43b1-8e0e-98ef86bac193 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:12.024514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba2454-3024-4755-8b31-c265d1ff88bf None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:12.070750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67111e87-3619-4c89-9797-434600bb79dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:12.071584 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67111e87-3619-4c89-9797-434600bb79dd None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:12.071875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67111e87-3619-4c89-9797-434600bb79dd None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:12.072151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67111e87-3619-4c89-9797-434600bb79dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:12.079404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67111e87-3619-4c89-9797-434600bb79dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:12.080856 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67111e87-3619-4c89-9797-434600bb79dd None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:12.086139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0ab61-7a03-43b1-8e0e-98ef86bac193 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-67111e87-3619-4c89-9797-434600bb79dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:40:12.097235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:12.098842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:12.099741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:40:12.099741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:40:12.099741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:40:12.099741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:40:12.099741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:40:12.099741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:40:12.099741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:12.099741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:12.101694 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 477/944] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:12.103419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aab3ab-08d8-4f36-b29d-e693b440a5d1 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:12.103934 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aab3ab-08d8-4f36-b29d-e693b440a5d1 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:12.104228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aab3ab-08d8-4f36-b29d-e693b440a5d1 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:12.105777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 478/945] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:12.106314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aab3ab-08d8-4f36-b29d-e693b440a5d1 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:12.128244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05318f45-d472-4116-afc6-bd82e7283339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:12.130017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05318f45-d472-4116-afc6-bd82e7283339 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:12.130156 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05318f45-d472-4116-afc6-bd82e7283339 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:12.130420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05318f45-d472-4116-afc6-bd82e7283339 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:12.131147 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05318f45-d472-4116-afc6-bd82e7283339 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:12.133213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05318f45-d472-4116-afc6-bd82e7283339 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:12.135189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: WARNING keystone.server.flask.common [None req-05318f45-d472-4116-afc6-bd82e7283339 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 31 20:40:12.183839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.sql.core [None req-05318f45-d472-4116-afc6-bd82e7283339 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 31 20:40:12.183839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 31 20:40:12.183839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [parameters: {'id': '11b275fe833d43b59d56854ec08c7121', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 31 20:40:12.183839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87216) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 31 20:40:12.200529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:12.203232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-05318f45-d472-4116-afc6-bd82e7283339 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11b275fe833d43b59d56854ec08c7121.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11b275fe833d43b59d56854ec08c7121. May 31 20:40:12.203232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:12.203232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 20:40:12.203232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 20:40:12.203232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 20:40:12.203232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 20:40:12.203232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 20:40:12.203232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application result = self._query(query) May 31 20:40:12.203232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 20:40:12.203232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application conn.query(q) May 31 20:40:12.203232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 20:40:12.203232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 20:40:12.203232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application result.read() May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 31 20:40:12.204101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return project_ref.to_dict() May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application next(self.gen) May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application yield resource May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application next(self.gen) May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self.session.rollback() May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self.force_reraise() May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise self.value May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application session.commit() May 31 20:40:12.205051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._prepare_impl() May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self.session.flush() May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._flush(objects) May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application compat.raise_( May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application flush_context.execute() May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 31 20:40:12.206005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rec.execute(self) May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application _emit_insert_statements( May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application c = connection._execute_20( May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ret = self._execute_context( May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 31 20:40:12.206987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application result = self._query(query) May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application conn.query(q) May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application result.read() May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 20:40:12.207886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [parameters: {'id': '11b275fe833d43b59d56854ec08c7121', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:12.210466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:12.211762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:12.215720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:12.215720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 31 20:40:12.215720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 31 20:40:12.215720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:12.215720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:12.215720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 31 20:40:12.215720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.Conflict( May 31 20:40:12.215720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11b275fe833d43b59d56854ec08c7121. May 31 20:40:12.215720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:12.215720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 468/946] 10.222.0.39 () {60 vars in 1140 bytes} [Tue May 31 20:40:11 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:12.215720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db207421-23a9-4b1b-9b4f-c280f17c4baf None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:12.215720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db207421-23a9-4b1b-9b4f-c280f17c4baf None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:12.217188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db207421-23a9-4b1b-9b4f-c280f17c4baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:12.226023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-db207421-23a9-4b1b-9b4f-c280f17c4baf None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:12.227725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-db207421-23a9-4b1b-9b4f-c280f17c4baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:12.247951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aab3ab-08d8-4f36-b29d-e693b440a5d1 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:12.252607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:12.309059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e69a31-1ba6-4d98-a7aa-ac1ba53a7b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:12.310033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e69a31-1ba6-4d98-a7aa-ac1ba53a7b58 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:12.310165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 469/947] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:12.310682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e69a31-1ba6-4d98-a7aa-ac1ba53a7b58 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:12.311019 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db207421-23a9-4b1b-9b4f-c280f17c4baf None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:12.311422 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e69a31-1ba6-4d98-a7aa-ac1ba53a7b58 None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:12.312415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e69a31-1ba6-4d98-a7aa-ac1ba53a7b58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:12.312928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e69a31-1ba6-4d98-a7aa-ac1ba53a7b58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:12.315891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e69a31-1ba6-4d98-a7aa-ac1ba53a7b58 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:12.332700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 479/948] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:12.338725 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e69a31-1ba6-4d98-a7aa-ac1ba53a7b58 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:12.448019 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db207421-23a9-4b1b-9b4f-c280f17c4baf None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:12.468260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e69a31-1ba6-4d98-a7aa-ac1ba53a7b58 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:12.484440 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a86e78-318b-4c47-9be5-54a34ce0a6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:12.485420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a86e78-318b-4c47-9be5-54a34ce0a6d5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:12.485533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a86e78-318b-4c47-9be5-54a34ce0a6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:12.485816 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a86e78-318b-4c47-9be5-54a34ce0a6d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:12.493015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a86e78-318b-4c47-9be5-54a34ce0a6d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:12.494711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a86e78-318b-4c47-9be5-54a34ce0a6d5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-57a86e78-318b-4c47-9be5-54a34ce0a6d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:40:12.510059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:12.511284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:12.512185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:40:12.512185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:40:12.512185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:40:12.512185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:40:12.512185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:40:12.512185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:40:12.512185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:12.512185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:12.512615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d0f86-620a-4fa3-933c-e4a9e2d46e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:12.512615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d0f86-620a-4fa3-933c-e4a9e2d46e5a None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:12.512615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d0f86-620a-4fa3-933c-e4a9e2d46e5a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:12.513138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d0f86-620a-4fa3-933c-e4a9e2d46e5a None admin] PATH_INFO: `/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/9ba18c72dcba4cc4aa863783f325e780/roles/f800b518993746dfaa6c0f19e0e9bcb0` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:12.516122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 470/949] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:40:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:12.516236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d0f86-620a-4fa3-933c-e4a9e2d46e5a None admin] RBAC: Authorizing `identity:create_grant(project_id=69d14229f6554a34bf9084d36cffe8ac, user_id=9ba18c72dcba4cc4aa863783f325e780, role_id=f800b518993746dfaa6c0f19e0e9bcb0)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:12.516842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a86e78-318b-4c47-9be5-54a34ce0a6d5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:12.518263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d0f86-620a-4fa3-933c-e4a9e2d46e5a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:12.523122 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:12.535363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:12.618816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 480/950] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:40:12 2022] PUT /identity/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/9ba18c72dcba4cc4aa863783f325e780/roles/f800b518993746dfaa6c0f19e0e9bcb0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:40:12.620015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d0f86-620a-4fa3-933c-e4a9e2d46e5a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:12.643238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a86e78-318b-4c47-9be5-54a34ce0a6d5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:12.685541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bf8e6-b417-4a99-9830-be40868dabe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:12.686760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bf8e6-b417-4a99-9830-be40868dabe9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:12.687246 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bf8e6-b417-4a99-9830-be40868dabe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:12.687704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bf8e6-b417-4a99-9830-be40868dabe9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:12.688576 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bf8e6-b417-4a99-9830-be40868dabe9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:12.690363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bf8e6-b417-4a99-9830-be40868dabe9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-3f1bf8e6-b417-4a99-9830-be40868dabe9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:12.704823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:12.706045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:12.707555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:12.710354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 471/951] 10.222.0.39 () {56 vars in 1126 bytes} [Tue May 31 20:40:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:12.723182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bf8e6-b417-4a99-9830-be40868dabe9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:12.745957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d0f86-620a-4fa3-933c-e4a9e2d46e5a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:12.787309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b78512-152e-4f61-ac1f-14140767efed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:12.788095 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b78512-152e-4f61-ac1f-14140767efed None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:12.788444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b78512-152e-4f61-ac1f-14140767efed None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:12.788898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b78512-152e-4f61-ac1f-14140767efed None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:12.789906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b78512-152e-4f61-ac1f-14140767efed None admin] RBAC: Adding query filter params (name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:12.790299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b78512-152e-4f61-ac1f-14140767efed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:12.791901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b78512-152e-4f61-ac1f-14140767efed None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:12.813239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 481/952] 10.222.0.39 () {56 vars in 1112 bytes} [Tue May 31 20:40:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:12.828423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:12.861589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bf8e6-b417-4a99-9830-be40868dabe9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:12.908443 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176f56a-e8f4-4b9e-bff4-8775b17303c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:12.909519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176f56a-e8f4-4b9e-bff4-8775b17303c5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:12.910640 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176f56a-e8f4-4b9e-bff4-8775b17303c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:12.911159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176f56a-e8f4-4b9e-bff4-8775b17303c5 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:12.912116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176f56a-e8f4-4b9e-bff4-8775b17303c5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:12.912627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176f56a-e8f4-4b9e-bff4-8775b17303c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:12.914364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176f56a-e8f4-4b9e-bff4-8775b17303c5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:12.923692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 472/953] 10.222.0.39 () {56 vars in 1122 bytes} [Tue May 31 20:40:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:12.930393 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b78512-152e-4f61-ac1f-14140767efed None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:13.002607 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:13.055389 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b78512-152e-4f61-ac1f-14140767efed None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:13.100147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c0d56-5f6f-4734-b190-4c92d42ec92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:13.100842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c0d56-5f6f-4734-b190-4c92d42ec92a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:13.101132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c0d56-5f6f-4734-b190-4c92d42ec92a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:13.102755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c0d56-5f6f-4734-b190-4c92d42ec92a None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:13.102755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c0d56-5f6f-4734-b190-4c92d42ec92a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:13.102755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c0d56-5f6f-4734-b190-4c92d42ec92a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:13.103920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c0d56-5f6f-4734-b190-4c92d42ec92a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:13.110028 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 482/954] 10.222.0.39 () {56 vars in 1122 bytes} [Tue May 31 20:40:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:13.116046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176f56a-e8f4-4b9e-bff4-8775b17303c5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:13.233715 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176f56a-e8f4-4b9e-bff4-8775b17303c5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:13.245441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f39a5-9c51-4fc5-b349-00a6131bffac None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:13.245792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f39a5-9c51-4fc5-b349-00a6131bffac None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:13.246011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f39a5-9c51-4fc5-b349-00a6131bffac None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:13.248990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 483/955] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:13.253906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fa2c7-7e6c-431b-9041-00465ff15e0e None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:13.254205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fa2c7-7e6c-431b-9041-00465ff15e0e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:13.254489 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fa2c7-7e6c-431b-9041-00465ff15e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:13.272230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a69fa2c7-7e6c-431b-9041-00465ff15e0e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:13.273457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a69fa2c7-7e6c-431b-9041-00465ff15e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:13.274015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec510c5d-80a8-48d8-b006-758deac33b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:13.274682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510c5d-80a8-48d8-b006-758deac33b15 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:13.274965 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510c5d-80a8-48d8-b006-758deac33b15 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:13.275239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510c5d-80a8-48d8-b006-758deac33b15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:13.276321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec510c5d-80a8-48d8-b006-758deac33b15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:13.278735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec510c5d-80a8-48d8-b006-758deac33b15 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:13.292330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:13.356881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 484/956] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:13.371077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 473/957] 10.222.0.39 () {60 vars in 1144 bytes} [Tue May 31 20:40:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:40:13.381829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fa2c7-7e6c-431b-9041-00465ff15e0e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:13.450124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:13.511661 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fa2c7-7e6c-431b-9041-00465ff15e0e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:13.560673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68964c6b-c23f-4c92-bc39-85b0e397d44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:13.561517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964c6b-c23f-4c92-bc39-85b0e397d44a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:13.561785 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964c6b-c23f-4c92-bc39-85b0e397d44a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:13.562058 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964c6b-c23f-4c92-bc39-85b0e397d44a None admin] PATH_INFO: `/v3/services/compute` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:13.562719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68964c6b-c23f-4c92-bc39-85b0e397d44a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:13.564150 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68964c6b-c23f-4c92-bc39-85b0e397d44a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-68964c6b-c23f-4c92-bc39-85b0e397d44a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:13.577429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:13.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:13.581125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 485/958] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:40:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:13.586337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec510c5d-80a8-48d8-b006-758deac33b15 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:13.725682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec510c5d-80a8-48d8-b006-758deac33b15 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:13.763226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023876ac-4c89-4a77-9ae2-0290d2bc646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:13.763813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023876ac-4c89-4a77-9ae2-0290d2bc646b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:13.764093 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023876ac-4c89-4a77-9ae2-0290d2bc646b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:13.764369 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023876ac-4c89-4a77-9ae2-0290d2bc646b None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:13.765085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023876ac-4c89-4a77-9ae2-0290d2bc646b None admin] RBAC: Adding query filter params (name=compute) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:13.765407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023876ac-4c89-4a77-9ae2-0290d2bc646b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:13.766801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023876ac-4c89-4a77-9ae2-0290d2bc646b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:13.773197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 474/959] 10.222.0.39 () {56 vars in 1112 bytes} [Tue May 31 20:40:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:13.779491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68964c6b-c23f-4c92-bc39-85b0e397d44a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:13.904032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68964c6b-c23f-4c92-bc39-85b0e397d44a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:13.915779 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:13.941524 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e988-14c4-485d-b93d-51ba0d775c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:13.942366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e988-14c4-485d-b93d-51ba0d775c82 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:13.942658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e988-14c4-485d-b93d-51ba0d775c82 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:13.942938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e988-14c4-485d-b93d-51ba0d775c82 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:13.944037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31e988-14c4-485d-b93d-51ba0d775c82 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:13.944346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31e988-14c4-485d-b93d-51ba0d775c82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:13.945770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31e988-14c4-485d-b93d-51ba0d775c82 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:13.951389 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 486/960] 10.222.0.39 () {56 vars in 1112 bytes} [Tue May 31 20:40:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:15.048183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59f1c7-3a2e-40dc-b03f-702f934a7226 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:15.048702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59f1c7-3a2e-40dc-b03f-702f934a7226 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:15.048779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59f1c7-3a2e-40dc-b03f-702f934a7226 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:15.050971 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 475/961] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:15.056402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f863f5c-9fce-4192-934f-ebebcd85c040 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:15.056856 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f863f5c-9fce-4192-934f-ebebcd85c040 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:15.057003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f863f5c-9fce-4192-934f-ebebcd85c040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:15.075020 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-0f863f5c-9fce-4192-934f-ebebcd85c040 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:15.076269 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0f863f5c-9fce-4192-934f-ebebcd85c040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:15.151980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 487/962] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:15.176141 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59f1c7-3a2e-40dc-b03f-702f934a7226 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:15.246344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:15.294805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59f1c7-3a2e-40dc-b03f-702f934a7226 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:15.320949 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c881a2c-cfa2-4ed4-aa22-3b719c60690e None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:15.321279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c881a2c-cfa2-4ed4-aa22-3b719c60690e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:15.321561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c881a2c-cfa2-4ed4-aa22-3b719c60690e None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:15.323432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 488/963] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:40:15.328952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b718c9-3595-45d9-a585-3bbfdf9897a2 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:15.329309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b718c9-3595-45d9-a585-3bbfdf9897a2 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:15.329632 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b718c9-3595-45d9-a585-3bbfdf9897a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:15.334380 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e952ed9-e627-45c8-b5c7-cf09d2bee1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:15.335201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e952ed9-e627-45c8-b5c7-cf09d2bee1dd None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:15.335487 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e952ed9-e627-45c8-b5c7-cf09d2bee1dd None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:15.335762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e952ed9-e627-45c8-b5c7-cf09d2bee1dd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:15.347207 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a7b718c9-3595-45d9-a585-3bbfdf9897a2 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:15.348891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a7b718c9-3595-45d9-a585-3bbfdf9897a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:15.351413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e952ed9-e627-45c8-b5c7-cf09d2bee1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-7e952ed9-e627-45c8-b5c7-cf09d2bee1dd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:40:15.361826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:15.363386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:15.364237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:15.364237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:15.364237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:15.364237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:15.364237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:40:15.364237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:40:15.364237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:40:15.364237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:40:15.364237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:40:15.364237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:40:15.364237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:40:15.364237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:15.364237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 476/964] 10.222.0.39 () {56 vars in 1120 bytes} [Tue May 31 20:40:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:15.370652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e952ed9-e627-45c8-b5c7-cf09d2bee1dd None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:15.441401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 489/965] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:15.461497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b718c9-3595-45d9-a585-3bbfdf9897a2 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:15.500622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e952ed9-e627-45c8-b5c7-cf09d2bee1dd None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:15.501036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:15.529490 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:15.551322 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3802c-3038-4192-b71f-25f8358ff657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:15.552000 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3802c-3038-4192-b71f-25f8358ff657 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:15.552288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3802c-3038-4192-b71f-25f8358ff657 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:15.552566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3802c-3038-4192-b71f-25f8358ff657 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:15.553325 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3802c-3038-4192-b71f-25f8358ff657 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:15.553667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3802c-3038-4192-b71f-25f8358ff657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:15.555667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3802c-3038-4192-b71f-25f8358ff657 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:15.572854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 477/966] 10.222.0.39 () {56 vars in 1115 bytes} [Tue May 31 20:40:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:15.574269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3802c-3038-4192-b71f-25f8358ff657 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:15.586827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b718c9-3595-45d9-a585-3bbfdf9897a2 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:15.629651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b8280-45ff-4e6c-8022-a48b8ace5f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:15.630892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b8280-45ff-4e6c-8022-a48b8ace5f49 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:15.631383 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b8280-45ff-4e6c-8022-a48b8ace5f49 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:15.631941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b8280-45ff-4e6c-8022-a48b8ace5f49 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:15.632846 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b8280-45ff-4e6c-8022-a48b8ace5f49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:15.634782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b8280-45ff-4e6c-8022-a48b8ace5f49 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:15.636420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: WARNING keystone.server.flask.common [None req-ca9b8280-45ff-4e6c-8022-a48b8ace5f49 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 31 20:40:15.684145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.sql.core [None req-ca9b8280-45ff-4e6c-8022-a48b8ace5f49 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 31 20:40:15.684145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 31 20:40:15.684145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [parameters: {'user_id': '67ac051225904569ac407b4eb798f82d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 31 20:40:15.684145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87215) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 31 20:40:15.695524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3802c-3038-4192-b71f-25f8358ff657 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-ca9b8280-45ff-4e6c-8022-a48b8ace5f49 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application result = self._query(query) May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application conn.query(q) May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application result.read() May 31 20:40:15.696117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 20:40:15.696987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application next(self.gen) May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application yield resource May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application next(self.gen) May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self.session.rollback() May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self.force_reraise() May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise self.value May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application session.commit() May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 31 20:40:15.697988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._prepare_impl() May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self.session.flush() May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._flush(objects) May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application compat.raise_( May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application flush_context.execute() May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rec.execute(self) May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 31 20:40:15.698988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application _emit_insert_statements( May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application result = connection._execute_20( May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ret = self._execute_context( May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 20:40:15.699902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application result = self._query(query) May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application conn.query(q) May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application result.read() May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 20:40:15.700774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [parameters: {'user_id': '67ac051225904569ac407b4eb798f82d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:15.706392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 31 20:40:15.707217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 31 20:40:15.708220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 31 20:40:15.708220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 31 20:40:15.708220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 31 20:40:15.708220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 31 20:40:15.708220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 31 20:40:15.708220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:15.708220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 490/967] 10.222.0.39 () {60 vars in 1131 bytes} [Tue May 31 20:40:15 2022] POST /identity/v3/users => generated 160 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:15.708220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b8280-45ff-4e6c-8022-a48b8ace5f49 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:15.747449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f802d7-38e7-469d-adb5-12f3d072a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:15.748700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f802d7-38e7-469d-adb5-12f3d072a5ec None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:15.750340 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f802d7-38e7-469d-adb5-12f3d072a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:15.750340 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f802d7-38e7-469d-adb5-12f3d072a5ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:15.763014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f802d7-38e7-469d-adb5-12f3d072a5ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:15.764894 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f802d7-38e7-469d-adb5-12f3d072a5ec None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-99f802d7-38e7-469d-adb5-12f3d072a5ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:15.786840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:15.787862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:15.788779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:15.788779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:15.788779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:15.788779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:15.791297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 478/968] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:15.797427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f802d7-38e7-469d-adb5-12f3d072a5ec None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:15.842370 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:15.844759 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:15.849909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b8280-45ff-4e6c-8022-a48b8ace5f49 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:15.886244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8001bb8-4e9a-4832-bb47-5c40464b4117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:15.887090 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8001bb8-4e9a-4832-bb47-5c40464b4117 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:15.887372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8001bb8-4e9a-4832-bb47-5c40464b4117 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:15.887650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8001bb8-4e9a-4832-bb47-5c40464b4117 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:15.896552 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8001bb8-4e9a-4832-bb47-5c40464b4117 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:15.898677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8001bb8-4e9a-4832-bb47-5c40464b4117 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-f8001bb8-4e9a-4832-bb47-5c40464b4117 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:40:15.913416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:15.914604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:15.915852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:15.915852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:15.915852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:40:15.915852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:40:15.915852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:40:15.915852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:40:15.915852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:40:15.915852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:40:15.915852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:40:15.915852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:15.918692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f802d7-38e7-469d-adb5-12f3d072a5ec None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:15.922545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 491/969] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:40:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:15.922545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e369eb5-5d4c-4c36-a7f8-99003dc6f4d0 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:15.922545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e369eb5-5d4c-4c36-a7f8-99003dc6f4d0 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:15.922545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e369eb5-5d4c-4c36-a7f8-99003dc6f4d0 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:15.929462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 492/970] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:15.929462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e369eb5-5d4c-4c36-a7f8-99003dc6f4d0 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:15.963935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0e67e-e595-4777-bf80-8c4af0ccd11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:15.964616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0e67e-e595-4777-bf80-8c4af0ccd11e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:15.964899 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0e67e-e595-4777-bf80-8c4af0ccd11e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:15.965173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0e67e-e595-4777-bf80-8c4af0ccd11e None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:15.965949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0e67e-e595-4777-bf80-8c4af0ccd11e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:15.966258 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0e67e-e595-4777-bf80-8c4af0ccd11e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:15.967665 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0e67e-e595-4777-bf80-8c4af0ccd11e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:15.984325 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 479/971] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:15.984325 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af17156-231c-4813-8890-5242c5f4f0b2 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:15.984325 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af17156-231c-4813-8890-5242c5f4f0b2 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:15.984325 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af17156-231c-4813-8890-5242c5f4f0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:16.000031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2af17156-231c-4813-8890-5242c5f4f0b2 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:16.001229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2af17156-231c-4813-8890-5242c5f4f0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:16.057367 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e369eb5-5d4c-4c36-a7f8-99003dc6f4d0 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:16.077548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 480/972] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:16.077548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af17156-231c-4813-8890-5242c5f4f0b2 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:16.100585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36ebb7-6636-43f6-8be1-a1e8c07e49c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:16.101183 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36ebb7-6636-43f6-8be1-a1e8c07e49c4 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:16.101493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36ebb7-6636-43f6-8be1-a1e8c07e49c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:16.101773 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36ebb7-6636-43f6-8be1-a1e8c07e49c4 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:16.102701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36ebb7-6636-43f6-8be1-a1e8c07e49c4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:16.103134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36ebb7-6636-43f6-8be1-a1e8c07e49c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:16.104600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36ebb7-6636-43f6-8be1-a1e8c07e49c4 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:16.109765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:16.153409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 493/973] 10.222.0.39 () {56 vars in 1101 bytes} [Tue May 31 20:40:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:16.153409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36ebb7-6636-43f6-8be1-a1e8c07e49c4 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:16.171561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:16.209019 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af17156-231c-4813-8890-5242c5f4f0b2 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:16.256339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9c387-8248-4f8a-b606-64c8d063b397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:16.257193 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c387-8248-4f8a-b606-64c8d063b397 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:16.257577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c387-8248-4f8a-b606-64c8d063b397 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:16.257854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c387-8248-4f8a-b606-64c8d063b397 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:16.266980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9c387-8248-4f8a-b606-64c8d063b397 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:16.268776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9c387-8248-4f8a-b606-64c8d063b397 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:16.279850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36ebb7-6636-43f6-8be1-a1e8c07e49c4 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-75f9c387-8248-4f8a-b606-64c8d063b397 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:40:16.287352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:16.288375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:16.289316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:16.289316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:16.289316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:40:16.289316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:40:16.289316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:40:16.289316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:40:16.289316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:40:16.289316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:40:16.289316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:40:16.289316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:16.290565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 481/974] 10.222.0.39 () {56 vars in 1117 bytes} [Tue May 31 20:40:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:16.292239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f2fab-2189-4365-b5ae-a29d6b877bf8 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:16.292755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f2fab-2189-4365-b5ae-a29d6b877bf8 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:16.293239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f2fab-2189-4365-b5ae-a29d6b877bf8 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:16.294947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 482/975] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:16.299445 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f2fab-2189-4365-b5ae-a29d6b877bf8 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:16.321964 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e1b1a-de1f-4e96-86c1-1ee99c85e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:16.322795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e1b1a-de1f-4e96-86c1-1ee99c85e5c1 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:16.323191 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e1b1a-de1f-4e96-86c1-1ee99c85e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:16.323342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e1b1a-de1f-4e96-86c1-1ee99c85e5c1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:16.324013 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e1b1a-de1f-4e96-86c1-1ee99c85e5c1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:16.325471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e1b1a-de1f-4e96-86c1-1ee99c85e5c1 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-159e1b1a-de1f-4e96-86c1-1ee99c85e5c1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:16.339070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:16.340371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:16.341268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 494/976] 10.222.0.39 () {56 vars in 1126 bytes} [Tue May 31 20:40:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:16.342456 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209df1f-4060-4733-8e0c-46bb9d2d337a None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:16.342456 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209df1f-4060-4733-8e0c-46bb9d2d337a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:16.342591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209df1f-4060-4733-8e0c-46bb9d2d337a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:16.361270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-5209df1f-4060-4733-8e0c-46bb9d2d337a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:16.363358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5209df1f-4060-4733-8e0c-46bb9d2d337a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:16.409958 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:16.429688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f2fab-2189-4365-b5ae-a29d6b877bf8 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:16.447485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 495/977] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:16.448700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209df1f-4060-4733-8e0c-46bb9d2d337a None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:16.460712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:16.484671 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820970cd-2cfa-49f5-b241-e83d9b8cdba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:16.485352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820970cd-2cfa-49f5-b241-e83d9b8cdba0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:16.485677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820970cd-2cfa-49f5-b241-e83d9b8cdba0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:16.485957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820970cd-2cfa-49f5-b241-e83d9b8cdba0 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:16.486807 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820970cd-2cfa-49f5-b241-e83d9b8cdba0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:16.487122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820970cd-2cfa-49f5-b241-e83d9b8cdba0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:16.489142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820970cd-2cfa-49f5-b241-e83d9b8cdba0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:16.508324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 483/978] 10.222.0.39 () {56 vars in 1149 bytes} [Tue May 31 20:40:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:16.509164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820970cd-2cfa-49f5-b241-e83d9b8cdba0 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:16.553218 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209df1f-4060-4733-8e0c-46bb9d2d337a None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:16.587303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7483255-d6f5-4a60-8eaa-c7df7ecb1269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:16.587968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7483255-d6f5-4a60-8eaa-c7df7ecb1269 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:16.588252 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7483255-d6f5-4a60-8eaa-c7df7ecb1269 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:16.588527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7483255-d6f5-4a60-8eaa-c7df7ecb1269 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:16.589229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7483255-d6f5-4a60-8eaa-c7df7ecb1269 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:16.589571 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7483255-d6f5-4a60-8eaa-c7df7ecb1269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:16.590967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7483255-d6f5-4a60-8eaa-c7df7ecb1269 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:16.595750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 496/979] 10.222.0.39 () {56 vars in 1122 bytes} [Tue May 31 20:40:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:16.596727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7483255-d6f5-4a60-8eaa-c7df7ecb1269 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:16.611806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820970cd-2cfa-49f5-b241-e83d9b8cdba0 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:16.646231 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf502c-e565-49bb-b504-ad409d4454fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:16.646889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf502c-e565-49bb-b504-ad409d4454fa None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:16.647173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf502c-e565-49bb-b504-ad409d4454fa None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:16.647451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf502c-e565-49bb-b504-ad409d4454fa None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:16.648160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf502c-e565-49bb-b504-ad409d4454fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:16.649583 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf502c-e565-49bb-b504-ad409d4454fa None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:16.666418 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:16.696147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7483255-d6f5-4a60-8eaa-c7df7ecb1269 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:16.728517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef9d06-8e93-4913-ba78-65defbf1be03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:16.729163 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9d06-8e93-4913-ba78-65defbf1be03 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:16.729598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9d06-8e93-4913-ba78-65defbf1be03 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:16.729756 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9d06-8e93-4913-ba78-65defbf1be03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:16.735856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 484/980] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:40:16 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:40:16.736679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf502c-e565-49bb-b504-ad409d4454fa None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:16.746621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:16.809519 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef9d06-8e93-4913-ba78-65defbf1be03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:16.811340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef9d06-8e93-4913-ba78-65defbf1be03 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:16.865822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf502c-e565-49bb-b504-ad409d4454fa None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:16.893358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:16.907079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6bd24-b5e3-4f5a-8c56-88a828c75a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:16.907759 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6bd24-b5e3-4f5a-8c56-88a828c75a32 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:16.908039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6bd24-b5e3-4f5a-8c56-88a828c75a32 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:16.908312 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6bd24-b5e3-4f5a-8c56-88a828c75a32 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:16.909026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6bd24-b5e3-4f5a-8c56-88a828c75a32 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:16.909897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6bd24-b5e3-4f5a-8c56-88a828c75a32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:16.911340 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6bd24-b5e3-4f5a-8c56-88a828c75a32 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:16.921968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 485/981] 10.222.0.39 () {56 vars in 1122 bytes} [Tue May 31 20:40:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:16.923908 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6bd24-b5e3-4f5a-8c56-88a828c75a32 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:16.928211 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 497/982] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:40:16 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:40:16.934066 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef9d06-8e93-4913-ba78-65defbf1be03 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:16.999599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:17.051718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6bd24-b5e3-4f5a-8c56-88a828c75a32 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:17.054696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef9d06-8e93-4913-ba78-65defbf1be03 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:17.088679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adcd63-0272-4c98-9373-a4cfec0847d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:17.089454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adcd63-0272-4c98-9373-a4cfec0847d8 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:17.089738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adcd63-0272-4c98-9373-a4cfec0847d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:17.090012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adcd63-0272-4c98-9373-a4cfec0847d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:17.090841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adcd63-0272-4c98-9373-a4cfec0847d8 None admin] RBAC: Adding query filter params (interface=admin, service_id=7bfd3de019674356bc417f2e9e521afe, region_id=RegionOne) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:17.091118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adcd63-0272-4c98-9373-a4cfec0847d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:17.091459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cee60-5e27-4e92-b945-2ae4e799e11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:17.092403 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cee60-5e27-4e92-b945-2ae4e799e11a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:17.092502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adcd63-0272-4c98-9373-a4cfec0847d8 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:17.092690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cee60-5e27-4e92-b945-2ae4e799e11a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:17.092968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cee60-5e27-4e92-b945-2ae4e799e11a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:17.103330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 486/983] 10.222.0.39 () {56 vars in 1249 bytes} [Tue May 31 20:40:16 2022] GET /identity/v3/endpoints?service_id=7bfd3de019674356bc417f2e9e521afe&interface=admin®ion_id=RegionOne => generated 193 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:17.104136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adcd63-0272-4c98-9373-a4cfec0847d8 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:17.105638 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cee60-5e27-4e92-b945-2ae4e799e11a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:17.107392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cee60-5e27-4e92-b945-2ae4e799e11a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-1c5cee60-5e27-4e92-b945-2ae4e799e11a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:17.131727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:17.132777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:17.133727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:17.133727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:17.133727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:17.133727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:17.137766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 498/984] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:17.138507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cee60-5e27-4e92-b945-2ae4e799e11a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:17.166559 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:17.214875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adcd63-0272-4c98-9373-a4cfec0847d8 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:17.242428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:17.248176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cee60-5e27-4e92-b945-2ae4e799e11a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:17.251370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecf55d-1a58-409a-98cb-cbee059ea2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:17.252160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecf55d-1a58-409a-98cb-cbee059ea2e4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:17.252438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecf55d-1a58-409a-98cb-cbee059ea2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:17.252709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecf55d-1a58-409a-98cb-cbee059ea2e4 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:17.253441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecf55d-1a58-409a-98cb-cbee059ea2e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:17.254805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecf55d-1a58-409a-98cb-cbee059ea2e4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:17.261655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 487/985] 10.222.0.39 () {56 vars in 1087 bytes} [Tue May 31 20:40:17 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 20:40:17.291852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdaf79-2f14-4a7c-b208-846c4a510864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:17.292548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdaf79-2f14-4a7c-b208-846c4a510864 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:17.292830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdaf79-2f14-4a7c-b208-846c4a510864 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:17.293105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdaf79-2f14-4a7c-b208-846c4a510864 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:17.293909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdaf79-2f14-4a7c-b208-846c4a510864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:17.294221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdaf79-2f14-4a7c-b208-846c4a510864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:17.295648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdaf79-2f14-4a7c-b208-846c4a510864 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:17.318008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 499/986] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:17.319313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecf55d-1a58-409a-98cb-cbee059ea2e4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:17.433539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecf55d-1a58-409a-98cb-cbee059ea2e4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:17.479001 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab6427-5ec7-45e6-a800-5d1779c73d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:17.479805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab6427-5ec7-45e6-a800-5d1779c73d65 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:17.480083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab6427-5ec7-45e6-a800-5d1779c73d65 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:17.480354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab6427-5ec7-45e6-a800-5d1779c73d65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:17.488253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab6427-5ec7-45e6-a800-5d1779c73d65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:17.489975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab6427-5ec7-45e6-a800-5d1779c73d65 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-2dab6427-5ec7-45e6-a800-5d1779c73d65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:40:17.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:17.506315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:17.507661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:40:17.507661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:40:17.507661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:40:17.507661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:40:17.507661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:40:17.507661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:40:17.507661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:17.507661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:17.507661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 488/987] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:40:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:17.512614 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdaf79-2f14-4a7c-b208-846c4a510864 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:17.604801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:17.621801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdaf79-2f14-4a7c-b208-846c4a510864 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:17.656608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c019f9-f7f6-49dd-996f-8ebfdfd18ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:17.657270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c019f9-f7f6-49dd-996f-8ebfdfd18ced None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:17.657579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c019f9-f7f6-49dd-996f-8ebfdfd18ced None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:17.657860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c019f9-f7f6-49dd-996f-8ebfdfd18ced None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:17.658637 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c019f9-f7f6-49dd-996f-8ebfdfd18ced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:17.658945 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c019f9-f7f6-49dd-996f-8ebfdfd18ced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:17.660915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c019f9-f7f6-49dd-996f-8ebfdfd18ced None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:17.673411 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 500/988] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:40:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:17.679814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab6427-5ec7-45e6-a800-5d1779c73d65 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:17.732913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:17.784559 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab6427-5ec7-45e6-a800-5d1779c73d65 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:17.819110 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87867b4-5897-4be4-90c0-34ec9647a14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:17.819776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87867b4-5897-4be4-90c0-34ec9647a14e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:17.820056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87867b4-5897-4be4-90c0-34ec9647a14e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:17.820331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87867b4-5897-4be4-90c0-34ec9647a14e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:17.821295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87867b4-5897-4be4-90c0-34ec9647a14e None admin] RBAC: Adding query filter params (role.id=f800b518993746dfaa6c0f19e0e9bcb0, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=9ba18c72dcba4cc4aa863783f325e780) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:17.821647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87867b4-5897-4be4-90c0-34ec9647a14e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:17.823089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87867b4-5897-4be4-90c0-34ec9647a14e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:17.837467 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 489/989] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:40:17 2022] GET /identity/v3/role_assignments?user.id=9ba18c72dcba4cc4aa863783f325e780&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=f800b518993746dfaa6c0f19e0e9bcb0 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:19.040148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bfce1-baf6-41ae-bfbf-20f9e44a1717 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:19.040707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bfce1-baf6-41ae-bfbf-20f9e44a1717 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:19.040707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bfce1-baf6-41ae-bfbf-20f9e44a1717 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:19.042138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 501/990] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:19.047474 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743959ae-8cda-46f3-a6f3-a86374a52d14 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:19.047912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743959ae-8cda-46f3-a6f3-a86374a52d14 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:19.048092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743959ae-8cda-46f3-a6f3-a86374a52d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:19.066995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-743959ae-8cda-46f3-a6f3-a86374a52d14 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:19.068429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-743959ae-8cda-46f3-a6f3-a86374a52d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:19.138801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 490/991] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:19.161328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bfce1-baf6-41ae-bfbf-20f9e44a1717 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:19.270186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bfce1-baf6-41ae-bfbf-20f9e44a1717 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:19.315427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd714c5-d71f-4724-86ff-b84fa886da80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:19.316462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd714c5-d71f-4724-86ff-b84fa886da80 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:19.316889 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd714c5-d71f-4724-86ff-b84fa886da80 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:19.317323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd714c5-d71f-4724-86ff-b84fa886da80 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:19.318397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd714c5-d71f-4724-86ff-b84fa886da80 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:19.319903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd714c5-d71f-4724-86ff-b84fa886da80 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-7fd714c5-d71f-4724-86ff-b84fa886da80 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:19.331966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:19.333052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:40:19.333931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:19.334689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 502/992] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:40:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:19.340970 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743959ae-8cda-46f3-a6f3-a86374a52d14 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:19.391509 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:19.446324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743959ae-8cda-46f3-a6f3-a86374a52d14 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:19.481170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dfeae-2cc4-44fb-afdc-db00d948fb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:19.481895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dfeae-2cc4-44fb-afdc-db00d948fb91 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:19.482180 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dfeae-2cc4-44fb-afdc-db00d948fb91 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:19.482486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dfeae-2cc4-44fb-afdc-db00d948fb91 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:19.483175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dfeae-2cc4-44fb-afdc-db00d948fb91 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:19.483481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dfeae-2cc4-44fb-afdc-db00d948fb91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:19.485007 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dfeae-2cc4-44fb-afdc-db00d948fb91 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:19.496040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 491/993] 10.222.0.39 () {56 vars in 1112 bytes} [Tue May 31 20:40:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:19.497655 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd714c5-d71f-4724-86ff-b84fa886da80 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:19.510972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:19.538618 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360c46-da5f-4e05-a58e-dcabc8b698ce None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:19.538987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360c46-da5f-4e05-a58e-dcabc8b698ce None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:19.539182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360c46-da5f-4e05-a58e-dcabc8b698ce None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:19.540778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 492/994] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:40:19.546442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4faf2d-cc33-4477-8c73-c75182bec9bd None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:19.546777 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4faf2d-cc33-4477-8c73-c75182bec9bd None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:19.547011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4faf2d-cc33-4477-8c73-c75182bec9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:19.565008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-bc4faf2d-cc33-4477-8c73-c75182bec9bd None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:19.566943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-bc4faf2d-cc33-4477-8c73-c75182bec9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:19.618833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd714c5-d71f-4724-86ff-b84fa886da80 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:19.649029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 493/995] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:19.658833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8a421-306b-44ed-b2bd-8e19da7ef525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:19.659051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8a421-306b-44ed-b2bd-8e19da7ef525 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:19.659272 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8a421-306b-44ed-b2bd-8e19da7ef525 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:19.659547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8a421-306b-44ed-b2bd-8e19da7ef525 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:19.660690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8a421-306b-44ed-b2bd-8e19da7ef525 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:19.660690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8a421-306b-44ed-b2bd-8e19da7ef525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:19.662129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8a421-306b-44ed-b2bd-8e19da7ef525 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:19.667564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 503/996] 10.222.0.39 () {56 vars in 1112 bytes} [Tue May 31 20:40:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:19.672185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4faf2d-cc33-4477-8c73-c75182bec9bd None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:19.673009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8a421-306b-44ed-b2bd-8e19da7ef525 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:19.723919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:19.755359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:19.787529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8a421-306b-44ed-b2bd-8e19da7ef525 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:19.792656 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4faf2d-cc33-4477-8c73-c75182bec9bd None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:19.830501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54332bc-860a-4614-9a71-c2c563441f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:19.831707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54332bc-860a-4614-9a71-c2c563441f25 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:19.832175 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54332bc-860a-4614-9a71-c2c563441f25 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:19.832731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54332bc-860a-4614-9a71-c2c563441f25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:19.833807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54332bc-860a-4614-9a71-c2c563441f25 None admin] RBAC: Adding query filter params (interface=public, service_id=4bf5d6f3a1da4374bec14dbb33ccfaf1, region_id=RegionOne) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:19.834216 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54332bc-860a-4614-9a71-c2c563441f25 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:19.835948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54332bc-860a-4614-9a71-c2c563441f25 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:19.836075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e78c3f-f200-45a3-a5b3-719804d914f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:19.836807 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e78c3f-f200-45a3-a5b3-719804d914f7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:19.837088 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e78c3f-f200-45a3-a5b3-719804d914f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:19.837364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e78c3f-f200-45a3-a5b3-719804d914f7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:19.838098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e78c3f-f200-45a3-a5b3-719804d914f7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:19.839521 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e78c3f-f200-45a3-a5b3-719804d914f7 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:19.847423 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 504/997] 10.222.0.39 () {56 vars in 1251 bytes} [Tue May 31 20:40:19 2022] GET /identity/v3/endpoints?service_id=4bf5d6f3a1da4374bec14dbb33ccfaf1&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:19.848551 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54332bc-860a-4614-9a71-c2c563441f25 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-f3e78c3f-f200-45a3-a5b3-719804d914f7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:19.852301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:19.853314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:19.858055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 494/998] 10.222.0.39 () {56 vars in 1126 bytes} [Tue May 31 20:40:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:19.860339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e78c3f-f200-45a3-a5b3-719804d914f7 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:19.968114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54332bc-860a-4614-9a71-c2c563441f25 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:19.968358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e78c3f-f200-45a3-a5b3-719804d914f7 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:19.969759 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:20.004607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc9b81-ac8e-4c4e-b65c-e1ac235fe202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:20.004981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beac0fd-9922-4ab5-afc4-a36ba0b37825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:20.005286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc9b81-ac8e-4c4e-b65c-e1ac235fe202 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:20.005595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc9b81-ac8e-4c4e-b65c-e1ac235fe202 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:20.005692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beac0fd-9922-4ab5-afc4-a36ba0b37825 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:20.005873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc9b81-ac8e-4c4e-b65c-e1ac235fe202 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:20.005973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beac0fd-9922-4ab5-afc4-a36ba0b37825 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:20.006143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beac0fd-9922-4ab5-afc4-a36ba0b37825 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:20.006587 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc9b81-ac8e-4c4e-b65c-e1ac235fe202 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:20.006813 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beac0fd-9922-4ab5-afc4-a36ba0b37825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:20.006913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc9b81-ac8e-4c4e-b65c-e1ac235fe202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:20.008190 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beac0fd-9922-4ab5-afc4-a36ba0b37825 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:20.008291 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc9b81-ac8e-4c4e-b65c-e1ac235fe202 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:20.010444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:20.019879 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 495/999] 10.222.0.39 () {56 vars in 1122 bytes} [Tue May 31 20:40:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:20.020112 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 505/1000] 10.222.0.39 () {56 vars in 1087 bytes} [Tue May 31 20:40:19 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:40:20.020210 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc9b81-ac8e-4c4e-b65c-e1ac235fe202 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:20.140765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc9b81-ac8e-4c4e-b65c-e1ac235fe202 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:20.159203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630dd49-763f-499b-8ade-fdc57cd6a6ed None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:20.159803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630dd49-763f-499b-8ade-fdc57cd6a6ed None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:20.159803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630dd49-763f-499b-8ade-fdc57cd6a6ed None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:20.161555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 506/1001] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:40:20.167078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1a68e-8824-44e2-bf8d-28f49d75311a None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:20.167612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1a68e-8824-44e2-bf8d-28f49d75311a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:20.168071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1a68e-8824-44e2-bf8d-28f49d75311a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:20.188661 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-65b1a68e-8824-44e2-bf8d-28f49d75311a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:20.189741 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0137c-569a-43d0-bf1a-801779812b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:20.190512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-65b1a68e-8824-44e2-bf8d-28f49d75311a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:20.191015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0137c-569a-43d0-bf1a-801779812b21 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:20.191307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0137c-569a-43d0-bf1a-801779812b21 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:20.191581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0137c-569a-43d0-bf1a-801779812b21 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:20.193421 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0137c-569a-43d0-bf1a-801779812b21 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:20.193421 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0137c-569a-43d0-bf1a-801779812b21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:20.194320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0137c-569a-43d0-bf1a-801779812b21 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:20.200917 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 496/1002] 10.222.0.39 () {56 vars in 1122 bytes} [Tue May 31 20:40:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:20.207553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0137c-569a-43d0-bf1a-801779812b21 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:20.244688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:20.289288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 507/1003] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:20.312080 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1a68e-8824-44e2-bf8d-28f49d75311a None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:20.326692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0137c-569a-43d0-bf1a-801779812b21 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:20.365628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805ae55-fa4a-4b0c-9e74-9812f6af83ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:20.366302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ae55-fa4a-4b0c-9e74-9812f6af83ae None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:20.366587 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ae55-fa4a-4b0c-9e74-9812f6af83ae None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:20.366872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ae55-fa4a-4b0c-9e74-9812f6af83ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:20.367643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805ae55-fa4a-4b0c-9e74-9812f6af83ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:20.369043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805ae55-fa4a-4b0c-9e74-9812f6af83ae None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:20.445265 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 497/1004] 10.222.0.39 () {60 vars in 1144 bytes} [Tue May 31 20:40:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:40:20.454175 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1a68e-8824-44e2-bf8d-28f49d75311a None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:20.511560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:20.527114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446661a-aa52-4b61-ae58-d61955bbcdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:20.527920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446661a-aa52-4b61-ae58-d61955bbcdf3 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:20.528201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446661a-aa52-4b61-ae58-d61955bbcdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:20.528471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446661a-aa52-4b61-ae58-d61955bbcdf3 None admin] PATH_INFO: `/v3/services/image` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:20.529139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446661a-aa52-4b61-ae58-d61955bbcdf3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:20.530574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446661a-aa52-4b61-ae58-d61955bbcdf3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-b446661a-aa52-4b61-ae58-d61955bbcdf3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:20.543121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:20.544576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:20.545528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 508/1005] 10.222.0.39 () {56 vars in 1105 bytes} [Tue May 31 20:40:20 2022] GET /identity/v3/services/image => generated 86 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:20.551284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805ae55-fa4a-4b0c-9e74-9812f6af83ae None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:20.660156 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:20.670173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805ae55-fa4a-4b0c-9e74-9812f6af83ae None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:20.708737 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79474911-c0e9-4d73-9a11-7912782132ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:20.709335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79474911-c0e9-4d73-9a11-7912782132ac None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:20.709735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79474911-c0e9-4d73-9a11-7912782132ac None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:20.710012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79474911-c0e9-4d73-9a11-7912782132ac None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:20.710738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79474911-c0e9-4d73-9a11-7912782132ac None admin] RBAC: Adding query filter params (name=image) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:20.711047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79474911-c0e9-4d73-9a11-7912782132ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:20.712462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79474911-c0e9-4d73-9a11-7912782132ac None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:20.721638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 498/1006] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:20.725064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446661a-aa52-4b61-ae58-d61955bbcdf3 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:20.844956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446661a-aa52-4b61-ae58-d61955bbcdf3 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:20.931542 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56be00-01b2-4d00-9ec2-5dba104064d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:20.932228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56be00-01b2-4d00-9ec2-5dba104064d4 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:20.932513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56be00-01b2-4d00-9ec2-5dba104064d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:20.932789 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56be00-01b2-4d00-9ec2-5dba104064d4 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:20.934077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56be00-01b2-4d00-9ec2-5dba104064d4 None admin] RBAC: Adding query filter params (type=image) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:20.934077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56be00-01b2-4d00-9ec2-5dba104064d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:20.935320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56be00-01b2-4d00-9ec2-5dba104064d4 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:20.944601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 509/1007] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:22.366305 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873f9f5-f3fa-4dde-b43d-634c1e101e8c None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:22.366830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873f9f5-f3fa-4dde-b43d-634c1e101e8c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:22.367274 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873f9f5-f3fa-4dde-b43d-634c1e101e8c None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:22.369855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 499/1008] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:22.375514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8540f4-e792-4d3c-93e2-69e6b69472b6 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:22.376230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8540f4-e792-4d3c-93e2-69e6b69472b6 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:22.376230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8540f4-e792-4d3c-93e2-69e6b69472b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:22.393769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-de8540f4-e792-4d3c-93e2-69e6b69472b6 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:22.394950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-de8540f4-e792-4d3c-93e2-69e6b69472b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:22.461081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:22.481509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 510/1009] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:22 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:22.505318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873f9f5-f3fa-4dde-b43d-634c1e101e8c None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:22.626731 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873f9f5-f3fa-4dde-b43d-634c1e101e8c None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:22.667839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26e907-7d56-4bf6-bc26-ac01d22035d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:22.668850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26e907-7d56-4bf6-bc26-ac01d22035d0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:22.669287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26e907-7d56-4bf6-bc26-ac01d22035d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:22.669742 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26e907-7d56-4bf6-bc26-ac01d22035d0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:22.670590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26e907-7d56-4bf6-bc26-ac01d22035d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:22.672309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26e907-7d56-4bf6-bc26-ac01d22035d0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-8e26e907-7d56-4bf6-bc26-ac01d22035d0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:22.686112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:22.688264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:22.689135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 500/1010] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:40:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:22.697653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8540f4-e792-4d3c-93e2-69e6b69472b6 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:22.767869 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dc0f5-88ac-4ef1-917d-ca5f96c1f741 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:22.768152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dc0f5-88ac-4ef1-917d-ca5f96c1f741 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:22.768428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dc0f5-88ac-4ef1-917d-ca5f96c1f741 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:22.770182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 501/1011] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:22.775217 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edde57-584f-4e7d-a895-c9695fbda0a4 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:22.775519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edde57-584f-4e7d-a895-c9695fbda0a4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:22.775800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edde57-584f-4e7d-a895-c9695fbda0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:22.793552 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-56edde57-584f-4e7d-a895-c9695fbda0a4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:22.794765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-56edde57-584f-4e7d-a895-c9695fbda0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:22.818126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:22.824941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8540f4-e792-4d3c-93e2-69e6b69472b6 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:22.872235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90506541-29dd-41da-a649-f94d1111b0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:22.873193 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90506541-29dd-41da-a649-f94d1111b0fc None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:22.873657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90506541-29dd-41da-a649-f94d1111b0fc None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:22.874134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90506541-29dd-41da-a649-f94d1111b0fc None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:22.875101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90506541-29dd-41da-a649-f94d1111b0fc None admin] RBAC: Adding query filter params (name=compute) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:22.875603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90506541-29dd-41da-a649-f94d1111b0fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:22.878193 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90506541-29dd-41da-a649-f94d1111b0fc None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:22.890029 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 511/1012] 10.222.0.39 () {56 vars in 1112 bytes} [Tue May 31 20:40:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:22.891466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90506541-29dd-41da-a649-f94d1111b0fc None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:22.892523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 502/1013] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:22 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:22.921945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edde57-584f-4e7d-a895-c9695fbda0a4 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:22.956282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:23.027802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90506541-29dd-41da-a649-f94d1111b0fc None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:23.061513 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edde57-584f-4e7d-a895-c9695fbda0a4 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:23.071930 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1048-aa1e-480a-b4b7-ab6620584062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:23.073010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1048-aa1e-480a-b4b7-ab6620584062 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:23.073484 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1048-aa1e-480a-b4b7-ab6620584062 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:23.073892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1048-aa1e-480a-b4b7-ab6620584062 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:23.074860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d1048-aa1e-480a-b4b7-ab6620584062 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:23.075350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d1048-aa1e-480a-b4b7-ab6620584062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:23.077139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d1048-aa1e-480a-b4b7-ab6620584062 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:23.088868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 512/1014] 10.222.0.39 () {56 vars in 1112 bytes} [Tue May 31 20:40:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:23.090243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1048-aa1e-480a-b4b7-ab6620584062 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:23.114520 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee0f23-c95a-4ab1-b80f-50788d77064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:23.115762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee0f23-c95a-4ab1-b80f-50788d77064d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:23.116650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee0f23-c95a-4ab1-b80f-50788d77064d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:23.116771 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee0f23-c95a-4ab1-b80f-50788d77064d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:23.118632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee0f23-c95a-4ab1-b80f-50788d77064d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:23.121168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee0f23-c95a-4ab1-b80f-50788d77064d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:23.129817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 503/1015] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:23.132943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee0f23-c95a-4ab1-b80f-50788d77064d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:23.164911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:23.249692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1048-aa1e-480a-b4b7-ab6620584062 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:23.268482 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:23.281573 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee0f23-c95a-4ab1-b80f-50788d77064d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:23.297243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0f043-6c6b-4dfd-8351-a9e2f34b8f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:23.298366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f043-6c6b-4dfd-8351-a9e2f34b8f13 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:23.298816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f043-6c6b-4dfd-8351-a9e2f34b8f13 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:23.299471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f043-6c6b-4dfd-8351-a9e2f34b8f13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:23.309226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0f043-6c6b-4dfd-8351-a9e2f34b8f13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:23.311822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0f043-6c6b-4dfd-8351-a9e2f34b8f13 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:23.323159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe409c26-a4e5-48f3-8558-f4689fd02175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:23.323895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe409c26-a4e5-48f3-8558-f4689fd02175 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:23.324178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe409c26-a4e5-48f3-8558-f4689fd02175 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:23.324668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe409c26-a4e5-48f3-8558-f4689fd02175 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:23.325447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe409c26-a4e5-48f3-8558-f4689fd02175 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:23.326896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe409c26-a4e5-48f3-8558-f4689fd02175 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:23.399409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 513/1016] 10.222.0.39 () {60 vars in 1144 bytes} [Tue May 31 20:40:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:40:23.449414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 504/1017] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:40:23 2022] POST /identity/v3/projects => generated 311 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:40:23.754162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275a26d-6817-4f83-80f8-73198794fdeb None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:23.754432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275a26d-6817-4f83-80f8-73198794fdeb None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:23.754715 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275a26d-6817-4f83-80f8-73198794fdeb None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:23.756392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 514/1018] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:40:23.764723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75ff3-7c79-4e38-8209-13283db1ccdf None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:23.765186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75ff3-7c79-4e38-8209-13283db1ccdf None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:23.765769 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75ff3-7c79-4e38-8209-13283db1ccdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:23.791707 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a5e75ff3-7c79-4e38-8209-13283db1ccdf None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:23.793606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a5e75ff3-7c79-4e38-8209-13283db1ccdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:23.890968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:23.916396 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 505/1019] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:23 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:23.953517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275a26d-6817-4f83-80f8-73198794fdeb None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:24.106797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275a26d-6817-4f83-80f8-73198794fdeb None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:24.147057 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab26e3-d479-457a-acc5-372475d77ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:24.147739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab26e3-d479-457a-acc5-372475d77ada None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:24.148025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab26e3-d479-457a-acc5-372475d77ada None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:24.148300 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab26e3-d479-457a-acc5-372475d77ada None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:24.149035 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab26e3-d479-457a-acc5-372475d77ada None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:24.150486 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab26e3-d479-457a-acc5-372475d77ada None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:24.296235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 515/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:40:23 2022] POST /identity/v3/services => generated 242 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:40:26.399807 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b2fa8-61dd-4f65-8c9f-6cce74fe6642 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:26.400519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b2fa8-61dd-4f65-8c9f-6cce74fe6642 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:26.400519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b2fa8-61dd-4f65-8c9f-6cce74fe6642 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:26.401741 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 506/1021] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:40:26.410056 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed2c4f-ca51-4a50-95d2-69b49fd1e83a None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:26.410760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed2c4f-ca51-4a50-95d2-69b49fd1e83a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:26.410760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed2c4f-ca51-4a50-95d2-69b49fd1e83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:26.429746 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-91ed2c4f-ca51-4a50-95d2-69b49fd1e83a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:26.430936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-91ed2c4f-ca51-4a50-95d2-69b49fd1e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:26.459985 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:26.521438 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 516/1022] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:26.564876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b2fa8-61dd-4f65-8c9f-6cce74fe6642 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:26.689474 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b2fa8-61dd-4f65-8c9f-6cce74fe6642 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:26.729343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da4057-c611-4aab-b8a4-c4c041b927e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:26.730186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da4057-c611-4aab-b8a4-c4c041b927e9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:26.730461 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da4057-c611-4aab-b8a4-c4c041b927e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:26.730733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da4057-c611-4aab-b8a4-c4c041b927e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:26.743760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da4057-c611-4aab-b8a4-c4c041b927e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-d6da4057-c611-4aab-b8a4-c4c041b927e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:40:26.752092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:26.759286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:26.760870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:26.760870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:26.760870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:26.760870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:26.760870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:40:26.760870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:40:26.760870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:40:26.760870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:40:26.760870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:40:26.760870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:40:26.760870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:40:26.760870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:26.760870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 507/1023] 10.222.0.39 () {56 vars in 1120 bytes} [Tue May 31 20:40:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:26.767024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed2c4f-ca51-4a50-95d2-69b49fd1e83a None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:26.884110 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed2c4f-ca51-4a50-95d2-69b49fd1e83a None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:26.924649 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2b78-7c98-4252-b297-0f1be95c6175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:26.925871 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2b78-7c98-4252-b297-0f1be95c6175 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:26.926523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2b78-7c98-4252-b297-0f1be95c6175 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:26.927017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c2b78-7c98-4252-b297-0f1be95c6175 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:26.928027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c2b78-7c98-4252-b297-0f1be95c6175 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:26.928681 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c2b78-7c98-4252-b297-0f1be95c6175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:26.930449 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c2b78-7c98-4252-b297-0f1be95c6175 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:26.942285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 517/1024] 10.222.0.39 () {56 vars in 1115 bytes} [Tue May 31 20:40:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:26.949313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da4057-c611-4aab-b8a4-c4c041b927e9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:27.039688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:27.094014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da4057-c611-4aab-b8a4-c4c041b927e9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:27.132841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3119a4b-2050-4174-846c-11ea26c19247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:27.133896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3119a4b-2050-4174-846c-11ea26c19247 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:27.134313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3119a4b-2050-4174-846c-11ea26c19247 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:27.134741 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3119a4b-2050-4174-846c-11ea26c19247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:27.147539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3119a4b-2050-4174-846c-11ea26c19247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:27.149213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3119a4b-2050-4174-846c-11ea26c19247 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-c3119a4b-2050-4174-846c-11ea26c19247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:27.168514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:27.170366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:27.178314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:27.178314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:27.178314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:27.178314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:27.178314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 508/1025] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:27.179749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2b78-7c98-4252-b297-0f1be95c6175 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:27.200265 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9d679-490d-4d53-8854-dfc6e002e873 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:27.200527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:27.200674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9d679-490d-4d53-8854-dfc6e002e873 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:27.201144 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9d679-490d-4d53-8854-dfc6e002e873 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:27.203664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 509/1026] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:40:27.212838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee2332-3fd3-4be5-a4c3-450a8f5ce8d3 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:27.213442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee2332-3fd3-4be5-a4c3-450a8f5ce8d3 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:27.213945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee2332-3fd3-4be5-a4c3-450a8f5ce8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:27.243647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-54ee2332-3fd3-4be5-a4c3-450a8f5ce8d3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:27.245697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-54ee2332-3fd3-4be5-a4c3-450a8f5ce8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:27.313938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c2b78-7c98-4252-b297-0f1be95c6175 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:27.358160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 510/1027] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:27.378860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81883af7-fc3e-4746-8f22-f985e7ddc1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:27.380001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81883af7-fc3e-4746-8f22-f985e7ddc1f3 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:27.380546 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81883af7-fc3e-4746-8f22-f985e7ddc1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:27.381047 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81883af7-fc3e-4746-8f22-f985e7ddc1f3 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:27.382615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81883af7-fc3e-4746-8f22-f985e7ddc1f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:27.383182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81883af7-fc3e-4746-8f22-f985e7ddc1f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:27.385891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81883af7-fc3e-4746-8f22-f985e7ddc1f3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:27.387536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee2332-3fd3-4be5-a4c3-450a8f5ce8d3 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:27.410178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 518/1028] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:27.416114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81883af7-fc3e-4746-8f22-f985e7ddc1f3 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:27.445694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:27.521901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:27.566950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee2332-3fd3-4be5-a4c3-450a8f5ce8d3 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:27.569055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81883af7-fc3e-4746-8f22-f985e7ddc1f3 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:27.617762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af5d81-6116-4830-b974-98f51325e3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:27.618732 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af5d81-6116-4830-b974-98f51325e3ea None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:27.619185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af5d81-6116-4830-b974-98f51325e3ea None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:27.619614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af5d81-6116-4830-b974-98f51325e3ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:27.621348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af5d81-6116-4830-b974-98f51325e3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:27.623054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af5d81-6116-4830-b974-98f51325e3ea None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:27.631095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 511/1029] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:27.632399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af5d81-6116-4830-b974-98f51325e3ea None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:27.647153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e91ce-2606-46b5-826f-b61b3e668244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:27.648667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e91ce-2606-46b5-826f-b61b3e668244 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:27.649182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e91ce-2606-46b5-826f-b61b3e668244 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:27.649719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e91ce-2606-46b5-826f-b61b3e668244 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:27.664939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e91ce-2606-46b5-826f-b61b3e668244 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:27.667855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e91ce-2606-46b5-826f-b61b3e668244 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-b12e91ce-2606-46b5-826f-b61b3e668244 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:40:27.697771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:27.699023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:27.704876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:27.704876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:27.704876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:40:27.704876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:40:27.704876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:40:27.704876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:40:27.704876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:40:27.704876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:40:27.704876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:40:27.704876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:27.704876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 519/1030] 10.222.0.39 () {56 vars in 1093 bytes} [Tue May 31 20:40:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:27.704876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506b810-f3ed-4421-bf98-f176b34d993a None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:27.704876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506b810-f3ed-4421-bf98-f176b34d993a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:27.705935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506b810-f3ed-4421-bf98-f176b34d993a None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:27.706355 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 520/1031] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:27.707603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506b810-f3ed-4421-bf98-f176b34d993a None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:27.754402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af5d81-6116-4830-b974-98f51325e3ea None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:27.756756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:27.793736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4ace1-6e73-40ce-ad4c-1c0917ac73fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:27.794907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4ace1-6e73-40ce-ad4c-1c0917ac73fd None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:27.795414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4ace1-6e73-40ce-ad4c-1c0917ac73fd None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:27.795818 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4ace1-6e73-40ce-ad4c-1c0917ac73fd None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:27.797045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4ace1-6e73-40ce-ad4c-1c0917ac73fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:27.800303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4ace1-6e73-40ce-ad4c-1c0917ac73fd None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:27.846243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506b810-f3ed-4421-bf98-f176b34d993a None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:27.884526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77936a20-966f-40e8-a183-9652fd5d2a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:27.885287 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77936a20-966f-40e8-a183-9652fd5d2a10 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:27.885644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77936a20-966f-40e8-a183-9652fd5d2a10 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:27.885963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77936a20-966f-40e8-a183-9652fd5d2a10 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:27.886861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77936a20-966f-40e8-a183-9652fd5d2a10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:27.887322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77936a20-966f-40e8-a183-9652fd5d2a10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:27.889005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77936a20-966f-40e8-a183-9652fd5d2a10 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:27.892787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:27.911281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 512/1032] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:40:27 2022] POST /identity/v3/users => generated 285 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:40:27.913168 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 521/1033] 10.222.0.39 () {56 vars in 1133 bytes} [Tue May 31 20:40:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:27.913590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0719b-ece3-4278-a7f1-a62560705875 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:27.914014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0719b-ece3-4278-a7f1-a62560705875 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:27.914436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0719b-ece3-4278-a7f1-a62560705875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:27.921646 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77936a20-966f-40e8-a183-9652fd5d2a10 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:27.950649 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d6c0719b-ece3-4278-a7f1-a62560705875 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:27.952199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d6c0719b-ece3-4278-a7f1-a62560705875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:28.056028 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 513/1034] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:28.082877 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0719b-ece3-4278-a7f1-a62560705875 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:28.130861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77936a20-966f-40e8-a183-9652fd5d2a10 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:28.201839 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199309d0-a08d-435b-9e51-235864dbdc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:28.202875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199309d0-a08d-435b-9e51-235864dbdc3c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:28.203331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199309d0-a08d-435b-9e51-235864dbdc3c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:28.203850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199309d0-a08d-435b-9e51-235864dbdc3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:28.227095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:28.244931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0719b-ece3-4278-a7f1-a62560705875 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:28.318180 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:28.318891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee97c17-0da8-42cf-9891-779d0c7069ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:28.320099 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee97c17-0da8-42cf-9891-779d0c7069ae None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:28.320556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee97c17-0da8-42cf-9891-779d0c7069ae None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:28.320886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee97c17-0da8-42cf-9891-779d0c7069ae None admin] PATH_INFO: `/v3/services/image` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:28.321878 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee97c17-0da8-42cf-9891-779d0c7069ae None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:28.323619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee97c17-0da8-42cf-9891-779d0c7069ae None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:28.333956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199309d0-a08d-435b-9e51-235864dbdc3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:28.337131 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199309d0-a08d-435b-9e51-235864dbdc3c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-aee97c17-0da8-42cf-9891-779d0c7069ae None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:28.338162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:28.348395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:28.350394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 514/1035] 10.222.0.39 () {56 vars in 1105 bytes} [Tue May 31 20:40:28 2022] GET /identity/v3/services/image => generated 86 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:28.352667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee97c17-0da8-42cf-9891-779d0c7069ae None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:28.492359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee97c17-0da8-42cf-9891-779d0c7069ae None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:28.525348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 522/1036] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:40:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 31 20:40:28.530915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199309d0-a08d-435b-9e51-235864dbdc3c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:28.541182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44551211-483e-4296-ad73-e184e7661b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:28.542339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44551211-483e-4296-ad73-e184e7661b86 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:28.542801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44551211-483e-4296-ad73-e184e7661b86 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:28.543275 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44551211-483e-4296-ad73-e184e7661b86 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:28.544609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44551211-483e-4296-ad73-e184e7661b86 None admin] RBAC: Adding query filter params (name=image) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:28.545150 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44551211-483e-4296-ad73-e184e7661b86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:28.547716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44551211-483e-4296-ad73-e184e7661b86 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:28.556826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 515/1037] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:28.566614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44551211-483e-4296-ad73-e184e7661b86 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:28.596974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:28.673884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:28.685741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199309d0-a08d-435b-9e51-235864dbdc3c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:28.724407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44551211-483e-4296-ad73-e184e7661b86 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:28.754577 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9166e-1b73-4182-b8d1-861ecf5ba627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:28.755985 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9166e-1b73-4182-b8d1-861ecf5ba627 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:28.756570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9166e-1b73-4182-b8d1-861ecf5ba627 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:28.756973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9166e-1b73-4182-b8d1-861ecf5ba627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:28.776123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9166e-1b73-4182-b8d1-861ecf5ba627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:28.777750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9166e-1b73-4182-b8d1-861ecf5ba627 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:28.795410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816070a1-11b3-4592-8a9f-bdb78b5a8e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:28.796534 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816070a1-11b3-4592-8a9f-bdb78b5a8e98 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:28.797012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816070a1-11b3-4592-8a9f-bdb78b5a8e98 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:28.797525 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816070a1-11b3-4592-8a9f-bdb78b5a8e98 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-84c9166e-1b73-4182-b8d1-861ecf5ba627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:28.798670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:28.808491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:28.812662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:28.812662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:28.812662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:28.812662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:28.813543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816070a1-11b3-4592-8a9f-bdb78b5a8e98 None admin] RBAC: Adding query filter params (type=image) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:28.813543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816070a1-11b3-4592-8a9f-bdb78b5a8e98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:28.820954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 523/1038] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:28.821110 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816070a1-11b3-4592-8a9f-bdb78b5a8e98 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:28.821244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9166e-1b73-4182-b8d1-861ecf5ba627 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:28.821416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 516/1039] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:28.827390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816070a1-11b3-4592-8a9f-bdb78b5a8e98 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:28.971119 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:28.972538 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9166e-1b73-4182-b8d1-861ecf5ba627 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:29.002173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816070a1-11b3-4592-8a9f-bdb78b5a8e98 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:29.028622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58140-3e3f-466f-982a-5a94108fb912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:29.029469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58140-3e3f-466f-982a-5a94108fb912 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:29.029805 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58140-3e3f-466f-982a-5a94108fb912 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:29.030183 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58140-3e3f-466f-982a-5a94108fb912 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:29.031132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd58140-3e3f-466f-982a-5a94108fb912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:29.031569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd58140-3e3f-466f-982a-5a94108fb912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:29.033855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd58140-3e3f-466f-982a-5a94108fb912 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:29.046369 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec4e2d-260f-4c97-9d7f-cf1f456349c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:29.047890 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec4e2d-260f-4c97-9d7f-cf1f456349c3 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:29.048086 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 524/1040] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:29.049493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec4e2d-260f-4c97-9d7f-cf1f456349c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:29.050101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec4e2d-260f-4c97-9d7f-cf1f456349c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:29.051641 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec4e2d-260f-4c97-9d7f-cf1f456349c3 None admin] RBAC: Adding query filter params (interface=public, service_id=6aab926910dd479eb11fd21f3e671d63, region_id=RegionOne) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:29.052202 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec4e2d-260f-4c97-9d7f-cf1f456349c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:29.054539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec4e2d-260f-4c97-9d7f-cf1f456349c3 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:29.055091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58140-3e3f-466f-982a-5a94108fb912 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:29.060663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 517/1041] 10.222.0.39 () {56 vars in 1251 bytes} [Tue May 31 20:40:28 2022] GET /identity/v3/endpoints?service_id=6aab926910dd479eb11fd21f3e671d63&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:29.067003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:29.068070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec4e2d-260f-4c97-9d7f-cf1f456349c3 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:29.183892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58140-3e3f-466f-982a-5a94108fb912 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:29.184873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec4e2d-260f-4c97-9d7f-cf1f456349c3 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:29.223609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398ded5-bd8f-4455-84ef-e96893da7859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:29.224272 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398ded5-bd8f-4455-84ef-e96893da7859 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:29.224552 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398ded5-bd8f-4455-84ef-e96893da7859 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:29.224826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398ded5-bd8f-4455-84ef-e96893da7859 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:29.225549 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398ded5-bd8f-4455-84ef-e96893da7859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:29.226938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398ded5-bd8f-4455-84ef-e96893da7859 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:29.231041 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e68cc-a27f-4f57-a54b-3b035ac3dee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:29.232092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e68cc-a27f-4f57-a54b-3b035ac3dee0 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:29.232551 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e68cc-a27f-4f57-a54b-3b035ac3dee0 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:29.232973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e68cc-a27f-4f57-a54b-3b035ac3dee0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:29.235283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 518/1042] 10.222.0.39 () {56 vars in 1087 bytes} [Tue May 31 20:40:29 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 20:40:29.242566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e68cc-a27f-4f57-a54b-3b035ac3dee0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:29.244353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e68cc-a27f-4f57-a54b-3b035ac3dee0 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-5a3e68cc-a27f-4f57-a54b-3b035ac3dee0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:40:29.262021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:29.263815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:29.265574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:40:29.265574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:40:29.265574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:40:29.265574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:40:29.265574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:40:29.265574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:40:29.265574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:29.265574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:29.269942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 525/1043] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:29.272406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398ded5-bd8f-4455-84ef-e96893da7859 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:29.289563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:29.436569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398ded5-bd8f-4455-84ef-e96893da7859 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:29.483472 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb35532-9da2-4cfb-916f-d2c0044a7d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:29.484153 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb35532-9da2-4cfb-916f-d2c0044a7d16 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:29.484442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb35532-9da2-4cfb-916f-d2c0044a7d16 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:29.484716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb35532-9da2-4cfb-916f-d2c0044a7d16 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:29.485590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb35532-9da2-4cfb-916f-d2c0044a7d16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:29.485908 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb35532-9da2-4cfb-916f-d2c0044a7d16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:29.487450 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb35532-9da2-4cfb-916f-d2c0044a7d16 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:29.505719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 519/1044] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:29.512308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e68cc-a27f-4f57-a54b-3b035ac3dee0 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:29.646102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:29.686493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e68cc-a27f-4f57-a54b-3b035ac3dee0 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:29.732679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33136e67-5cfd-412c-91b7-29cf6ce3c956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:29.733255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33136e67-5cfd-412c-91b7-29cf6ce3c956 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:29.733780 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33136e67-5cfd-412c-91b7-29cf6ce3c956 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:29.734068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33136e67-5cfd-412c-91b7-29cf6ce3c956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:29.734916 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33136e67-5cfd-412c-91b7-29cf6ce3c956 None admin] RBAC: Adding query filter params (role.id=f800b518993746dfaa6c0f19e0e9bcb0, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=8c86c12743bd4ee8843dba4a7af5d7a0) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:29.735234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33136e67-5cfd-412c-91b7-29cf6ce3c956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:29.737416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33136e67-5cfd-412c-91b7-29cf6ce3c956 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:29.753755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 526/1045] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:40:29 2022] GET /identity/v3/role_assignments?user.id=8c86c12743bd4ee8843dba4a7af5d7a0&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=f800b518993746dfaa6c0f19e0e9bcb0 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:31.049239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9040b-79a0-4e3a-8190-a8ffa679637e None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:31.049834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9040b-79a0-4e3a-8190-a8ffa679637e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:31.050253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9040b-79a0-4e3a-8190-a8ffa679637e None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:31.052810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 520/1046] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:31.060700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b8cc8-151f-40c3-9b93-5bd810cae0f0 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:31.061482 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b8cc8-151f-40c3-9b93-5bd810cae0f0 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:31.061482 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b8cc8-151f-40c3-9b93-5bd810cae0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:31.082424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b38b8cc8-151f-40c3-9b93-5bd810cae0f0 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:31.083648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b38b8cc8-151f-40c3-9b93-5bd810cae0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:31.164442 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 527/1047] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:31.190368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9040b-79a0-4e3a-8190-a8ffa679637e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:31.322179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:31.358803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9040b-79a0-4e3a-8190-a8ffa679637e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:31.398885 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d858-6adc-44b9-aac1-881461cff87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:31.399889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d858-6adc-44b9-aac1-881461cff87a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:31.400314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d858-6adc-44b9-aac1-881461cff87a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:31.400733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d858-6adc-44b9-aac1-881461cff87a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:31.413579 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954d858-6adc-44b9-aac1-881461cff87a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-3954d858-6adc-44b9-aac1-881461cff87a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:40:31.421845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:31.423577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:31.424503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:31.424503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:31.424503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:31.424503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:31.424503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:40:31.424503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:40:31.424503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:40:31.424503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:40:31.424503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:40:31.424503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:40:31.424503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:40:31.424503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:31.429486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 521/1048] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:40:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:31.430176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b8cc8-151f-40c3-9b93-5bd810cae0f0 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:31.497246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:31.546631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b8cc8-151f-40c3-9b93-5bd810cae0f0 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:31.588186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc5a50-8cf7-4140-bc0a-8859c12426e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:31.588766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc5a50-8cf7-4140-bc0a-8859c12426e8 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:31.589048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc5a50-8cf7-4140-bc0a-8859c12426e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:31.589315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc5a50-8cf7-4140-bc0a-8859c12426e8 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:31.590109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc5a50-8cf7-4140-bc0a-8859c12426e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:31.590425 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc5a50-8cf7-4140-bc0a-8859c12426e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:31.591810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc5a50-8cf7-4140-bc0a-8859c12426e8 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:31.602139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 528/1049] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:40:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:31.608512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d858-6adc-44b9-aac1-881461cff87a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:31.728650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d858-6adc-44b9-aac1-881461cff87a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:31.761022 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:31.768863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff6be7-424b-430a-8fdc-843af93e13da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:31.770036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff6be7-424b-430a-8fdc-843af93e13da None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:31.770488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff6be7-424b-430a-8fdc-843af93e13da None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:31.770963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff6be7-424b-430a-8fdc-843af93e13da None admin] PATH_INFO: `/v3/users/d86a291bd9cb4d2ba746238c22872a76` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:31.787040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff6be7-424b-430a-8fdc-843af93e13da None admin] RBAC: Authorizing `identity:get_user(user_id=d86a291bd9cb4d2ba746238c22872a76)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:31.788687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff6be7-424b-430a-8fdc-843af93e13da None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:31.795688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 522/1050] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:40:31 2022] GET /identity/v3/users/d86a291bd9cb4d2ba746238c22872a76 => generated 285 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:31.797001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc5a50-8cf7-4140-bc0a-8859c12426e8 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:31.882261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e528d0-492f-46ee-8064-4323b456e8be None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:31.882930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e528d0-492f-46ee-8064-4323b456e8be None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:31.883429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e528d0-492f-46ee-8064-4323b456e8be None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:31.885963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 523/1051] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:40:31.893225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761aca7-b7b4-4633-b7b7-c313146b974b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:31.893768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761aca7-b7b4-4633-b7b7-c313146b974b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:31.894169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761aca7-b7b4-4633-b7b7-c313146b974b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:31.938011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a761aca7-b7b4-4633-b7b7-c313146b974b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:31.940220 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a761aca7-b7b4-4633-b7b7-c313146b974b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:32.036167 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc5a50-8cf7-4140-bc0a-8859c12426e8 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:32.046738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 524/1052] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:32.072815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761aca7-b7b4-4633-b7b7-c313146b974b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:32.083221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:32.104410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271489e6-2688-44d5-a79e-4919b572d5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:32.105595 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271489e6-2688-44d5-a79e-4919b572d5e1 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:32.106340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271489e6-2688-44d5-a79e-4919b572d5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:32.106731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271489e6-2688-44d5-a79e-4919b572d5e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:32.210549 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761aca7-b7b4-4633-b7b7-c313146b974b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:32.236252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:32.236595 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271489e6-2688-44d5-a79e-4919b572d5e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:32.239357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271489e6-2688-44d5-a79e-4919b572d5e1 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:32.276494 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cace4-6ae6-4f2b-a3a3-aeadc1e59574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:32.277724 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cace4-6ae6-4f2b-a3a3-aeadc1e59574 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:32.278163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cace4-6ae6-4f2b-a3a3-aeadc1e59574 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:32.278585 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cace4-6ae6-4f2b-a3a3-aeadc1e59574 None admin] PATH_INFO: `/v3/services/image` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:32.279715 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cace4-6ae6-4f2b-a3a3-aeadc1e59574 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:32.281945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cace4-6ae6-4f2b-a3a3-aeadc1e59574 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-6a3cace4-6ae6-4f2b-a3a3-aeadc1e59574 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:32.303357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:32.304512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:40:32.305459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:32.311199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 525/1053] 10.222.0.39 () {56 vars in 1105 bytes} [Tue May 31 20:40:32 2022] GET /identity/v3/services/image => generated 86 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:32.312712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cace4-6ae6-4f2b-a3a3-aeadc1e59574 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:32.418070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 529/1054] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:40:31 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:40:32.427978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271489e6-2688-44d5-a79e-4919b572d5e1 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:32.462938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:32.504632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cace4-6ae6-4f2b-a3a3-aeadc1e59574 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:32.544053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271489e6-2688-44d5-a79e-4919b572d5e1 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:32.562785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afaf15-b9af-4b03-b7c4-c3cd1f081656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:32.563902 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afaf15-b9af-4b03-b7c4-c3cd1f081656 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:32.564393 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afaf15-b9af-4b03-b7c4-c3cd1f081656 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:32.564856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afaf15-b9af-4b03-b7c4-c3cd1f081656 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:32.566391 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afaf15-b9af-4b03-b7c4-c3cd1f081656 None admin] RBAC: Adding query filter params (name=image) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:32.566931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afaf15-b9af-4b03-b7c4-c3cd1f081656 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:32.569350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afaf15-b9af-4b03-b7c4-c3cd1f081656 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:32.578050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 526/1055] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:32.579834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c5132-723f-47d6-8cb5-5d843b673533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:32.580872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8529a-c31a-4983-9def-3c6855d48451 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:32.581047 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c5132-723f-47d6-8cb5-5d843b673533 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:32.581396 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8529a-c31a-4983-9def-3c6855d48451 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:32.581668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c5132-723f-47d6-8cb5-5d843b673533 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:32.581896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8529a-c31a-4983-9def-3c6855d48451 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:32.582249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c5132-723f-47d6-8cb5-5d843b673533 None admin] PATH_INFO: `/v3/projects/6dce66a7b4984bc197294086a15d699f` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:32.583642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c5132-723f-47d6-8cb5-5d843b673533 None admin] RBAC: Authorizing `identity:get_project(project_id=6dce66a7b4984bc197294086a15d699f)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:32.584227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 527/1056] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:32.585464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c5132-723f-47d6-8cb5-5d843b673533 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:32.585687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8529a-c31a-4983-9def-3c6855d48451 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:32.592390 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 530/1057] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:40:32 2022] GET /identity/v3/projects/6dce66a7b4984bc197294086a15d699f => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:32.592390 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8badb-83ca-48f8-bbde-8f6c74c4bdc2 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:32.592390 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8badb-83ca-48f8-bbde-8f6c74c4bdc2 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:32.592390 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8badb-83ca-48f8-bbde-8f6c74c4bdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:32.608101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-2de8badb-83ca-48f8-bbde-8f6c74c4bdc2 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:32.609304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2de8badb-83ca-48f8-bbde-8f6c74c4bdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:32.659380 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:32.705309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 531/1058] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:32.706724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8badb-83ca-48f8-bbde-8f6c74c4bdc2 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:32.740207 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8529a-c31a-4983-9def-3c6855d48451 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:32.748760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:32.784087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62a7ad-d6f6-4eae-85eb-8176a6ce1252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:32.784960 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62a7ad-d6f6-4eae-85eb-8176a6ce1252 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:32.785457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62a7ad-d6f6-4eae-85eb-8176a6ce1252 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:32.785858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62a7ad-d6f6-4eae-85eb-8176a6ce1252 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:32.786669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62a7ad-d6f6-4eae-85eb-8176a6ce1252 None admin] RBAC: Adding query filter params (type=image) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:32.787046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62a7ad-d6f6-4eae-85eb-8176a6ce1252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:32.788834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62a7ad-d6f6-4eae-85eb-8176a6ce1252 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:32.795337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 528/1059] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:32.796465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62a7ad-d6f6-4eae-85eb-8176a6ce1252 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:32.860954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8badb-83ca-48f8-bbde-8f6c74c4bdc2 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:32.912015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d046-7008-46d7-94fe-5e3c8f0a1956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:32.912672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d046-7008-46d7-94fe-5e3c8f0a1956 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:32.912957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d046-7008-46d7-94fe-5e3c8f0a1956 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:32.913241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d046-7008-46d7-94fe-5e3c8f0a1956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:32.914120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27d046-7008-46d7-94fe-5e3c8f0a1956 None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=6dce66a7b4984bc197294086a15d699f, user.id=d86a291bd9cb4d2ba746238c22872a76) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:32.914434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27d046-7008-46d7-94fe-5e3c8f0a1956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:32.915889 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27d046-7008-46d7-94fe-5e3c8f0a1956 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:32.922294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 532/1060] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:40:32 2022] GET /identity/v3/role_assignments?user.id=d86a291bd9cb4d2ba746238c22872a76&scope.project.id=6dce66a7b4984bc197294086a15d699f&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:32.923148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d046-7008-46d7-94fe-5e3c8f0a1956 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:32.948086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62a7ad-d6f6-4eae-85eb-8176a6ce1252 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:32.967190 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:32.999008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87da8a-9fd9-4a38-93e0-37ed4d0abc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:33.000296 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87da8a-9fd9-4a38-93e0-37ed4d0abc42 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:33.000566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87da8a-9fd9-4a38-93e0-37ed4d0abc42 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:33.000922 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87da8a-9fd9-4a38-93e0-37ed4d0abc42 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:33.019721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87da8a-9fd9-4a38-93e0-37ed4d0abc42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-8a87da8a-9fd9-4a38-93e0-37ed4d0abc42 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:40:33.028781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:33.030505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:33.032590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:33.032590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:33.032590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:33.032590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:33.032590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:40:33.032590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:40:33.032590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:40:33.032590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:40:33.032590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:40:33.032590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:40:33.032590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:40:33.032590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:33.035950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 529/1061] 10.222.0.39 () {56 vars in 1120 bytes} [Tue May 31 20:40:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:33.037123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87da8a-9fd9-4a38-93e0-37ed4d0abc42 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:33.055842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:33.078593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d046-7008-46d7-94fe-5e3c8f0a1956 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:33.134966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7793a-570b-47d5-a6cd-f1e1d44fc835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:33.135953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7793a-570b-47d5-a6cd-f1e1d44fc835 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:33.136487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7793a-570b-47d5-a6cd-f1e1d44fc835 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:33.136963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7793a-570b-47d5-a6cd-f1e1d44fc835 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:33.138340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7793a-570b-47d5-a6cd-f1e1d44fc835 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:33.140900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7793a-570b-47d5-a6cd-f1e1d44fc835 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:33.183636 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87da8a-9fd9-4a38-93e0-37ed4d0abc42 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:33.223577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167caba-8f07-466a-b410-8afe7403062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:33.224273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167caba-8f07-466a-b410-8afe7403062c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:33.224552 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167caba-8f07-466a-b410-8afe7403062c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:33.224835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167caba-8f07-466a-b410-8afe7403062c None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:33.225701 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167caba-8f07-466a-b410-8afe7403062c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:33.226012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167caba-8f07-466a-b410-8afe7403062c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:33.227440 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167caba-8f07-466a-b410-8afe7403062c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:33.237683 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 533/1062] 10.222.0.39 () {60 vars in 1144 bytes} [Tue May 31 20:40:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:40:33.241589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 530/1063] 10.222.0.39 () {56 vars in 1115 bytes} [Tue May 31 20:40:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:33.247421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7793a-570b-47d5-a6cd-f1e1d44fc835 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:33.434071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7793a-570b-47d5-a6cd-f1e1d44fc835 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:33.476398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0f87-1ff9-45dd-846a-2f423ec94fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:33.477421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0f87-1ff9-45dd-846a-2f423ec94fa0 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:33.477845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0f87-1ff9-45dd-846a-2f423ec94fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:33.478246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0f87-1ff9-45dd-846a-2f423ec94fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:33.482042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:33.492427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be0f87-1ff9-45dd-846a-2f423ec94fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:33.494323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be0f87-1ff9-45dd-846a-2f423ec94fa0 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-83be0f87-1ff9-45dd-846a-2f423ec94fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:33.514105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:33.515890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:33.518808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:33.518808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:33.518808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:33.518808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:33.523662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 534/1064] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:33.525136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167caba-8f07-466a-b410-8afe7403062c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:33.563962 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:33.681079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167caba-8f07-466a-b410-8afe7403062c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:33.742882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61397a91-d830-4ccd-afe7-26fa53c72890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:33.743985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61397a91-d830-4ccd-afe7-26fa53c72890 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:33.744470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61397a91-d830-4ccd-afe7-26fa53c72890 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:33.744947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61397a91-d830-4ccd-afe7-26fa53c72890 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:33.746363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61397a91-d830-4ccd-afe7-26fa53c72890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:33.746910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61397a91-d830-4ccd-afe7-26fa53c72890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:33.749520 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61397a91-d830-4ccd-afe7-26fa53c72890 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:33.777420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 531/1065] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:33.781690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0f87-1ff9-45dd-846a-2f423ec94fa0 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:33.992162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0f87-1ff9-45dd-846a-2f423ec94fa0 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:34.058627 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5378378-178b-4e28-a3b2-631458cf80ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:34.059985 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5378378-178b-4e28-a3b2-631458cf80ba None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:34.060506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5378378-178b-4e28-a3b2-631458cf80ba None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:34.061024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5378378-178b-4e28-a3b2-631458cf80ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:34.076307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5378378-178b-4e28-a3b2-631458cf80ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:34.079729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5378378-178b-4e28-a3b2-631458cf80ba None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-a5378378-178b-4e28-a3b2-631458cf80ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:40:34.104126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:34.106381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:34.116270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:34.116270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:34.116270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:40:34.116270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:40:34.116270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:40:34.116270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:40:34.116270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:40:34.116270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:40:34.116270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:40:34.116270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:34.116270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 535/1066] 10.222.0.39 () {56 vars in 1093 bytes} [Tue May 31 20:40:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:34.120227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61397a91-d830-4ccd-afe7-26fa53c72890 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:34.298835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:34.319097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61397a91-d830-4ccd-afe7-26fa53c72890 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:34.361680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a29ee-2f61-49cc-86d6-dbdf702ce0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:34.362526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a29ee-2f61-49cc-86d6-dbdf702ce0ed None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:34.362946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a29ee-2f61-49cc-86d6-dbdf702ce0ed None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:34.363348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a29ee-2f61-49cc-86d6-dbdf702ce0ed None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:34.364341 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a29ee-2f61-49cc-86d6-dbdf702ce0ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:34.364790 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a29ee-2f61-49cc-86d6-dbdf702ce0ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:34.366425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a29ee-2f61-49cc-86d6-dbdf702ce0ed None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:34.387454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 532/1067] 10.222.0.39 () {56 vars in 1133 bytes} [Tue May 31 20:40:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:34.393622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5378378-178b-4e28-a3b2-631458cf80ba None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:34.449930 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:34.541903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5378378-178b-4e28-a3b2-631458cf80ba None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:34.606972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e64831-0d49-4e90-8205-6f32fbc39762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:34.608187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e64831-0d49-4e90-8205-6f32fbc39762 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:34.608674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e64831-0d49-4e90-8205-6f32fbc39762 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:34.609169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e64831-0d49-4e90-8205-6f32fbc39762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:34.630785 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e64831-0d49-4e90-8205-6f32fbc39762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:34.633652 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e64831-0d49-4e90-8205-6f32fbc39762 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-d6e64831-0d49-4e90-8205-6f32fbc39762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:34.668440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:34.669492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:34.670435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:34.670435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:34.670435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:34.670435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:34.676424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 536/1068] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:34.677792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a29ee-2f61-49cc-86d6-dbdf702ce0ed None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:34.810267 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a29ee-2f61-49cc-86d6-dbdf702ce0ed None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:34.854920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbc2cf-c9b5-43d7-a45b-b32003f9fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:34.855964 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbc2cf-c9b5-43d7-a45b-b32003f9fd88 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:34.856480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbc2cf-c9b5-43d7-a45b-b32003f9fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:34.856952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbc2cf-c9b5-43d7-a45b-b32003f9fd88 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:34.857990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbc2cf-c9b5-43d7-a45b-b32003f9fd88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:34.858500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbc2cf-c9b5-43d7-a45b-b32003f9fd88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:34.860615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbc2cf-c9b5-43d7-a45b-b32003f9fd88 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:34.880098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 533/1069] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:34.881277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e64831-0d49-4e90-8205-6f32fbc39762 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:34.994295 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:35.000204 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e64831-0d49-4e90-8205-6f32fbc39762 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:35.060967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1751b60-1109-45cf-af22-ae6da31e77ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:35.062026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1751b60-1109-45cf-af22-ae6da31e77ee None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:35.062442 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1751b60-1109-45cf-af22-ae6da31e77ee None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:35.062845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1751b60-1109-45cf-af22-ae6da31e77ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:35.072072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1751b60-1109-45cf-af22-ae6da31e77ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:35.073786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1751b60-1109-45cf-af22-ae6da31e77ee None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-a1751b60-1109-45cf-af22-ae6da31e77ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:40:35.090417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:35.092200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:35.098626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:40:35.098626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:40:35.098626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:40:35.098626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:40:35.098626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:40:35.098626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:40:35.098626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:35.098626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:35.098626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 537/1070] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:40:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:35.110519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbc2cf-c9b5-43d7-a45b-b32003f9fd88 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:35.125076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:35.254555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbc2cf-c9b5-43d7-a45b-b32003f9fd88 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:35.324057 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb0095-1308-4aa7-9025-8c70b7c415f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:35.325067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb0095-1308-4aa7-9025-8c70b7c415f1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:35.325541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb0095-1308-4aa7-9025-8c70b7c415f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:35.325964 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb0095-1308-4aa7-9025-8c70b7c415f1 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:35.327272 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb0095-1308-4aa7-9025-8c70b7c415f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:35.327760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb0095-1308-4aa7-9025-8c70b7c415f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:35.330754 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb0095-1308-4aa7-9025-8c70b7c415f1 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:35.356749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 534/1071] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:35.358613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1751b60-1109-45cf-af22-ae6da31e77ee None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:35.533133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1751b60-1109-45cf-af22-ae6da31e77ee None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:35.591134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be80d4-abb9-4d7e-be79-81e84ad53311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:35.592667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be80d4-abb9-4d7e-be79-81e84ad53311 None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:35.593159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be80d4-abb9-4d7e-be79-81e84ad53311 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:35.593680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be80d4-abb9-4d7e-be79-81e84ad53311 None admin] PATH_INFO: `/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/8c86c12743bd4ee8843dba4a7af5d7a0/roles/f800b518993746dfaa6c0f19e0e9bcb0` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:35.597499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be80d4-abb9-4d7e-be79-81e84ad53311 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d14229f6554a34bf9084d36cffe8ac, user_id=8c86c12743bd4ee8843dba4a7af5d7a0, role_id=f800b518993746dfaa6c0f19e0e9bcb0)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:35.600249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be80d4-abb9-4d7e-be79-81e84ad53311 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:35.685184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 538/1072] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:40:35 2022] PUT /identity/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/8c86c12743bd4ee8843dba4a7af5d7a0/roles/f800b518993746dfaa6c0f19e0e9bcb0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:40:35.791842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa8a27-a9e2-41a6-bfbb-4e88a82756cc None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:35.792132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa8a27-a9e2-41a6-bfbb-4e88a82756cc None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:35.792264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa8a27-a9e2-41a6-bfbb-4e88a82756cc None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:35.794085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 535/1073] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:40:35.800670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689c976-4510-432f-874c-4f9a2aa1108b None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:35.800947 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689c976-4510-432f-874c-4f9a2aa1108b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:35.801323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689c976-4510-432f-874c-4f9a2aa1108b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:35.819719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-7689c976-4510-432f-874c-4f9a2aa1108b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:35.820956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7689c976-4510-432f-874c-4f9a2aa1108b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:35.839436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:35.919266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 539/1074] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:35.952954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa8a27-a9e2-41a6-bfbb-4e88a82756cc None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:36.041798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:36.081907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa8a27-a9e2-41a6-bfbb-4e88a82756cc None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:36.137759 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a4885-14ea-4506-bf20-3b09e36a8fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:36.139021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a4885-14ea-4506-bf20-3b09e36a8fae None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:36.139473 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a4885-14ea-4506-bf20-3b09e36a8fae None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:36.139919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a4885-14ea-4506-bf20-3b09e36a8fae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:36.159511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a4885-14ea-4506-bf20-3b09e36a8fae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-357a4885-14ea-4506-bf20-3b09e36a8fae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:40:36.172668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:36.173976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:36.174836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:36.174836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:36.174836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:36.174836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:36.174836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:40:36.174836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:40:36.174836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:40:36.174836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:40:36.174836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:40:36.174836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:40:36.174836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:40:36.174836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:36.175484 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 536/1075] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:40:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:36.182444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689c976-4510-432f-874c-4f9a2aa1108b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:36.350824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689c976-4510-432f-874c-4f9a2aa1108b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:36.390152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042be70-0d71-4a0f-b4ec-8aa59b0a1da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:36.390849 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042be70-0d71-4a0f-b4ec-8aa59b0a1da2 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:36.391662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042be70-0d71-4a0f-b4ec-8aa59b0a1da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:36.391992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042be70-0d71-4a0f-b4ec-8aa59b0a1da2 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:36.392759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042be70-0d71-4a0f-b4ec-8aa59b0a1da2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:36.393058 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042be70-0d71-4a0f-b4ec-8aa59b0a1da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:36.394484 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042be70-0d71-4a0f-b4ec-8aa59b0a1da2 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:36.404507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 540/1076] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:40:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:36.411606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a4885-14ea-4506-bf20-3b09e36a8fae None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:36.564919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a4885-14ea-4506-bf20-3b09e36a8fae None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:36.599099 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:36.614569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d44f9-2627-4ce9-8879-ec2a345aa31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:36.614569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d44f9-2627-4ce9-8879-ec2a345aa31d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:36.614569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d44f9-2627-4ce9-8879-ec2a345aa31d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:36.614569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d44f9-2627-4ce9-8879-ec2a345aa31d None admin] PATH_INFO: `/v3/users/d86a291bd9cb4d2ba746238c22872a76` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:36.615186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d44f9-2627-4ce9-8879-ec2a345aa31d None admin] RBAC: Authorizing `identity:get_user(user_id=d86a291bd9cb4d2ba746238c22872a76)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:36.615186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d44f9-2627-4ce9-8879-ec2a345aa31d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:36.615186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 537/1077] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:40:36 2022] GET /identity/v3/users/d86a291bd9cb4d2ba746238c22872a76 => generated 285 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:36.619504 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56c5d-0207-4646-a3f5-85ed2d84e8e8 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:36.619994 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d44f9-2627-4ce9-8879-ec2a345aa31d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:36.620759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56c5d-0207-4646-a3f5-85ed2d84e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:36.621262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56c5d-0207-4646-a3f5-85ed2d84e8e8 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:36.623522 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 541/1078] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:36.630486 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86411cd7-5b57-441d-870b-9c00de1ae641 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:36.630948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86411cd7-5b57-441d-870b-9c00de1ae641 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:36.631385 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86411cd7-5b57-441d-870b-9c00de1ae641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:36.650848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-86411cd7-5b57-441d-870b-9c00de1ae641 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:36.652575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-86411cd7-5b57-441d-870b-9c00de1ae641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:36.662852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:36.734425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d44f9-2627-4ce9-8879-ec2a345aa31d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:36.741412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 542/1079] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:36.758738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86411cd7-5b57-441d-870b-9c00de1ae641 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:36.774037 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b403940-0b9f-4221-a06f-da5bb43817c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:36.774911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b403940-0b9f-4221-a06f-da5bb43817c8 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:36.775188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b403940-0b9f-4221-a06f-da5bb43817c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:36.775456 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b403940-0b9f-4221-a06f-da5bb43817c8 None admin] PATH_INFO: `/v3/projects/6dce66a7b4984bc197294086a15d699f` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:36.776663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b403940-0b9f-4221-a06f-da5bb43817c8 None admin] RBAC: Authorizing `identity:get_project(project_id=6dce66a7b4984bc197294086a15d699f)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:36.778706 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b403940-0b9f-4221-a06f-da5bb43817c8 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:36.781094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 538/1080] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:40:36 2022] GET /identity/v3/projects/6dce66a7b4984bc197294086a15d699f => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:36.791187 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b403940-0b9f-4221-a06f-da5bb43817c8 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:36.887366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:36.909718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86411cd7-5b57-441d-870b-9c00de1ae641 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:36.927344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b403940-0b9f-4221-a06f-da5bb43817c8 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:36.966574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b604b-bc2e-4064-b6fb-a2b9ff924f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:36.967559 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b604b-bc2e-4064-b6fb-a2b9ff924f07 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:36.968022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b604b-bc2e-4064-b6fb-a2b9ff924f07 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:36.968501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b604b-bc2e-4064-b6fb-a2b9ff924f07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:36.971419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f04c26-c9ce-4267-8861-0565a39e1222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:36.972983 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f04c26-c9ce-4267-8861-0565a39e1222 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:36.973538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f04c26-c9ce-4267-8861-0565a39e1222 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:36.974012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f04c26-c9ce-4267-8861-0565a39e1222 None admin] PATH_INFO: `/v3/projects/6dce66a7b4984bc197294086a15d699f/users/d86a291bd9cb4d2ba746238c22872a76/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:36.977728 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f04c26-c9ce-4267-8861-0565a39e1222 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dce66a7b4984bc197294086a15d699f, user_id=d86a291bd9cb4d2ba746238c22872a76, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:36.980483 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f04c26-c9ce-4267-8861-0565a39e1222 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:36.985286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:37.043351 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b604b-bc2e-4064-b6fb-a2b9ff924f07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:37.044840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b604b-bc2e-4064-b6fb-a2b9ff924f07 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:37.091560 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 539/1081] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:40:36 2022] PUT /identity/v3/projects/6dce66a7b4984bc197294086a15d699f/users/d86a291bd9cb4d2ba746238c22872a76/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:40:37.186677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 543/1082] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:40:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:40:37.194495 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f04c26-c9ce-4267-8861-0565a39e1222 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:37.379376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f04c26-c9ce-4267-8861-0565a39e1222 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:37.426215 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:37.444798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4227c32-8b09-448f-a2bb-fcbfcc36a15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:37.444798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4227c32-8b09-448f-a2bb-fcbfcc36a15a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:37.444798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4227c32-8b09-448f-a2bb-fcbfcc36a15a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:37.444798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4227c32-8b09-448f-a2bb-fcbfcc36a15a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:37.463408 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4227c32-8b09-448f-a2bb-fcbfcc36a15a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:37.466255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4227c32-8b09-448f-a2bb-fcbfcc36a15a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-a4227c32-8b09-448f-a2bb-fcbfcc36a15a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:37.499556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:37.501139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:37.502424 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:37.502424 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:37.502424 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:37.502424 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:37.508126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 540/1083] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:37.509570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b604b-bc2e-4064-b6fb-a2b9ff924f07 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:37.561512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:37.628015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b604b-bc2e-4064-b6fb-a2b9ff924f07 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:37.666795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafb882-4f64-4398-9225-b7e03433d7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:37.667469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafb882-4f64-4398-9225-b7e03433d7ef None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:37.667750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafb882-4f64-4398-9225-b7e03433d7ef None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:37.668025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafb882-4f64-4398-9225-b7e03433d7ef None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:37.668747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafb882-4f64-4398-9225-b7e03433d7ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:37.669053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafb882-4f64-4398-9225-b7e03433d7ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:37.670480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafb882-4f64-4398-9225-b7e03433d7ef None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:37.687193 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 544/1084] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:38.044448 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade162ab-5fec-428d-82da-aeb17e023c92 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:38.044724 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade162ab-5fec-428d-82da-aeb17e023c92 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:38.045008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade162ab-5fec-428d-82da-aeb17e023c92 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:38.046504 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 541/1085] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:40:38.052871 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ad2c9-ae2c-4bab-96ef-2abf484dd870 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:38.053306 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ad2c9-ae2c-4bab-96ef-2abf484dd870 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:38.053731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ad2c9-ae2c-4bab-96ef-2abf484dd870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:38.072993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-2c0ad2c9-ae2c-4bab-96ef-2abf484dd870 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:38.074225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2c0ad2c9-ae2c-4bab-96ef-2abf484dd870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:38.145742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 545/1086] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:38.169690 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade162ab-5fec-428d-82da-aeb17e023c92 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:38.282946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade162ab-5fec-428d-82da-aeb17e023c92 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:38.324043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d5c81-71ae-4760-a1af-9b5d2a8fc324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:38.324859 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5c81-71ae-4760-a1af-9b5d2a8fc324 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:38.325143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5c81-71ae-4760-a1af-9b5d2a8fc324 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:38.325444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5c81-71ae-4760-a1af-9b5d2a8fc324 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:38.336848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d5c81-71ae-4760-a1af-9b5d2a8fc324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-1b2d5c81-71ae-4760-a1af-9b5d2a8fc324 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:40:38.345845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:38.346892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:38.347787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:38.347787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:38.347787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:38.347787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:38.347787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:40:38.347787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:40:38.347787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:40:38.347787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:40:38.347787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:40:38.347787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:40:38.347787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:40:38.347787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:38.349544 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 542/1087] 10.222.0.39 () {56 vars in 1120 bytes} [Tue May 31 20:40:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:38.353142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ad2c9-ae2c-4bab-96ef-2abf484dd870 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:38.385203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:38.457357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ad2c9-ae2c-4bab-96ef-2abf484dd870 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:38.492047 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36dcad-7c41-4223-bb44-b49ecff8d4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:38.492718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36dcad-7c41-4223-bb44-b49ecff8d4bf None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:38.492997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36dcad-7c41-4223-bb44-b49ecff8d4bf None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:38.493270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36dcad-7c41-4223-bb44-b49ecff8d4bf None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:38.494055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36dcad-7c41-4223-bb44-b49ecff8d4bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:38.494359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36dcad-7c41-4223-bb44-b49ecff8d4bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:38.495744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36dcad-7c41-4223-bb44-b49ecff8d4bf None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:38.505502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 546/1088] 10.222.0.39 () {56 vars in 1115 bytes} [Tue May 31 20:40:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:38.511316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d5c81-71ae-4760-a1af-9b5d2a8fc324 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:38.554753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:38.619610 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d5c81-71ae-4760-a1af-9b5d2a8fc324 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:38.656877 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574d743-d24a-41e3-afbb-233459ff1a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:38.657718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d743-d24a-41e3-afbb-233459ff1a45 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:38.657995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d743-d24a-41e3-afbb-233459ff1a45 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:38.658262 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d743-d24a-41e3-afbb-233459ff1a45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:38.669543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574d743-d24a-41e3-afbb-233459ff1a45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:38.671040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574d743-d24a-41e3-afbb-233459ff1a45 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e574d743-d24a-41e3-afbb-233459ff1a45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:38.691556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:38.693252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:38.694758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:38.694758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:38.694758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:38.694758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:38.694758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 543/1089] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:38.699055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36dcad-7c41-4223-bb44-b49ecff8d4bf None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:38.803068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:38.810637 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36dcad-7c41-4223-bb44-b49ecff8d4bf None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:38.847967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9677f-57d0-4d16-91eb-cb07f18aa866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:38.848642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9677f-57d0-4d16-91eb-cb07f18aa866 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:38.848923 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9677f-57d0-4d16-91eb-cb07f18aa866 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:38.849197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9677f-57d0-4d16-91eb-cb07f18aa866 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:38.849956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9677f-57d0-4d16-91eb-cb07f18aa866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:38.850263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9677f-57d0-4d16-91eb-cb07f18aa866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:38.851707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9677f-57d0-4d16-91eb-cb07f18aa866 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:38.870866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 547/1090] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:38.871791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574d743-d24a-41e3-afbb-233459ff1a45 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:38.974781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:38.986901 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574d743-d24a-41e3-afbb-233459ff1a45 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:39.028910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e967c-aa4b-4fad-8335-36750fb59deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:39.029872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e967c-aa4b-4fad-8335-36750fb59deb None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:39.030252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e967c-aa4b-4fad-8335-36750fb59deb None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:39.030626 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e967c-aa4b-4fad-8335-36750fb59deb None admin] PATH_INFO: `/v3/users/nova` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:39.040337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e967c-aa4b-4fad-8335-36750fb59deb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:39.042114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e967c-aa4b-4fad-8335-36750fb59deb None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-8e0e967c-aa4b-4fad-8335-36750fb59deb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:40:39.059607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:39.061849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:39.064554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:39.064554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:39.064554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:40:39.064554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:40:39.064554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:40:39.064554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:40:39.064554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:40:39.064554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:40:39.064554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:40:39.064554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:39.064554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 544/1091] 10.222.0.39 () {56 vars in 1093 bytes} [Tue May 31 20:40:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:39.069640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9677f-57d0-4d16-91eb-cb07f18aa866 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:39.205195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9677f-57d0-4d16-91eb-cb07f18aa866 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:39.263016 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8ddc8-7398-48b1-8dce-8283db683182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:39.264080 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8ddc8-7398-48b1-8dce-8283db683182 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:39.264575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8ddc8-7398-48b1-8dce-8283db683182 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:39.265024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8ddc8-7398-48b1-8dce-8283db683182 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:39.267191 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8ddc8-7398-48b1-8dce-8283db683182 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:39.267698 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8ddc8-7398-48b1-8dce-8283db683182 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:39.270273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8ddc8-7398-48b1-8dce-8283db683182 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:39.303285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 548/1092] 10.222.0.39 () {56 vars in 1133 bytes} [Tue May 31 20:40:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:39.309128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e967c-aa4b-4fad-8335-36750fb59deb None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:39.438541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9d181-96fd-4795-8833-80a7207aecaa None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:39.438928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9d181-96fd-4795-8833-80a7207aecaa None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:39.439321 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9d181-96fd-4795-8833-80a7207aecaa None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:39.441145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 549/1093] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:40:39.447032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca0761-85e9-4de0-8bff-edc919556a6f None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:39.447325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca0761-85e9-4de0-8bff-edc919556a6f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:39.447599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca0761-85e9-4de0-8bff-edc919556a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:39.465038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-7eca0761-85e9-4de0-8bff-edc919556a6f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:39.466249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7eca0761-85e9-4de0-8bff-edc919556a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:39.475212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:39.487663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e967c-aa4b-4fad-8335-36750fb59deb None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:39.533938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309ed65-28ac-4ee8-b1ff-d2ce9e4bd394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:39.535002 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309ed65-28ac-4ee8-b1ff-d2ce9e4bd394 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:39.535427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309ed65-28ac-4ee8-b1ff-d2ce9e4bd394 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:39.535793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309ed65-28ac-4ee8-b1ff-d2ce9e4bd394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:39.560199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:39.565438 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 550/1094] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:39.598244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca0761-85e9-4de0-8bff-edc919556a6f None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:39.638120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309ed65-28ac-4ee8-b1ff-d2ce9e4bd394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:39.640564 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309ed65-28ac-4ee8-b1ff-d2ce9e4bd394 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:39.728616 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca0761-85e9-4de0-8bff-edc919556a6f None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:39.757425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 545/1095] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:40:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:40:39.766647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309ed65-28ac-4ee8-b1ff-d2ce9e4bd394 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:39.783682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411e647-5acf-4fa6-9c25-78293c51ce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:39.785035 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411e647-5acf-4fa6-9c25-78293c51ce51 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:39.785576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411e647-5acf-4fa6-9c25-78293c51ce51 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:39.786058 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411e647-5acf-4fa6-9c25-78293c51ce51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:39.804247 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411e647-5acf-4fa6-9c25-78293c51ce51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:40:39.818352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-5411e647-5acf-4fa6-9c25-78293c51ce51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:40:39.819962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:39.821971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:39.823747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:39.823747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:39.823747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:39.823747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:39.823747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:40:39.823747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:40:39.823747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:40:39.823747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:40:39.823747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:40:39.823747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:40:39.823747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:40:39.823747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:40:39.823747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 551/1096] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:40:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:40:39.829061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411e647-5acf-4fa6-9c25-78293c51ce51 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:39.832402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:39.897843 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309ed65-28ac-4ee8-b1ff-d2ce9e4bd394 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:39.939398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7e66-d98d-4422-85d8-10cd142a3f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:39.940915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7e66-d98d-4422-85d8-10cd142a3f86 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:39.941371 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7e66-d98d-4422-85d8-10cd142a3f86 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:39.941855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7e66-d98d-4422-85d8-10cd142a3f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:39.958714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b7e66-d98d-4422-85d8-10cd142a3f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:39.960471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b7e66-d98d-4422-85d8-10cd142a3f86 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:39.970187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411e647-5acf-4fa6-9c25-78293c51ce51 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-ab2b7e66-d98d-4422-85d8-10cd142a3f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:40:39.984139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:39.986136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:39.987392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:40:39.987392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:40:39.987392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:40:39.987392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:39.987392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 546/1097] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:39.992681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7e66-d98d-4422-85d8-10cd142a3f86 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:40.015102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa85f8-1add-40ab-bd45-1b23b96d44ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:40.016457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa85f8-1add-40ab-bd45-1b23b96d44ee None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:40.016838 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa85f8-1add-40ab-bd45-1b23b96d44ee None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:40.017246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa85f8-1add-40ab-bd45-1b23b96d44ee None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:40.018220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa85f8-1add-40ab-bd45-1b23b96d44ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:40.018652 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa85f8-1add-40ab-bd45-1b23b96d44ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:40.020201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa85f8-1add-40ab-bd45-1b23b96d44ee None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:40.031697 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 552/1098] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:40:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:40.037951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa85f8-1add-40ab-bd45-1b23b96d44ee None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:40.116919 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:40.120759 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7e66-d98d-4422-85d8-10cd142a3f86 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:40.123397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:40.173558 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59041f86-2552-4189-86a6-c38e71ac082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:40.174347 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59041f86-2552-4189-86a6-c38e71ac082c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:40.174709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59041f86-2552-4189-86a6-c38e71ac082c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:40.174872 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa85f8-1add-40ab-bd45-1b23b96d44ee None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:40.175145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59041f86-2552-4189-86a6-c38e71ac082c None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:40.175964 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59041f86-2552-4189-86a6-c38e71ac082c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:40.176409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59041f86-2552-4189-86a6-c38e71ac082c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:40.178006 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59041f86-2552-4189-86a6-c38e71ac082c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:40.193428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 547/1099] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:40.199018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59041f86-2552-4189-86a6-c38e71ac082c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:40.225146 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d58f8-45bb-4219-b453-5e76218e767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:40.226598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d58f8-45bb-4219-b453-5e76218e767f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:40.227063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d58f8-45bb-4219-b453-5e76218e767f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:40.227521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d58f8-45bb-4219-b453-5e76218e767f None admin] PATH_INFO: `/v3/users/d86a291bd9cb4d2ba746238c22872a76` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:40.229319 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d58f8-45bb-4219-b453-5e76218e767f None admin] RBAC: Authorizing `identity:get_user(user_id=d86a291bd9cb4d2ba746238c22872a76)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:40.231854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d58f8-45bb-4219-b453-5e76218e767f None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:40.235293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 553/1100] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:40:40 2022] GET /identity/v3/users/d86a291bd9cb4d2ba746238c22872a76 => generated 285 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:40.241870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d58f8-45bb-4219-b453-5e76218e767f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:40.336121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59041f86-2552-4189-86a6-c38e71ac082c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:40.376039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d58f8-45bb-4219-b453-5e76218e767f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:40.383005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f8b59-dbbd-46e7-9c32-19422a2deab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:40.384287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f8b59-dbbd-46e7-9c32-19422a2deab4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:40.384753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f8b59-dbbd-46e7-9c32-19422a2deab4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:40.385198 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f8b59-dbbd-46e7-9c32-19422a2deab4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:40.396949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f8b59-dbbd-46e7-9c32-19422a2deab4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:40.399544 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f8b59-dbbd-46e7-9c32-19422a2deab4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:40.425116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-4a6f8b59-dbbd-46e7-9c32-19422a2deab4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:40:40.426227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:40:40.427976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:40:40.429132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:40:40.429132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:40:40.429132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:40:40.429132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:40:40.429132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:40:40.429132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:40:40.429132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:40:40.429132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:40:40.429132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 548/1101] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:40:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:40:40.434009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eb69b-5329-4d4e-9e8d-734a052a43a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:40.435098 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eb69b-5329-4d4e-9e8d-734a052a43a3 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:40.435594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eb69b-5329-4d4e-9e8d-734a052a43a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:40.436183 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eb69b-5329-4d4e-9e8d-734a052a43a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:40.437410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f8b59-dbbd-46e7-9c32-19422a2deab4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:40.462868 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:40.518876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3eb69b-5329-4d4e-9e8d-734a052a43a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:40.520249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3eb69b-5329-4d4e-9e8d-734a052a43a3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:40.557640 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f8b59-dbbd-46e7-9c32-19422a2deab4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:40.596320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5a695-0225-4045-abbe-999de2834682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:40.596974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a695-0225-4045-abbe-999de2834682 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:40.597253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a695-0225-4045-abbe-999de2834682 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:40.597555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a695-0225-4045-abbe-999de2834682 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:40.598345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5a695-0225-4045-abbe-999de2834682 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:40.598664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5a695-0225-4045-abbe-999de2834682 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:40.600090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5a695-0225-4045-abbe-999de2834682 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:40.621104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 549/1102] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:40:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:40.631641 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5a695-0225-4045-abbe-999de2834682 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:40.644517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 554/1103] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:40:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 31 20:40:40.650672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eb69b-5329-4d4e-9e8d-734a052a43a3 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:40.685349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:40.777782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eb69b-5329-4d4e-9e8d-734a052a43a3 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:40.778793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:40.798868 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5a695-0225-4045-abbe-999de2834682 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:40.815091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3241f-bda1-4a53-9738-a8bdbeca2120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:40.815965 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3241f-bda1-4a53-9738-a8bdbeca2120 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:40.816247 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3241f-bda1-4a53-9738-a8bdbeca2120 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:40.816583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3241f-bda1-4a53-9738-a8bdbeca2120 None admin] PATH_INFO: `/v3/projects/6dce66a7b4984bc197294086a15d699f` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:40.817782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3241f-bda1-4a53-9738-a8bdbeca2120 None admin] RBAC: Authorizing `identity:get_project(project_id=6dce66a7b4984bc197294086a15d699f)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:40.819226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3241f-bda1-4a53-9738-a8bdbeca2120 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:40.820945 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 555/1104] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:40:40 2022] GET /identity/v3/projects/6dce66a7b4984bc197294086a15d699f => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:40.827637 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3241f-bda1-4a53-9738-a8bdbeca2120 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:40.847818 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7673f4-27c5-491b-86b8-52e3186c7fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:40.851122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7673f4-27c5-491b-86b8-52e3186c7fd5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:40.851122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7673f4-27c5-491b-86b8-52e3186c7fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:40.851122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7673f4-27c5-491b-86b8-52e3186c7fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:40.851373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7673f4-27c5-491b-86b8-52e3186c7fd5 None admin] RBAC: Adding query filter params (role.id=f800b518993746dfaa6c0f19e0e9bcb0, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=8c86c12743bd4ee8843dba4a7af5d7a0) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:40.851737 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7673f4-27c5-491b-86b8-52e3186c7fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:40.854137 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7673f4-27c5-491b-86b8-52e3186c7fd5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:40.863959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 550/1105] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:40:40 2022] GET /identity/v3/role_assignments?user.id=8c86c12743bd4ee8843dba4a7af5d7a0&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=f800b518993746dfaa6c0f19e0e9bcb0 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:40.951461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:40.955811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3241f-bda1-4a53-9738-a8bdbeca2120 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:40.994342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9561b4e-f2d4-403d-bfec-cb9e5611acab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:40.995009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9561b4e-f2d4-403d-bfec-cb9e5611acab None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:40.995287 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9561b4e-f2d4-403d-bfec-cb9e5611acab None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:40.995564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9561b4e-f2d4-403d-bfec-cb9e5611acab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:40.996401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9561b4e-f2d4-403d-bfec-cb9e5611acab None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=6dce66a7b4984bc197294086a15d699f, user.id=d86a291bd9cb4d2ba746238c22872a76) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:40.996711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9561b4e-f2d4-403d-bfec-cb9e5611acab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:40.998229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9561b4e-f2d4-403d-bfec-cb9e5611acab None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:41.005872 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 556/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:40:40 2022] GET /identity/v3/role_assignments?user.id=d86a291bd9cb4d2ba746238c22872a76&scope.project.id=6dce66a7b4984bc197294086a15d699f&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:40:43.358227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1cb14-e44f-4fbf-9124-beab289660a0 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:43.359412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1cb14-e44f-4fbf-9124-beab289660a0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:43.359412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1cb14-e44f-4fbf-9124-beab289660a0 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:43.360708 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 551/1107] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:43.366310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0053a6f-1812-4908-8153-7af5c5d2b818 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:43.366720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0053a6f-1812-4908-8153-7af5c5d2b818 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:43.366868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0053a6f-1812-4908-8153-7af5c5d2b818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:43.383714 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a0053a6f-1812-4908-8153-7af5c5d2b818 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:43.384928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a0053a6f-1812-4908-8153-7af5c5d2b818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:43.452912 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 557/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:40:43.478641 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1cb14-e44f-4fbf-9124-beab289660a0 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:43.581586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1cb14-e44f-4fbf-9124-beab289660a0 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:43.616487 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44599f-6400-4ef6-b523-88b48a1c21a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:43.617268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44599f-6400-4ef6-b523-88b48a1c21a5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:43.617578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44599f-6400-4ef6-b523-88b48a1c21a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:43.617854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44599f-6400-4ef6-b523-88b48a1c21a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:43.619036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44599f-6400-4ef6-b523-88b48a1c21a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:43.620477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44599f-6400-4ef6-b523-88b48a1c21a5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:43.622155 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 552/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:43.628822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0053a6f-1812-4908-8153-7af5c5d2b818 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:43.721500 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:43.729950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0053a6f-1812-4908-8153-7af5c5d2b818 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:43.766624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aa323-56fa-42db-a761-4aed8896c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:43.767730 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aa323-56fa-42db-a761-4aed8896c6f9 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:43.768013 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aa323-56fa-42db-a761-4aed8896c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:43.768289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aa323-56fa-42db-a761-4aed8896c6f9 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:43.768990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177aa323-56fa-42db-a761-4aed8896c6f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:43.770468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177aa323-56fa-42db-a761-4aed8896c6f9 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:43.858432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 558/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:40:43 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:40:46.190214 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04168590-ad69-4cae-a024-22d547f370f3 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:46.190782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04168590-ad69-4cae-a024-22d547f370f3 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:46.190782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04168590-ad69-4cae-a024-22d547f370f3 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:46.192142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 553/1111] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:46.197513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db32f-fdb6-4016-8fe3-c6c261efc133 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:46.197932 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db32f-fdb6-4016-8fe3-c6c261efc133 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:46.198075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db32f-fdb6-4016-8fe3-c6c261efc133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:46.215833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-072db32f-fdb6-4016-8fe3-c6c261efc133 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:46.217009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-072db32f-fdb6-4016-8fe3-c6c261efc133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:46.281617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 559/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:46.305511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04168590-ad69-4cae-a024-22d547f370f3 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:46.321791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:46.406643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04168590-ad69-4cae-a024-22d547f370f3 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:46.440197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a2ed0-5b81-4fd5-b64f-eed46972ac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:46.441094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a2ed0-5b81-4fd5-b64f-eed46972ac4f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:46.441320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a2ed0-5b81-4fd5-b64f-eed46972ac4f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:46.441621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a2ed0-5b81-4fd5-b64f-eed46972ac4f None admin] PATH_INFO: `/v3/roles/cf5f891b636947e0840ddfa871027fed` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:46.443061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a2ed0-5b81-4fd5-b64f-eed46972ac4f None admin] RBAC: Authorizing `identity:get_role(role_id=cf5f891b636947e0840ddfa871027fed)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:46.444430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a2ed0-5b81-4fd5-b64f-eed46972ac4f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:46.445842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 554/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:40:46 2022] GET /identity/v3/roles/cf5f891b636947e0840ddfa871027fed => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:46.451647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072db32f-fdb6-4016-8fe3-c6c261efc133 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:46.531460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:46.549758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072db32f-fdb6-4016-8fe3-c6c261efc133 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:46.584601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e71ef-7d8f-4a66-b2bc-3574cf23c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:46.585504 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e71ef-7d8f-4a66-b2bc-3574cf23c017 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:46.585790 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e71ef-7d8f-4a66-b2bc-3574cf23c017 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:46.586068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e71ef-7d8f-4a66-b2bc-3574cf23c017 None admin] PATH_INFO: `/v3/users/58e6145574c94aeb98a62a6ba23f2c40` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:46.599369 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e71ef-7d8f-4a66-b2bc-3574cf23c017 None admin] RBAC: Authorizing `identity:get_user(user_id=58e6145574c94aeb98a62a6ba23f2c40)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:46.600810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e71ef-7d8f-4a66-b2bc-3574cf23c017 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:46.602514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 560/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:40:46 2022] GET /identity/v3/users/58e6145574c94aeb98a62a6ba23f2c40 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:46.608790 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a2ed0-5b81-4fd5-b64f-eed46972ac4f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:46.688190 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:46.706234 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a2ed0-5b81-4fd5-b64f-eed46972ac4f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:46.739693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196cd17-6517-4fb2-9c7a-72d3403e091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:46.740329 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196cd17-6517-4fb2-9c7a-72d3403e091e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:46.740616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196cd17-6517-4fb2-9c7a-72d3403e091e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:46.740897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196cd17-6517-4fb2-9c7a-72d3403e091e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:46.806581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196cd17-6517-4fb2-9c7a-72d3403e091e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:46.808030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196cd17-6517-4fb2-9c7a-72d3403e091e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:46.886380 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:46.904283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 555/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:40:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:40:46.910767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e71ef-7d8f-4a66-b2bc-3574cf23c017 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:47.008845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e71ef-7d8f-4a66-b2bc-3574cf23c017 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:47.041862 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799ed44-35f7-48aa-b411-b65c9d4a7d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:47.042704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799ed44-35f7-48aa-b411-b65c9d4a7d79 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:47.042989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799ed44-35f7-48aa-b411-b65c9d4a7d79 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:47.043267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799ed44-35f7-48aa-b411-b65c9d4a7d79 None admin] PATH_INFO: `/v3/projects/6dce66a7b4984bc197294086a15d699f` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:47.044434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799ed44-35f7-48aa-b411-b65c9d4a7d79 None admin] RBAC: Authorizing `identity:get_project(project_id=6dce66a7b4984bc197294086a15d699f)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:47.046493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799ed44-35f7-48aa-b411-b65c9d4a7d79 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:47.048185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 561/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:40:46 2022] GET /identity/v3/projects/6dce66a7b4984bc197294086a15d699f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:47.054334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196cd17-6517-4fb2-9c7a-72d3403e091e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:47.157065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196cd17-6517-4fb2-9c7a-72d3403e091e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:47.193909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414a8e1-9d7c-45cc-bbb0-01e719cc3323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:47.194574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414a8e1-9d7c-45cc-bbb0-01e719cc3323 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:47.194837 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414a8e1-9d7c-45cc-bbb0-01e719cc3323 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:47.195108 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414a8e1-9d7c-45cc-bbb0-01e719cc3323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:47.195938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414a8e1-9d7c-45cc-bbb0-01e719cc3323 None admin] RBAC: Adding query filter params (role.id=cf5f891b636947e0840ddfa871027fed, scope.project.id=6dce66a7b4984bc197294086a15d699f, user.id=58e6145574c94aeb98a62a6ba23f2c40) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:47.196250 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414a8e1-9d7c-45cc-bbb0-01e719cc3323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:47.197721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414a8e1-9d7c-45cc-bbb0-01e719cc3323 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:47.204436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 556/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:40:47 2022] GET /identity/v3/role_assignments?user.id=58e6145574c94aeb98a62a6ba23f2c40&scope.project.id=6dce66a7b4984bc197294086a15d699f&role.id=cf5f891b636947e0840ddfa871027fed => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:49.451281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc00af-328e-44d2-91a8-486a95801ef9 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:49.452392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc00af-328e-44d2-91a8-486a95801ef9 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:49.452392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc00af-328e-44d2-91a8-486a95801ef9 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:49.453790 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 562/1118] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:49.459034 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bfb03-9da1-4f43-80ae-a35c2e9924d2 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:49.459409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bfb03-9da1-4f43-80ae-a35c2e9924d2 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:49.459598 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bfb03-9da1-4f43-80ae-a35c2e9924d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:49.476034 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b68bfb03-9da1-4f43-80ae-a35c2e9924d2 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:49.477213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b68bfb03-9da1-4f43-80ae-a35c2e9924d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:49.519406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:49.542968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 557/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:49.567172 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc00af-328e-44d2-91a8-486a95801ef9 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:49.577347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:49.667470 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc00af-328e-44d2-91a8-486a95801ef9 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:49.700789 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f232fe1-a867-44b3-ac50-9a8b6e6c6108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:49.701687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f232fe1-a867-44b3-ac50-9a8b6e6c6108 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:49.701972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f232fe1-a867-44b3-ac50-9a8b6e6c6108 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:49.702246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f232fe1-a867-44b3-ac50-9a8b6e6c6108 None admin] PATH_INFO: `/v3/roles/cf5f891b636947e0840ddfa871027fed` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:49.703705 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f232fe1-a867-44b3-ac50-9a8b6e6c6108 None admin] RBAC: Authorizing `identity:get_role(role_id=cf5f891b636947e0840ddfa871027fed)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:49.705087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f232fe1-a867-44b3-ac50-9a8b6e6c6108 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:49.706498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 563/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:40:49 2022] GET /identity/v3/roles/cf5f891b636947e0840ddfa871027fed => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:49.712287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bfb03-9da1-4f43-80ae-a35c2e9924d2 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:49.807895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bfb03-9da1-4f43-80ae-a35c2e9924d2 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:49.841529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739b739-ad50-467d-bcce-e1eb3e4ab686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:49.842365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739b739-ad50-467d-bcce-e1eb3e4ab686 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:49.842638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739b739-ad50-467d-bcce-e1eb3e4ab686 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:49.842905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739b739-ad50-467d-bcce-e1eb3e4ab686 None admin] PATH_INFO: `/v3/users/58e6145574c94aeb98a62a6ba23f2c40` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:49.844072 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739b739-ad50-467d-bcce-e1eb3e4ab686 None admin] RBAC: Authorizing `identity:get_user(user_id=58e6145574c94aeb98a62a6ba23f2c40)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:49.845520 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739b739-ad50-467d-bcce-e1eb3e4ab686 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:49.847133 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 558/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:40:49 2022] GET /identity/v3/users/58e6145574c94aeb98a62a6ba23f2c40 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:49.853186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f232fe1-a867-44b3-ac50-9a8b6e6c6108 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:49.928593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:49.954126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f232fe1-a867-44b3-ac50-9a8b6e6c6108 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:49.986604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa357d-1298-48f7-8ae9-492c8aa4d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:49.987462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa357d-1298-48f7-8ae9-492c8aa4d510 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:49.987746 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa357d-1298-48f7-8ae9-492c8aa4d510 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:49.988023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa357d-1298-48f7-8ae9-492c8aa4d510 None admin] PATH_INFO: `/v3/projects/6dce66a7b4984bc197294086a15d699f` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:49.989185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa357d-1298-48f7-8ae9-492c8aa4d510 None admin] RBAC: Authorizing `identity:get_project(project_id=6dce66a7b4984bc197294086a15d699f)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:49.990651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa357d-1298-48f7-8ae9-492c8aa4d510 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:49.992337 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 564/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:40:49 2022] GET /identity/v3/projects/6dce66a7b4984bc197294086a15d699f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:49.998304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739b739-ad50-467d-bcce-e1eb3e4ab686 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:50.043383 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:50.097663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739b739-ad50-467d-bcce-e1eb3e4ab686 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:50.130587 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192c0f8-ca18-48d0-ae39-a258023711ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:50.131457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192c0f8-ca18-48d0-ae39-a258023711ee None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:50.131738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192c0f8-ca18-48d0-ae39-a258023711ee None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:50.132012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192c0f8-ca18-48d0-ae39-a258023711ee None admin] PATH_INFO: `/v3/projects/6dce66a7b4984bc197294086a15d699f/users/58e6145574c94aeb98a62a6ba23f2c40/roles/cf5f891b636947e0840ddfa871027fed` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:50.134237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192c0f8-ca18-48d0-ae39-a258023711ee None admin] RBAC: Authorizing `identity:create_grant(project_id=6dce66a7b4984bc197294086a15d699f, user_id=58e6145574c94aeb98a62a6ba23f2c40, role_id=cf5f891b636947e0840ddfa871027fed)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:50.135661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192c0f8-ca18-48d0-ae39-a258023711ee None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:50.229979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 559/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:40:49 2022] PUT /identity/v3/projects/6dce66a7b4984bc197294086a15d699f/users/58e6145574c94aeb98a62a6ba23f2c40/roles/cf5f891b636947e0840ddfa871027fed => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:40:52.462988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364192d-887a-4605-9f46-ae129c7f5cef None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:52.463503 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364192d-887a-4605-9f46-ae129c7f5cef None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:52.463590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364192d-887a-4605-9f46-ae129c7f5cef None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:52.464923 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 565/1124] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:52.470750 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f3abf-a70f-44b3-8b03-4451de6f18d1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:52.471149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f3abf-a70f-44b3-8b03-4451de6f18d1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:52.471310 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f3abf-a70f-44b3-8b03-4451de6f18d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:52.488357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2d7f3abf-a70f-44b3-8b03-4451de6f18d1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:52.489555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2d7f3abf-a70f-44b3-8b03-4451de6f18d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:52.556920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 560/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:52.581135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364192d-887a-4605-9f46-ae129c7f5cef None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:52.681715 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364192d-887a-4605-9f46-ae129c7f5cef None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:52.714498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde434d4-7db1-4989-936f-ae9e8b62a03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:52.715349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde434d4-7db1-4989-936f-ae9e8b62a03f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:52.715630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde434d4-7db1-4989-936f-ae9e8b62a03f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:52.715906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde434d4-7db1-4989-936f-ae9e8b62a03f None admin] PATH_INFO: `/v3/roles/cf5f891b636947e0840ddfa871027fed` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:52.717363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde434d4-7db1-4989-936f-ae9e8b62a03f None admin] RBAC: Authorizing `identity:get_role(role_id=cf5f891b636947e0840ddfa871027fed)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:52.718752 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde434d4-7db1-4989-936f-ae9e8b62a03f None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:52.720121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 566/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:40:52 2022] GET /identity/v3/roles/cf5f891b636947e0840ddfa871027fed => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:52.725923 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f3abf-a70f-44b3-8b03-4451de6f18d1 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:52.759223 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:52.824179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f3abf-a70f-44b3-8b03-4451de6f18d1 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:52.858114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5907ca-029c-4462-9a1f-d347359298ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:52.858983 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5907ca-029c-4462-9a1f-d347359298ec None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:52.859262 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5907ca-029c-4462-9a1f-d347359298ec None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:52.859535 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5907ca-029c-4462-9a1f-d347359298ec None admin] PATH_INFO: `/v3/users/58e6145574c94aeb98a62a6ba23f2c40` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:52.860720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5907ca-029c-4462-9a1f-d347359298ec None admin] RBAC: Authorizing `identity:get_user(user_id=58e6145574c94aeb98a62a6ba23f2c40)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:52.862196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5907ca-029c-4462-9a1f-d347359298ec None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:52.863852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 561/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:40:52 2022] GET /identity/v3/users/58e6145574c94aeb98a62a6ba23f2c40 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:52.870427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde434d4-7db1-4989-936f-ae9e8b62a03f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:52.884308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:52.972222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde434d4-7db1-4989-936f-ae9e8b62a03f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:53.005252 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f84162-d1c6-48b0-aea7-801a0e0a04a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:53.005928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f84162-d1c6-48b0-aea7-801a0e0a04a2 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:53.006217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f84162-d1c6-48b0-aea7-801a0e0a04a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:53.006493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f84162-d1c6-48b0-aea7-801a0e0a04a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:53.072359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f84162-d1c6-48b0-aea7-801a0e0a04a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:53.073839 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f84162-d1c6-48b0-aea7-801a0e0a04a2 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:53.085320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:53.170992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 567/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:40:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:40:53.176813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5907ca-029c-4462-9a1f-d347359298ec None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:53.277004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5907ca-029c-4462-9a1f-d347359298ec None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:53.278627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:53.313572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1557ba5-567f-44e0-ab25-3b9e5a3c97f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:53.314430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1557ba5-567f-44e0-ab25-3b9e5a3c97f6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:53.314718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1557ba5-567f-44e0-ab25-3b9e5a3c97f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:53.314996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1557ba5-567f-44e0-ab25-3b9e5a3c97f6 None admin] PATH_INFO: `/v3/projects/6dce66a7b4984bc197294086a15d699f` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:53.316167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1557ba5-567f-44e0-ab25-3b9e5a3c97f6 None admin] RBAC: Authorizing `identity:get_project(project_id=6dce66a7b4984bc197294086a15d699f)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:53.317630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1557ba5-567f-44e0-ab25-3b9e5a3c97f6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:53.319333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 562/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:40:53 2022] GET /identity/v3/projects/6dce66a7b4984bc197294086a15d699f => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:53.325326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f84162-d1c6-48b0-aea7-801a0e0a04a2 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:53.421043 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f84162-d1c6-48b0-aea7-801a0e0a04a2 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:53.431938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:53.454906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397bc5-983c-4df3-97d5-5707a33f6823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:53.455546 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397bc5-983c-4df3-97d5-5707a33f6823 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:53.455829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397bc5-983c-4df3-97d5-5707a33f6823 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:53.456105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397bc5-983c-4df3-97d5-5707a33f6823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:53.456921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57397bc5-983c-4df3-97d5-5707a33f6823 None admin] RBAC: Adding query filter params (role.id=cf5f891b636947e0840ddfa871027fed, scope.project.id=6dce66a7b4984bc197294086a15d699f, user.id=58e6145574c94aeb98a62a6ba23f2c40) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:40:53.457233 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57397bc5-983c-4df3-97d5-5707a33f6823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:53.458707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57397bc5-983c-4df3-97d5-5707a33f6823 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:53.464801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 568/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:40:53 2022] GET /identity/v3/role_assignments?user.id=58e6145574c94aeb98a62a6ba23f2c40&scope.project.id=6dce66a7b4984bc197294086a15d699f&role.id=cf5f891b636947e0840ddfa871027fed => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:55.751367 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73fd96-8fa3-49b9-ac55-c884ffa35530 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:55.751932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73fd96-8fa3-49b9-ac55-c884ffa35530 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:55.751932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73fd96-8fa3-49b9-ac55-c884ffa35530 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:55.753292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 563/1131] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:55.758702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b27d1d-c935-4bc5-94d1-f1d1a5d85d70 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:55.759129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b27d1d-c935-4bc5-94d1-f1d1a5d85d70 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:55.759258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b27d1d-c935-4bc5-94d1-f1d1a5d85d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:55.775775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-47b27d1d-c935-4bc5-94d1-f1d1a5d85d70 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:55.776974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-47b27d1d-c935-4bc5-94d1-f1d1a5d85d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:55.844671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 569/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:55.868627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73fd96-8fa3-49b9-ac55-c884ffa35530 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:55.971092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73fd96-8fa3-49b9-ac55-c884ffa35530 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:56.005675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ee857-fbad-4b23-8f45-2965bded3770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:56.006387 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ee857-fbad-4b23-8f45-2965bded3770 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:56.006673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ee857-fbad-4b23-8f45-2965bded3770 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:56.006951 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ee857-fbad-4b23-8f45-2965bded3770 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:56.008126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ee857-fbad-4b23-8f45-2965bded3770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:56.009587 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ee857-fbad-4b23-8f45-2965bded3770 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:56.011205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 564/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:56.017663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b27d1d-c935-4bc5-94d1-f1d1a5d85d70 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:56.116633 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b27d1d-c935-4bc5-94d1-f1d1a5d85d70 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:56.118955 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:56.149534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a80eef-d7da-4ab2-9df7-5a9459a452d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:56.150240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a80eef-d7da-4ab2-9df7-5a9459a452d7 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:56.150526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a80eef-d7da-4ab2-9df7-5a9459a452d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:56.150806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a80eef-d7da-4ab2-9df7-5a9459a452d7 None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:56.151513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a80eef-d7da-4ab2-9df7-5a9459a452d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:56.152954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a80eef-d7da-4ab2-9df7-5a9459a452d7 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:56.265535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 570/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:40:56 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:40:58.525461 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fb24b-b5a1-4372-aed7-8e78c5b06b17 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:58.526017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fb24b-b5a1-4372-aed7-8e78c5b06b17 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:58.526017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fb24b-b5a1-4372-aed7-8e78c5b06b17 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:58.527389 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 565/1135] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:40:58.533262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1193a0-7f7f-405d-b472-5ad2c152bfc3 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:58.533721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1193a0-7f7f-405d-b472-5ad2c152bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:58.533889 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1193a0-7f7f-405d-b472-5ad2c152bfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:58.550692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-5c1193a0-7f7f-405d-b472-5ad2c152bfc3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:40:58.551876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5c1193a0-7f7f-405d-b472-5ad2c152bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:40:58.622828 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 571/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:40:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:40:58.647196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fb24b-b5a1-4372-aed7-8e78c5b06b17 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:58.688756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:58.748533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fb24b-b5a1-4372-aed7-8e78c5b06b17 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:58.781089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb62e1d-e5db-4a50-a2fa-475d93267662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:58.781900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb62e1d-e5db-4a50-a2fa-475d93267662 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:58.782188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb62e1d-e5db-4a50-a2fa-475d93267662 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:58.782462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb62e1d-e5db-4a50-a2fa-475d93267662 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:58.783623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb62e1d-e5db-4a50-a2fa-475d93267662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:58.785056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb62e1d-e5db-4a50-a2fa-475d93267662 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:58.786695 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 566/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:40:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:40:58.792575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1193a0-7f7f-405d-b472-5ad2c152bfc3 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:40:58.877291 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:40:58.891903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1193a0-7f7f-405d-b472-5ad2c152bfc3 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:40:58.926436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d002e-22ff-48b7-890c-775332434737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:40:58.927107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d002e-22ff-48b7-890c-775332434737 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:40:58.927391 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d002e-22ff-48b7-890c-775332434737 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:40:58.927662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d002e-22ff-48b7-890c-775332434737 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:40:58.928356 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d002e-22ff-48b7-890c-775332434737 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:40:58.929855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d002e-22ff-48b7-890c-775332434737 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:40:59.037769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 572/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:40:58 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:41:01.333082 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfc431-866f-462a-9497-f325d82e2b31 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:01.333719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfc431-866f-462a-9497-f325d82e2b31 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:01.333719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfc431-866f-462a-9497-f325d82e2b31 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:01.335091 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 567/1139] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:41:01.341689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9b1a3-a65b-433a-9046-019c9e311d51 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:01.342258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9b1a3-a65b-433a-9046-019c9e311d51 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:01.342258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9b1a3-a65b-433a-9046-019c9e311d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:01.359937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-c2f9b1a3-a65b-433a-9046-019c9e311d51 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:41:01.361147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c2f9b1a3-a65b-433a-9046-019c9e311d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:41:01.429596 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 573/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:41:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:41:01.453748 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfc431-866f-462a-9497-f325d82e2b31 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:01.555684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfc431-866f-462a-9497-f325d82e2b31 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:01.563385 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:01.593131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a79136-acb8-47e5-8f98-55ea0e4b8a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:01.594012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a79136-acb8-47e5-8f98-55ea0e4b8a8a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:01.594297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a79136-acb8-47e5-8f98-55ea0e4b8a8a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:01.594616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a79136-acb8-47e5-8f98-55ea0e4b8a8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:01.605354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a79136-acb8-47e5-8f98-55ea0e4b8a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-45a79136-acb8-47e5-8f98-55ea0e4b8a8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:41:01.612933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:41:01.614053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:41:01.615012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:41:01.615012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:41:01.615012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:41:01.615012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:41:01.615012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:41:01.615012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:41:01.615012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:41:01.615012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:41:01.615012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:41:01.615012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:41:01.615012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:41:01.615012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:41:01.615012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 568/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:41:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:41:01.620273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9b1a3-a65b-433a-9046-019c9e311d51 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:01.690957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:01.719101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9b1a3-a65b-433a-9046-019c9e311d51 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:01.754648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5056042-adcf-4648-91a8-070a851b8813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:01.755322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056042-adcf-4648-91a8-070a851b8813 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:01.755609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056042-adcf-4648-91a8-070a851b8813 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:01.755944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056042-adcf-4648-91a8-070a851b8813 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:01.756639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5056042-adcf-4648-91a8-070a851b8813 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:41:01.756946 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5056042-adcf-4648-91a8-070a851b8813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:01.758367 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5056042-adcf-4648-91a8-070a851b8813 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:01.767110 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 574/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:41:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:01.772844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a79136-acb8-47e5-8f98-55ea0e4b8a8a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:01.876478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a79136-acb8-47e5-8f98-55ea0e4b8a8a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:01.912715 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77513bf-dbab-4e2d-bb19-6d9004c4d380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:01.913608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77513bf-dbab-4e2d-bb19-6d9004c4d380 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:01.913892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77513bf-dbab-4e2d-bb19-6d9004c4d380 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:01.914176 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77513bf-dbab-4e2d-bb19-6d9004c4d380 None admin] PATH_INFO: `/v3/users/66edc2b58ec3427eabe4f0ca4b4fe9b1` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:01.928880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77513bf-dbab-4e2d-bb19-6d9004c4d380 None admin] RBAC: Authorizing `identity:get_user(user_id=66edc2b58ec3427eabe4f0ca4b4fe9b1)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:01.930499 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77513bf-dbab-4e2d-bb19-6d9004c4d380 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:01.932378 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 569/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:41:01 2022] GET /identity/v3/users/66edc2b58ec3427eabe4f0ca4b4fe9b1 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:01.939314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5056042-adcf-4648-91a8-070a851b8813 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:02.047420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5056042-adcf-4648-91a8-070a851b8813 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:02.080961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ca565-69d0-4219-bf16-9052a72735af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:02.081643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ca565-69d0-4219-bf16-9052a72735af None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:02.082104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ca565-69d0-4219-bf16-9052a72735af None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:02.082257 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ca565-69d0-4219-bf16-9052a72735af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:02.084959 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:02.152228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ca565-69d0-4219-bf16-9052a72735af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:02.154160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ca565-69d0-4219-bf16-9052a72735af None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:02.259858 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 575/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:41:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:41:02.266338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77513bf-dbab-4e2d-bb19-6d9004c4d380 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:02.292263 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:02.371423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77513bf-dbab-4e2d-bb19-6d9004c4d380 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:02.410482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80594f-6a15-48f2-8636-5cc5f02226ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:02.411680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80594f-6a15-48f2-8636-5cc5f02226ba None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:02.411988 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80594f-6a15-48f2-8636-5cc5f02226ba None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:02.412262 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80594f-6a15-48f2-8636-5cc5f02226ba None admin] PATH_INFO: `/v3/projects/1c8b5c72a2314234bfdbfbb2babc867e` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:02.413457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80594f-6a15-48f2-8636-5cc5f02226ba None admin] RBAC: Authorizing `identity:get_project(project_id=1c8b5c72a2314234bfdbfbb2babc867e)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:02.414888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80594f-6a15-48f2-8636-5cc5f02226ba None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:02.416598 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 570/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:41:02 2022] GET /identity/v3/projects/1c8b5c72a2314234bfdbfbb2babc867e => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:02.423355 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ca565-69d0-4219-bf16-9052a72735af None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:02.459142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:02.532795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ca565-69d0-4219-bf16-9052a72735af None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:02.569885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d086d-1ece-430d-a79d-163374beeaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:02.570957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d086d-1ece-430d-a79d-163374beeaa3 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:02.571393 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d086d-1ece-430d-a79d-163374beeaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:02.571684 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d086d-1ece-430d-a79d-163374beeaa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:02.572824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d086d-1ece-430d-a79d-163374beeaa3 None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=1c8b5c72a2314234bfdbfbb2babc867e, user.id=66edc2b58ec3427eabe4f0ca4b4fe9b1) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:41:02.573358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d086d-1ece-430d-a79d-163374beeaa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:02.574974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d086d-1ece-430d-a79d-163374beeaa3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:02.580896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 576/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:41:02 2022] GET /identity/v3/role_assignments?user.id=66edc2b58ec3427eabe4f0ca4b4fe9b1&scope.project.id=1c8b5c72a2314234bfdbfbb2babc867e&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:04.823955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30a2a2-bf7f-47a6-be35-348e0c9d4da2 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:04.824524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30a2a2-bf7f-47a6-be35-348e0c9d4da2 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:04.824524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30a2a2-bf7f-47a6-be35-348e0c9d4da2 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:04.825999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 571/1147] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:41:04.831559 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a6f50-ffa3-4282-8ebd-dfd8530a0476 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:04.832030 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a6f50-ffa3-4282-8ebd-dfd8530a0476 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:04.832131 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a6f50-ffa3-4282-8ebd-dfd8530a0476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:04.848783 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-179a6f50-ffa3-4282-8ebd-dfd8530a0476 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:41:04.850011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-179a6f50-ffa3-4282-8ebd-dfd8530a0476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:41:04.916814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 577/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:41:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:41:04.940149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30a2a2-bf7f-47a6-be35-348e0c9d4da2 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:05.030458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:05.039676 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30a2a2-bf7f-47a6-be35-348e0c9d4da2 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:05.073304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee3caf-cf47-43a2-bb34-cc577db1930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:05.074160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee3caf-cf47-43a2-bb34-cc577db1930d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:05.074413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee3caf-cf47-43a2-bb34-cc577db1930d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:05.074687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee3caf-cf47-43a2-bb34-cc577db1930d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:05.084621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee3caf-cf47-43a2-bb34-cc577db1930d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-8cee3caf-cf47-43a2-bb34-cc577db1930d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:41:05.092800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:41:05.094032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:41:05.095188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:41:05.095188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:41:05.095188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:41:05.095188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:41:05.095188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:41:05.095188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:41:05.095188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:41:05.095188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:41:05.095188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:41:05.095188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:41:05.095188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:41:05.095188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:41:05.095188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 572/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:41:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:41:05.100292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a6f50-ffa3-4282-8ebd-dfd8530a0476 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:05.128019 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:05.204823 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a6f50-ffa3-4282-8ebd-dfd8530a0476 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:05.239492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb34ac-946a-4bf1-9f52-7bde9287f882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:05.240158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb34ac-946a-4bf1-9f52-7bde9287f882 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:05.240444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb34ac-946a-4bf1-9f52-7bde9287f882 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:05.240721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb34ac-946a-4bf1-9f52-7bde9287f882 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:05.241490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb34ac-946a-4bf1-9f52-7bde9287f882 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:41:05.241801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb34ac-946a-4bf1-9f52-7bde9287f882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:05.243188 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb34ac-946a-4bf1-9f52-7bde9287f882 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:05.251248 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 578/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:41:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:05.257185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee3caf-cf47-43a2-bb34-cc577db1930d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:05.364620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee3caf-cf47-43a2-bb34-cc577db1930d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:05.399485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe46d0-643f-4438-943c-05a9e2cd6c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:05.400354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe46d0-643f-4438-943c-05a9e2cd6c9b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:05.400638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe46d0-643f-4438-943c-05a9e2cd6c9b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:05.400916 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe46d0-643f-4438-943c-05a9e2cd6c9b None admin] PATH_INFO: `/v3/users/66edc2b58ec3427eabe4f0ca4b4fe9b1` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:05.402108 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe46d0-643f-4438-943c-05a9e2cd6c9b None admin] RBAC: Authorizing `identity:get_user(user_id=66edc2b58ec3427eabe4f0ca4b4fe9b1)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:05.404222 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe46d0-643f-4438-943c-05a9e2cd6c9b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:05.405901 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 573/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:41:05 2022] GET /identity/v3/users/66edc2b58ec3427eabe4f0ca4b4fe9b1 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:05.411732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb34ac-946a-4bf1-9f52-7bde9287f882 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:05.504490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:05.515014 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb34ac-946a-4bf1-9f52-7bde9287f882 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:05.552051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd781f10-1739-4bfd-81e7-ea0ba0844a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:05.552939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd781f10-1739-4bfd-81e7-ea0ba0844a61 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:05.553228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd781f10-1739-4bfd-81e7-ea0ba0844a61 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:05.553541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd781f10-1739-4bfd-81e7-ea0ba0844a61 None admin] PATH_INFO: `/v3/projects/1c8b5c72a2314234bfdbfbb2babc867e` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:05.554844 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd781f10-1739-4bfd-81e7-ea0ba0844a61 None admin] RBAC: Authorizing `identity:get_project(project_id=1c8b5c72a2314234bfdbfbb2babc867e)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:05.556344 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd781f10-1739-4bfd-81e7-ea0ba0844a61 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:05.558195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 579/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:41:05 2022] GET /identity/v3/projects/1c8b5c72a2314234bfdbfbb2babc867e => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:05.565312 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe46d0-643f-4438-943c-05a9e2cd6c9b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:05.588114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:05.663068 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe46d0-643f-4438-943c-05a9e2cd6c9b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:05.696004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9f20f-8065-4197-8404-35ef7b26b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:05.696867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9f20f-8065-4197-8404-35ef7b26b6fe None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:05.697140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9f20f-8065-4197-8404-35ef7b26b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:05.697433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9f20f-8065-4197-8404-35ef7b26b6fe None admin] PATH_INFO: `/v3/projects/1c8b5c72a2314234bfdbfbb2babc867e/users/66edc2b58ec3427eabe4f0ca4b4fe9b1/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:05.699404 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9f20f-8065-4197-8404-35ef7b26b6fe None admin] RBAC: Authorizing `identity:create_grant(project_id=1c8b5c72a2314234bfdbfbb2babc867e, user_id=66edc2b58ec3427eabe4f0ca4b4fe9b1, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:05.700817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9f20f-8065-4197-8404-35ef7b26b6fe None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:05.785388 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 574/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:41:05 2022] PUT /identity/v3/projects/1c8b5c72a2314234bfdbfbb2babc867e/users/66edc2b58ec3427eabe4f0ca4b4fe9b1/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:41:08.035595 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f71d9-6958-4af8-bc67-16e2aa6dce19 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:08.036129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f71d9-6958-4af8-bc67-16e2aa6dce19 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:08.036129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f71d9-6958-4af8-bc67-16e2aa6dce19 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:08.037561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 580/1154] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:41:08.043356 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eaa70-9cfd-4688-85ee-aa620ef2fa02 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:08.043830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eaa70-9cfd-4688-85ee-aa620ef2fa02 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:08.043932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eaa70-9cfd-4688-85ee-aa620ef2fa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:08.060596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-bc0eaa70-9cfd-4688-85ee-aa620ef2fa02 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:41:08.062090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-bc0eaa70-9cfd-4688-85ee-aa620ef2fa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:41:08.129674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 575/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:41:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:41:08.153944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f71d9-6958-4af8-bc67-16e2aa6dce19 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:08.256972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f71d9-6958-4af8-bc67-16e2aa6dce19 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:08.291701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52f2e5-65e8-45c7-baf4-6cbc0d9ef61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:08.292414 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52f2e5-65e8-45c7-baf4-6cbc0d9ef61f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:08.292699 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52f2e5-65e8-45c7-baf4-6cbc0d9ef61f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:08.292973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52f2e5-65e8-45c7-baf4-6cbc0d9ef61f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:08.303703 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52f2e5-65e8-45c7-baf4-6cbc0d9ef61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-8f52f2e5-65e8-45c7-baf4-6cbc0d9ef61f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:41:08.311521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:41:08.312672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:41:08.313642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:41:08.313642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:41:08.313642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:41:08.313642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:41:08.313642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:41:08.313642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:41:08.313642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:41:08.313642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:41:08.313642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:41:08.313642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:41:08.313642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:41:08.313642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:41:08.313642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 581/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:41:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:41:08.319048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eaa70-9cfd-4688-85ee-aa620ef2fa02 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:08.331129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:08.417393 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eaa70-9cfd-4688-85ee-aa620ef2fa02 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:08.454499 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f338dcb-2486-4b17-b965-1a43a90ab82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:08.455160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f338dcb-2486-4b17-b965-1a43a90ab82a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:08.455438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f338dcb-2486-4b17-b965-1a43a90ab82a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:08.455711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f338dcb-2486-4b17-b965-1a43a90ab82a None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:08.456447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f338dcb-2486-4b17-b965-1a43a90ab82a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:41:08.456751 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f338dcb-2486-4b17-b965-1a43a90ab82a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:08.458152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f338dcb-2486-4b17-b965-1a43a90ab82a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:08.466415 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 576/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:41:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:08.472382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52f2e5-65e8-45c7-baf4-6cbc0d9ef61f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:08.491590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:08.574581 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52f2e5-65e8-45c7-baf4-6cbc0d9ef61f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:08.608466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781a32c-0f13-4732-8444-d1d8c2bbd2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:08.609349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781a32c-0f13-4732-8444-d1d8c2bbd2f9 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:08.609668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781a32c-0f13-4732-8444-d1d8c2bbd2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:08.609947 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781a32c-0f13-4732-8444-d1d8c2bbd2f9 None admin] PATH_INFO: `/v3/users/66edc2b58ec3427eabe4f0ca4b4fe9b1` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:08.611136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781a32c-0f13-4732-8444-d1d8c2bbd2f9 None admin] RBAC: Authorizing `identity:get_user(user_id=66edc2b58ec3427eabe4f0ca4b4fe9b1)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:08.612579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781a32c-0f13-4732-8444-d1d8c2bbd2f9 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:08.614248 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 582/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:41:08 2022] GET /identity/v3/users/66edc2b58ec3427eabe4f0ca4b4fe9b1 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:41:08.620148 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f338dcb-2486-4b17-b965-1a43a90ab82a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:08.688945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:08.718336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f338dcb-2486-4b17-b965-1a43a90ab82a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:08.754980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff602-cc26-4056-96fd-0f2eaae3c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:08.755615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff602-cc26-4056-96fd-0f2eaae3c101 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:08.755893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff602-cc26-4056-96fd-0f2eaae3c101 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:08.756163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff602-cc26-4056-96fd-0f2eaae3c101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:08.821020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ff602-cc26-4056-96fd-0f2eaae3c101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:08.822485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ff602-cc26-4056-96fd-0f2eaae3c101 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:08.888213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:08.917748 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 577/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:41:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:41:08.924204 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781a32c-0f13-4732-8444-d1d8c2bbd2f9 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:09.008254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:09.023104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781a32c-0f13-4732-8444-d1d8c2bbd2f9 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:09.056391 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6825a-6b23-44d4-b9ef-e7d721ac42c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:09.057233 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6825a-6b23-44d4-b9ef-e7d721ac42c8 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:09.057545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6825a-6b23-44d4-b9ef-e7d721ac42c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:09.057819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6825a-6b23-44d4-b9ef-e7d721ac42c8 None admin] PATH_INFO: `/v3/projects/1c8b5c72a2314234bfdbfbb2babc867e` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:09.059015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6825a-6b23-44d4-b9ef-e7d721ac42c8 None admin] RBAC: Authorizing `identity:get_project(project_id=1c8b5c72a2314234bfdbfbb2babc867e)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:09.060450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6825a-6b23-44d4-b9ef-e7d721ac42c8 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:09.062424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 583/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:41:08 2022] GET /identity/v3/projects/1c8b5c72a2314234bfdbfbb2babc867e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:09.068536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff602-cc26-4056-96fd-0f2eaae3c101 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:09.167950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff602-cc26-4056-96fd-0f2eaae3c101 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:09.201509 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cbaf7-ca9e-4cee-a407-fba96c3edc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:09.202152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cbaf7-ca9e-4cee-a407-fba96c3edc7a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:09.202435 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cbaf7-ca9e-4cee-a407-fba96c3edc7a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:09.202707 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cbaf7-ca9e-4cee-a407-fba96c3edc7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:09.203525 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cbaf7-ca9e-4cee-a407-fba96c3edc7a None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=1c8b5c72a2314234bfdbfbb2babc867e, user.id=66edc2b58ec3427eabe4f0ca4b4fe9b1) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:41:09.203834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cbaf7-ca9e-4cee-a407-fba96c3edc7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:09.205260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cbaf7-ca9e-4cee-a407-fba96c3edc7a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:09.211169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 578/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:41:09 2022] GET /identity/v3/role_assignments?user.id=66edc2b58ec3427eabe4f0ca4b4fe9b1&scope.project.id=1c8b5c72a2314234bfdbfbb2babc867e&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:11.482355 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7197b2-fd6f-46ea-83a2-e91e99f1ac7b None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:11.482878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7197b2-fd6f-46ea-83a2-e91e99f1ac7b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:11.482997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7197b2-fd6f-46ea-83a2-e91e99f1ac7b None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:11.484310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 584/1162] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:41:11.490144 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40894dea-a572-46bd-9fe9-c474fc10e9b1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:11.490656 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40894dea-a572-46bd-9fe9-c474fc10e9b1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:11.490772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40894dea-a572-46bd-9fe9-c474fc10e9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:11.508423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-40894dea-a572-46bd-9fe9-c474fc10e9b1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:41:11.509652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-40894dea-a572-46bd-9fe9-c474fc10e9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:41:11.537615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:11.575387 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 579/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:41:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:41:11.597815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7197b2-fd6f-46ea-83a2-e91e99f1ac7b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:11.697065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7197b2-fd6f-46ea-83a2-e91e99f1ac7b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:11.731148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ce68f-ed80-44c7-8860-f2fecb2da1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:11.731793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ce68f-ed80-44c7-8860-f2fecb2da1f7 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:11.732078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ce68f-ed80-44c7-8860-f2fecb2da1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:11.732354 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ce68f-ed80-44c7-8860-f2fecb2da1f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:11.755571 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:11.798560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ce68f-ed80-44c7-8860-f2fecb2da1f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:11.800018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ce68f-ed80-44c7-8860-f2fecb2da1f7 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:11.896292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 585/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:41:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:41:11.902397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40894dea-a572-46bd-9fe9-c474fc10e9b1 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:12.001428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40894dea-a572-46bd-9fe9-c474fc10e9b1 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:12.034243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe487469-677b-429a-9e60-e55fcc91d5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:12.035037 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe487469-677b-429a-9e60-e55fcc91d5f9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:12.035316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe487469-677b-429a-9e60-e55fcc91d5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:12.035590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe487469-677b-429a-9e60-e55fcc91d5f9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:12.042665 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe487469-677b-429a-9e60-e55fcc91d5f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:12.044124 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe487469-677b-429a-9e60-e55fcc91d5f9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-fe487469-677b-429a-9e60-e55fcc91d5f9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:41:12.058532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:41:12.059766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:41:12.061146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 580/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Tue May 31 20:41:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:41:12.066121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ce68f-ed80-44c7-8860-f2fecb2da1f7 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:12.119271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:12.169800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ce68f-ed80-44c7-8860-f2fecb2da1f7 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:12.209473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadef2b7-0f74-43ba-a10a-a9880822ffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:12.210170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef2b7-0f74-43ba-a10a-a9880822ffe8 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:12.210450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef2b7-0f74-43ba-a10a-a9880822ffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:12.210723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef2b7-0f74-43ba-a10a-a9880822ffe8 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:12.211471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadef2b7-0f74-43ba-a10a-a9880822ffe8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:41:12.211782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadef2b7-0f74-43ba-a10a-a9880822ffe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:12.213256 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadef2b7-0f74-43ba-a10a-a9880822ffe8 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:12.222370 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 586/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Tue May 31 20:41:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:14.460141 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b51ca-b06d-482b-8337-f0b2e6a35242 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:14.460686 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b51ca-b06d-482b-8337-f0b2e6a35242 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:14.460686 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b51ca-b06d-482b-8337-f0b2e6a35242 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:14.462079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 581/1167] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:41:14.467853 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332aac9-e53a-42f7-8a35-553233856564 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:14.468335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332aac9-e53a-42f7-8a35-553233856564 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:14.468446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332aac9-e53a-42f7-8a35-553233856564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:14.484993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-e332aac9-e53a-42f7-8a35-553233856564 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:41:14.486214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e332aac9-e53a-42f7-8a35-553233856564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:41:14.551777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 587/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:41:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:41:14.575593 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b51ca-b06d-482b-8337-f0b2e6a35242 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:14.604104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:14.680387 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b51ca-b06d-482b-8337-f0b2e6a35242 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:14.714447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a3f20-7689-4f5e-824a-a2a90b160eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:14.715104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a3f20-7689-4f5e-824a-a2a90b160eb3 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:14.715388 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a3f20-7689-4f5e-824a-a2a90b160eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:14.715669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a3f20-7689-4f5e-824a-a2a90b160eb3 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:14.716411 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a3f20-7689-4f5e-824a-a2a90b160eb3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:14.717820 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a3f20-7689-4f5e-824a-a2a90b160eb3 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:14.780079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 582/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Tue May 31 20:41:14 2022] POST /identity/v3/domains => generated 267 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:41:17.042290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f5a02-128d-4c4c-a9f8-f32be55c3bc9 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:17.042866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f5a02-128d-4c4c-a9f8-f32be55c3bc9 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:17.042866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f5a02-128d-4c4c-a9f8-f32be55c3bc9 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:17.044246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 588/1170] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:41:17.049553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6191e9-8914-4ef0-b171-15faa97717d1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:17.049977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6191e9-8914-4ef0-b171-15faa97717d1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:17.050107 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6191e9-8914-4ef0-b171-15faa97717d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:17.066838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2c6191e9-8914-4ef0-b171-15faa97717d1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:41:17.067997 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2c6191e9-8914-4ef0-b171-15faa97717d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:41:17.132084 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 583/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:41:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:41:17.156041 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f5a02-128d-4c4c-a9f8-f32be55c3bc9 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:17.205236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:17.255764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f5a02-128d-4c4c-a9f8-f32be55c3bc9 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:17.288967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c25f4-ee93-4e63-9e6d-1197f8926783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:17.289851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c25f4-ee93-4e63-9e6d-1197f8926783 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:17.290127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c25f4-ee93-4e63-9e6d-1197f8926783 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:17.290399 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c25f4-ee93-4e63-9e6d-1197f8926783 None admin] PATH_INFO: `/v3/domains/8e90db6d6a7d43a4a204c76246ec06ae` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:17.300508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c25f4-ee93-4e63-9e6d-1197f8926783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8e90db6d6a7d43a4a204c76246ec06ae)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:17.301937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c25f4-ee93-4e63-9e6d-1197f8926783 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:17.303817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 589/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Tue May 31 20:41:17 2022] GET /identity/v3/domains/8e90db6d6a7d43a4a204c76246ec06ae => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:17.309465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6191e9-8914-4ef0-b171-15faa97717d1 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:17.327720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:17.419646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6191e9-8914-4ef0-b171-15faa97717d1 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:17.452741 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77105f6c-2bea-467d-82f1-2288868bb177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:17.453407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77105f6c-2bea-467d-82f1-2288868bb177 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:17.453692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77105f6c-2bea-467d-82f1-2288868bb177 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:17.453965 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77105f6c-2bea-467d-82f1-2288868bb177 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:17.454671 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77105f6c-2bea-467d-82f1-2288868bb177 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:17.456082 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77105f6c-2bea-467d-82f1-2288868bb177 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:17.587039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 584/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:41:17 2022] POST /identity/v3/projects => generated 361 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:41:19.847250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fcbaa-3828-439a-b425-81809b766112 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:19.847785 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fcbaa-3828-439a-b425-81809b766112 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:19.847785 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fcbaa-3828-439a-b425-81809b766112 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:19.849179 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 590/1174] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:41:19.854881 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e060ce7-3014-46a7-8a51-6e74c5c3b06d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:19.855278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e060ce7-3014-46a7-8a51-6e74c5c3b06d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:19.855435 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e060ce7-3014-46a7-8a51-6e74c5c3b06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:19.872590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-5e060ce7-3014-46a7-8a51-6e74c5c3b06d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:41:19.873782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5e060ce7-3014-46a7-8a51-6e74c5c3b06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:41:19.932633 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:19.938191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 585/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:41:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:41:19.962682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fcbaa-3828-439a-b425-81809b766112 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:20.065395 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fcbaa-3828-439a-b425-81809b766112 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:20.073870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:20.098217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96627afb-b3ee-4837-9981-1bc99aafbb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:20.099005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96627afb-b3ee-4837-9981-1bc99aafbb70 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:20.099284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96627afb-b3ee-4837-9981-1bc99aafbb70 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:20.099557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96627afb-b3ee-4837-9981-1bc99aafbb70 None admin] PATH_INFO: `/v3/domains/8e90db6d6a7d43a4a204c76246ec06ae` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:20.100702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96627afb-b3ee-4837-9981-1bc99aafbb70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8e90db6d6a7d43a4a204c76246ec06ae)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:20.102305 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96627afb-b3ee-4837-9981-1bc99aafbb70 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:20.104841 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 591/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Tue May 31 20:41:19 2022] GET /identity/v3/domains/8e90db6d6a7d43a4a204c76246ec06ae => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:20.110457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e060ce7-3014-46a7-8a51-6e74c5c3b06d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:20.206291 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e060ce7-3014-46a7-8a51-6e74c5c3b06d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:20.240825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becaa06-0e69-45a4-8af7-5ac9e7ef5a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:20.241509 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becaa06-0e69-45a4-8af7-5ac9e7ef5a7d None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:20.241821 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becaa06-0e69-45a4-8af7-5ac9e7ef5a7d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:20.242093 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becaa06-0e69-45a4-8af7-5ac9e7ef5a7d None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:20.242795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becaa06-0e69-45a4-8af7-5ac9e7ef5a7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:20.244230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becaa06-0e69-45a4-8af7-5ac9e7ef5a7d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:20.358012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 586/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:41:20 2022] POST /identity/v3/users => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:41:22.622726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a6701-1ea9-44a8-966f-2377406309ff None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:22.623225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a6701-1ea9-44a8-966f-2377406309ff None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:22.623225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a6701-1ea9-44a8-966f-2377406309ff None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:22.624572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 592/1178] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:41:22.629876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d2d0a-b2fd-4223-84ec-73306aacc615 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:22.630316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d2d0a-b2fd-4223-84ec-73306aacc615 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:22.630451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d2d0a-b2fd-4223-84ec-73306aacc615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:22.772887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-511d2d0a-b2fd-4223-84ec-73306aacc615 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:41:22.774118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-511d2d0a-b2fd-4223-84ec-73306aacc615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:41:22.823249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:22.839853 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 587/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:41:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:41:22.864074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a6701-1ea9-44a8-966f-2377406309ff None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:22.965550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a6701-1ea9-44a8-966f-2377406309ff None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:22.998321 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046af99a-90b6-400b-97bc-d5beeb0096eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:22.999097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046af99a-90b6-400b-97bc-d5beeb0096eb None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:22.999383 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046af99a-90b6-400b-97bc-d5beeb0096eb None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:22.999660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046af99a-90b6-400b-97bc-d5beeb0096eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:23.010637 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046af99a-90b6-400b-97bc-d5beeb0096eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-046af99a-90b6-400b-97bc-d5beeb0096eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:41:23.018209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:41:23.019381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:41:23.020271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:41:23.020271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:41:23.020271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:41:23.020271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:41:23.020271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:41:23.020271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:41:23.020271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:41:23.020271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:41:23.020271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:41:23.020271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:41:23.020271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:41:23.020271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:41:23.020271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 593/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:41:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:41:23.025876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d2d0a-b2fd-4223-84ec-73306aacc615 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:23.121308 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d2d0a-b2fd-4223-84ec-73306aacc615 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:23.154064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b67da-1a8d-41c4-9a56-44f01fce1f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:23.154719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b67da-1a8d-41c4-9a56-44f01fce1f0e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:23.154999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b67da-1a8d-41c4-9a56-44f01fce1f0e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:23.155268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b67da-1a8d-41c4-9a56-44f01fce1f0e None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:23.156000 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b67da-1a8d-41c4-9a56-44f01fce1f0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:41:23.156303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b67da-1a8d-41c4-9a56-44f01fce1f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:23.157686 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b67da-1a8d-41c4-9a56-44f01fce1f0e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:23.165565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 588/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:41:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:23.171936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046af99a-90b6-400b-97bc-d5beeb0096eb None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:23.205620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:23.270071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046af99a-90b6-400b-97bc-d5beeb0096eb None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:23.305164 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d72d9-9efa-47b3-a12d-5b615fa4d3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:23.305997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d72d9-9efa-47b3-a12d-5b615fa4d3e7 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:23.306275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d72d9-9efa-47b3-a12d-5b615fa4d3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:23.306543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d72d9-9efa-47b3-a12d-5b615fa4d3e7 None admin] PATH_INFO: `/v3/users/604fdb915ba34815a5db0ca079d84fc6` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:23.319994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d72d9-9efa-47b3-a12d-5b615fa4d3e7 None admin] RBAC: Authorizing `identity:get_user(user_id=604fdb915ba34815a5db0ca079d84fc6)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:23.321472 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d72d9-9efa-47b3-a12d-5b615fa4d3e7 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:23.323641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 594/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:41:23 2022] GET /identity/v3/users/604fdb915ba34815a5db0ca079d84fc6 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:23.329286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b67da-1a8d-41c4-9a56-44f01fce1f0e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:23.383546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:23.437236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b67da-1a8d-41c4-9a56-44f01fce1f0e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:23.470920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc70861-4f77-4265-8450-c72581fb953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:23.471562 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70861-4f77-4265-8450-c72581fb953f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:23.471841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70861-4f77-4265-8450-c72581fb953f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:23.472114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70861-4f77-4265-8450-c72581fb953f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:23.537315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc70861-4f77-4265-8450-c72581fb953f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:23.538718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc70861-4f77-4265-8450-c72581fb953f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:23.582827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:23.634415 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 589/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:41:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:41:23.640817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d72d9-9efa-47b3-a12d-5b615fa4d3e7 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:23.732792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:23.739192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d72d9-9efa-47b3-a12d-5b615fa4d3e7 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:23.772459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4dbfa-0d4a-40a6-9528-0ed4d7fa9e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:23.773437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4dbfa-0d4a-40a6-9528-0ed4d7fa9e4e None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:23.773726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4dbfa-0d4a-40a6-9528-0ed4d7fa9e4e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:23.774003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4dbfa-0d4a-40a6-9528-0ed4d7fa9e4e None admin] PATH_INFO: `/v3/projects/de18252eb5ab43059d8176edb67efdef` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:23.775704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4dbfa-0d4a-40a6-9528-0ed4d7fa9e4e None admin] RBAC: Authorizing `identity:get_project(project_id=de18252eb5ab43059d8176edb67efdef)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:23.777127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4dbfa-0d4a-40a6-9528-0ed4d7fa9e4e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:23.778872 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 595/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:41:23 2022] GET /identity/v3/projects/de18252eb5ab43059d8176edb67efdef => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:23.785126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc70861-4f77-4265-8450-c72581fb953f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:23.882367 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc70861-4f77-4265-8450-c72581fb953f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:23.914838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927aa504-1b3a-462f-996e-63c8e39ad477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:23.915502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aa504-1b3a-462f-996e-63c8e39ad477 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:23.916339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aa504-1b3a-462f-996e-63c8e39ad477 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:23.916605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aa504-1b3a-462f-996e-63c8e39ad477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:23.917430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927aa504-1b3a-462f-996e-63c8e39ad477 None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=de18252eb5ab43059d8176edb67efdef, user.id=604fdb915ba34815a5db0ca079d84fc6) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:41:23.917735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927aa504-1b3a-462f-996e-63c8e39ad477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:23.919256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927aa504-1b3a-462f-996e-63c8e39ad477 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:23.924543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 590/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:41:23 2022] GET /identity/v3/role_assignments?user.id=604fdb915ba34815a5db0ca079d84fc6&scope.project.id=de18252eb5ab43059d8176edb67efdef&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:41:26.146587 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2db6b-5a3a-4eff-a803-6a52b08e43b6 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:26.147117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2db6b-5a3a-4eff-a803-6a52b08e43b6 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:26.147117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2db6b-5a3a-4eff-a803-6a52b08e43b6 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:26.148498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 596/1186] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:41:26.153757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fea4e-c4ef-4a5d-9578-3482877dde98 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:26.154184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fea4e-c4ef-4a5d-9578-3482877dde98 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:26.154303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fea4e-c4ef-4a5d-9578-3482877dde98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:26.170682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d04fea4e-c4ef-4a5d-9578-3482877dde98 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:41:26.171847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d04fea4e-c4ef-4a5d-9578-3482877dde98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:41:26.174725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:26.239692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 591/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:41:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:41:26.262476 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2db6b-5a3a-4eff-a803-6a52b08e43b6 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:26.361281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2db6b-5a3a-4eff-a803-6a52b08e43b6 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:26.393707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58b014-7f9c-4958-b2d7-43351a801ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:26.394479 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58b014-7f9c-4958-b2d7-43351a801ba2 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:26.394762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58b014-7f9c-4958-b2d7-43351a801ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:26.395037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58b014-7f9c-4958-b2d7-43351a801ba2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:26.404818 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58b014-7f9c-4958-b2d7-43351a801ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-ad58b014-7f9c-4958-b2d7-43351a801ba2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:41:26.412239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:41:26.413342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:41:26.414445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:41:26.414445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:41:26.414445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:41:26.414445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:41:26.414445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:41:26.414445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:41:26.414445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:41:26.414445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:41:26.414445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:41:26.414445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:41:26.414445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:41:26.414445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:41:26.414445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 597/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:41:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:41:26.419908 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fea4e-c4ef-4a5d-9578-3482877dde98 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:26.515254 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fea4e-c4ef-4a5d-9578-3482877dde98 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:26.547540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3b00f-3fd3-4230-a69d-9a241c2c6ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:26.548186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3b00f-3fd3-4230-a69d-9a241c2c6ad4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:26.548467 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3b00f-3fd3-4230-a69d-9a241c2c6ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:26.548742 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3b00f-3fd3-4230-a69d-9a241c2c6ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:26.549502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3b00f-3fd3-4230-a69d-9a241c2c6ad4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:41:26.549808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3b00f-3fd3-4230-a69d-9a241c2c6ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:26.551165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3b00f-3fd3-4230-a69d-9a241c2c6ad4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:26.559808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 592/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:41:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:26.565649 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58b014-7f9c-4958-b2d7-43351a801ba2 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:26.590227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:26.663726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58b014-7f9c-4958-b2d7-43351a801ba2 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:26.696458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f54a96-cf08-44d3-aa54-0f238868a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:26.697361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f54a96-cf08-44d3-aa54-0f238868a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:26.697678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f54a96-cf08-44d3-aa54-0f238868a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:26.697955 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f54a96-cf08-44d3-aa54-0f238868a8e3 None admin] PATH_INFO: `/v3/users/604fdb915ba34815a5db0ca079d84fc6` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:26.699129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f54a96-cf08-44d3-aa54-0f238868a8e3 None admin] RBAC: Authorizing `identity:get_user(user_id=604fdb915ba34815a5db0ca079d84fc6)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:26.700555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f54a96-cf08-44d3-aa54-0f238868a8e3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:26.702189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 598/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:41:26 2022] GET /identity/v3/users/604fdb915ba34815a5db0ca079d84fc6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:26.708131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3b00f-3fd3-4230-a69d-9a241c2c6ad4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:26.711108 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:26.808053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3b00f-3fd3-4230-a69d-9a241c2c6ad4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:26.840802 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c51fc-a4b3-4a4d-9dab-eb860527cb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:26.841674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c51fc-a4b3-4a4d-9dab-eb860527cb1d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:26.841956 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c51fc-a4b3-4a4d-9dab-eb860527cb1d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:26.842230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c51fc-a4b3-4a4d-9dab-eb860527cb1d None admin] PATH_INFO: `/v3/projects/de18252eb5ab43059d8176edb67efdef` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:26.843392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c51fc-a4b3-4a4d-9dab-eb860527cb1d None admin] RBAC: Authorizing `identity:get_project(project_id=de18252eb5ab43059d8176edb67efdef)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:26.844815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c51fc-a4b3-4a4d-9dab-eb860527cb1d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:26.846520 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 593/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:41:26 2022] GET /identity/v3/projects/de18252eb5ab43059d8176edb67efdef => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:26.852666 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f54a96-cf08-44d3-aa54-0f238868a8e3 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:26.942752 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:26.952540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f54a96-cf08-44d3-aa54-0f238868a8e3 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:26.985027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616ee33-4d2a-4792-a036-15cf3b717d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:26.985926 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ee33-4d2a-4792-a036-15cf3b717d19 None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:26.986210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ee33-4d2a-4792-a036-15cf3b717d19 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:26.986485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ee33-4d2a-4792-a036-15cf3b717d19 None admin] PATH_INFO: `/v3/projects/de18252eb5ab43059d8176edb67efdef/users/604fdb915ba34815a5db0ca079d84fc6/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:26.988412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616ee33-4d2a-4792-a036-15cf3b717d19 None admin] RBAC: Authorizing `identity:create_grant(project_id=de18252eb5ab43059d8176edb67efdef, user_id=604fdb915ba34815a5db0ca079d84fc6, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:26.989864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616ee33-4d2a-4792-a036-15cf3b717d19 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:27.064747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 599/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:41:26 2022] PUT /identity/v3/projects/de18252eb5ab43059d8176edb67efdef/users/604fdb915ba34815a5db0ca079d84fc6/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:41:29.293629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6463-52fa-4cd5-9573-c789a0475e9e None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:29.294167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6463-52fa-4cd5-9573-c789a0475e9e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:29.294167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6463-52fa-4cd5-9573-c789a0475e9e None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:29.295524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 594/1193] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:41:29.300941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837f07-a6f8-4725-9e38-ac4ca22f1ae5 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:29.301329 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837f07-a6f8-4725-9e38-ac4ca22f1ae5 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:29.301530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837f07-a6f8-4725-9e38-ac4ca22f1ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:29.319324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b7837f07-a6f8-4725-9e38-ac4ca22f1ae5 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:41:29.320481 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b7837f07-a6f8-4725-9e38-ac4ca22f1ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:41:29.386190 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 600/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:41:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:41:29.410370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f6463-52fa-4cd5-9573-c789a0475e9e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:29.479792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:29.510702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f6463-52fa-4cd5-9573-c789a0475e9e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:29.543700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7ca7c-1ad0-49cd-8e4d-8dbaace0fa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:29.544411 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7ca7c-1ad0-49cd-8e4d-8dbaace0fa38 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:29.544694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7ca7c-1ad0-49cd-8e4d-8dbaace0fa38 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:29.544970 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7ca7c-1ad0-49cd-8e4d-8dbaace0fa38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:29.555881 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7ca7c-1ad0-49cd-8e4d-8dbaace0fa38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-cdc7ca7c-1ad0-49cd-8e4d-8dbaace0fa38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:41:29.563581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:41:29.564669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:41:29.565913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:41:29.565913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:41:29.565913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:41:29.565913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:41:29.565913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:41:29.565913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:41:29.565913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:41:29.565913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:41:29.565913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:41:29.565913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:41:29.565913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:41:29.565913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:41:29.565913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 595/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:41:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:41:29.570858 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837f07-a6f8-4725-9e38-ac4ca22f1ae5 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:29.647858 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:29.665774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837f07-a6f8-4725-9e38-ac4ca22f1ae5 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:29.699286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35681fa7-ac83-4db4-bfe5-3f7a6d789aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:29.699939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35681fa7-ac83-4db4-bfe5-3f7a6d789aaa None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:29.700221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35681fa7-ac83-4db4-bfe5-3f7a6d789aaa None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:29.700493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35681fa7-ac83-4db4-bfe5-3f7a6d789aaa None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:29.701224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35681fa7-ac83-4db4-bfe5-3f7a6d789aaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:41:29.701565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35681fa7-ac83-4db4-bfe5-3f7a6d789aaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:29.702943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35681fa7-ac83-4db4-bfe5-3f7a6d789aaa None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:29.710752 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 601/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:41:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:29.716559 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7ca7c-1ad0-49cd-8e4d-8dbaace0fa38 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:29.814448 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7ca7c-1ad0-49cd-8e4d-8dbaace0fa38 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:29.842114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:29.847763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24e1cd-e30c-4099-aad5-fb62ab2c938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:29.848618 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24e1cd-e30c-4099-aad5-fb62ab2c938e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:29.848900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24e1cd-e30c-4099-aad5-fb62ab2c938e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:29.849178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24e1cd-e30c-4099-aad5-fb62ab2c938e None admin] PATH_INFO: `/v3/users/604fdb915ba34815a5db0ca079d84fc6` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:29.850383 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24e1cd-e30c-4099-aad5-fb62ab2c938e None admin] RBAC: Authorizing `identity:get_user(user_id=604fdb915ba34815a5db0ca079d84fc6)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:29.851813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24e1cd-e30c-4099-aad5-fb62ab2c938e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:29.853457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 596/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Tue May 31 20:41:29 2022] GET /identity/v3/users/604fdb915ba34815a5db0ca079d84fc6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:29.859678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35681fa7-ac83-4db4-bfe5-3f7a6d789aaa None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:29.958792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35681fa7-ac83-4db4-bfe5-3f7a6d789aaa None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:29.992563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5c55-c821-4632-bba1-17535ca80551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:29.993246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5c55-c821-4632-bba1-17535ca80551 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:29.993566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5c55-c821-4632-bba1-17535ca80551 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:29.994409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5c55-c821-4632-bba1-17535ca80551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:30.006750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:30.062695 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe5c55-c821-4632-bba1-17535ca80551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:30.064168 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe5c55-c821-4632-bba1-17535ca80551 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:30.162676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 602/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:41:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:41:30.169041 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24e1cd-e30c-4099-aad5-fb62ab2c938e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:30.268170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24e1cd-e30c-4099-aad5-fb62ab2c938e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:30.300184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb8b87-c74c-4c12-9bdf-68f2f5966d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:30.301025 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8b87-c74c-4c12-9bdf-68f2f5966d82 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:30.301300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8b87-c74c-4c12-9bdf-68f2f5966d82 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:30.301591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8b87-c74c-4c12-9bdf-68f2f5966d82 None admin] PATH_INFO: `/v3/projects/de18252eb5ab43059d8176edb67efdef` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:30.303230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb8b87-c74c-4c12-9bdf-68f2f5966d82 None admin] RBAC: Authorizing `identity:get_project(project_id=de18252eb5ab43059d8176edb67efdef)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:30.304649 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb8b87-c74c-4c12-9bdf-68f2f5966d82 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:30.306995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 597/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Tue May 31 20:41:30 2022] GET /identity/v3/projects/de18252eb5ab43059d8176edb67efdef => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:30.313297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5c55-c821-4632-bba1-17535ca80551 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:41:30.355881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:30.410366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5c55-c821-4632-bba1-17535ca80551 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:41:30.443481 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4f140-ffee-4c38-9a6e-ca1cffa43473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:41:30.444069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4f140-ffee-4c38-9a6e-ca1cffa43473 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:41:30.444353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4f140-ffee-4c38-9a6e-ca1cffa43473 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:41:30.444633 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4f140-ffee-4c38-9a6e-ca1cffa43473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:41:30.445492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4f140-ffee-4c38-9a6e-ca1cffa43473 None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=de18252eb5ab43059d8176edb67efdef, user.id=604fdb915ba34815a5db0ca079d84fc6) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:41:30.445833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4f140-ffee-4c38-9a6e-ca1cffa43473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:41:30.447308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4f140-ffee-4c38-9a6e-ca1cffa43473 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:41:30.453095 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 603/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:41:30 2022] GET /identity/v3/role_assignments?user.id=604fdb915ba34815a5db0ca079d84fc6&scope.project.id=de18252eb5ab43059d8176edb67efdef&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:41:40.296169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=67 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:41:40.450412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=47 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:51.075516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ac49e-db45-4447-ade2-a85c012183d9 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:51.076155 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ac49e-db45-4447-ade2-a85c012183d9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:51.076155 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ac49e-db45-4447-ade2-a85c012183d9 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:51.077438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 598/1201] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:42:51.085717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d89d0-36df-4fce-8c4d-15a36a0a1a78 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:51.086289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d89d0-36df-4fce-8c4d-15a36a0a1a78 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:51.086289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d89d0-36df-4fce-8c4d-15a36a0a1a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:51.103822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-991d89d0-36df-4fce-8c4d-15a36a0a1a78 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:51.105034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-991d89d0-36df-4fce-8c4d-15a36a0a1a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:51.181942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 604/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:42:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:42:51.217839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ac49e-db45-4447-ade2-a85c012183d9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:51.345968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ac49e-db45-4447-ade2-a85c012183d9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:51.387863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0153f-4b50-42e2-ae5a-1a32e0bd32d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:51.389175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0153f-4b50-42e2-ae5a-1a32e0bd32d3 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:51.389673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0153f-4b50-42e2-ae5a-1a32e0bd32d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:51.390025 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0153f-4b50-42e2-ae5a-1a32e0bd32d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:51.404623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0153f-4b50-42e2-ae5a-1a32e0bd32d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:51.408327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0153f-4b50-42e2-ae5a-1a32e0bd32d3 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-2bb0153f-4b50-42e2-ae5a-1a32e0bd32d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:42:51.424698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:51.426755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:51.428734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:42:51.428734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:42:51.428734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:42:51.428734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:42:51.428734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 599/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:51.435427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d89d0-36df-4fce-8c4d-15a36a0a1a78 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:51.605659 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d89d0-36df-4fce-8c4d-15a36a0a1a78 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:51.640317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:51.648796 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3b53c-74f7-4ab1-bce1-2268b9e06a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:51.649515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3b53c-74f7-4ab1-bce1-2268b9e06a7c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:51.649802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3b53c-74f7-4ab1-bce1-2268b9e06a7c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:51.650077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3b53c-74f7-4ab1-bce1-2268b9e06a7c None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:51.651397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3b53c-74f7-4ab1-bce1-2268b9e06a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:51.651702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3b53c-74f7-4ab1-bce1-2268b9e06a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:51.653107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3b53c-74f7-4ab1-bce1-2268b9e06a7c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:51.671500 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 605/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:51.677490 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0153f-4b50-42e2-ae5a-1a32e0bd32d3 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:51.747116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:51.805247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0153f-4b50-42e2-ae5a-1a32e0bd32d3 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:51.848192 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fc85c-ca73-4dd0-ad65-415a49a935e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:51.849317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fc85c-ca73-4dd0-ad65-415a49a935e5 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:51.849861 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fc85c-ca73-4dd0-ad65-415a49a935e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:51.850396 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fc85c-ca73-4dd0-ad65-415a49a935e5 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:51.851685 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fc85c-ca73-4dd0-ad65-415a49a935e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:51.855047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fc85c-ca73-4dd0-ad65-415a49a935e5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:52.018697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 600/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Tue May 31 20:42:51 2022] POST /identity/v3/users => generated 251 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:42:54.413519 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ee94-cf83-4950-bf8b-11bda413e451 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.414140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ee94-cf83-4950-bf8b-11bda413e451 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.414517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ee94-cf83-4950-bf8b-11bda413e451 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.417242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 606/1206] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:42:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:54.423370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb7588-3ef4-48d7-911f-56b3b9f55983 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.423911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb7588-3ef4-48d7-911f-56b3b9f55983 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.423911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb7588-3ef4-48d7-911f-56b3b9f55983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.442099 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-edbb7588-3ef4-48d7-911f-56b3b9f55983 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:54.443308 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-edbb7588-3ef4-48d7-911f-56b3b9f55983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:54.518557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 601/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:42:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:42:54.544791 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2ee94-cf83-4950-bf8b-11bda413e451 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:54.653902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2ee94-cf83-4950-bf8b-11bda413e451 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:54.688892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35b7a4-3a66-435b-a804-da4eb8c0c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:54.695245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35b7a4-3a66-435b-a804-da4eb8c0c6ba None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.695245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35b7a4-3a66-435b-a804-da4eb8c0c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.695245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35b7a4-3a66-435b-a804-da4eb8c0c6ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.703029 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35b7a4-3a66-435b-a804-da4eb8c0c6ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-3d35b7a4-3a66-435b-a804-da4eb8c0c6ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:54.711072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:54.712419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:54.713326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:54.713326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:54.713326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:54.713326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:54.713326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:54.713326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:54.713326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:54.713326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:54.713326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:54.713326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:54.713326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:42:54.713326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:42:54.713326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 607/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:42:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:54.719022 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb7588-3ef4-48d7-911f-56b3b9f55983 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:54.775202 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:54.845550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb7588-3ef4-48d7-911f-56b3b9f55983 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:54.889727 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b54e52-55d7-44d7-be4f-69309adf5b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:54.890815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b54e52-55d7-44d7-be4f-69309adf5b7c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.891310 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b54e52-55d7-44d7-be4f-69309adf5b7c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.891818 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b54e52-55d7-44d7-be4f-69309adf5b7c None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.893248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b54e52-55d7-44d7-be4f-69309adf5b7c None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:54.894043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b54e52-55d7-44d7-be4f-69309adf5b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:54.896410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b54e52-55d7-44d7-be4f-69309adf5b7c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:54.913016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 602/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:42:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:54.920386 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35b7a4-3a66-435b-a804-da4eb8c0c6ba None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:54.974952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:55.028269 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35b7a4-3a66-435b-a804-da4eb8c0c6ba None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:55.070804 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3590dc-c8f1-48af-8410-edc83234b63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:55.071708 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3590dc-c8f1-48af-8410-edc83234b63a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:55.072059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3590dc-c8f1-48af-8410-edc83234b63a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:55.072356 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3590dc-c8f1-48af-8410-edc83234b63a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:55.084886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3590dc-c8f1-48af-8410-edc83234b63a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:55.086437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3590dc-c8f1-48af-8410-edc83234b63a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-db3590dc-c8f1-48af-8410-edc83234b63a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:42:55.108378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:55.109929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:55.111534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:42:55.111534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:42:55.111534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:42:55.111534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:42:55.111534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 608/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:55.116382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b54e52-55d7-44d7-be4f-69309adf5b7c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:55.293161 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:55.296703 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b54e52-55d7-44d7-be4f-69309adf5b7c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:55.338199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81936b3c-0ce2-487f-81de-2245be5b12ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:55.338877 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81936b3c-0ce2-487f-81de-2245be5b12ab None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:55.339154 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81936b3c-0ce2-487f-81de-2245be5b12ab None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:55.339995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81936b3c-0ce2-487f-81de-2245be5b12ab None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:55.340742 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81936b3c-0ce2-487f-81de-2245be5b12ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:55.341045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81936b3c-0ce2-487f-81de-2245be5b12ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:55.342466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81936b3c-0ce2-487f-81de-2245be5b12ab None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:55.354802 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 603/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:55.363654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3590dc-c8f1-48af-8410-edc83234b63a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:55.475279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3590dc-c8f1-48af-8410-edc83234b63a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:55.476907 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:55.512228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7a61b-ccec-46ab-bc08-641dde51c148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:55.513035 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a61b-ccec-46ab-bc08-641dde51c148 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:55.513320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a61b-ccec-46ab-bc08-641dde51c148 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:55.513628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7a61b-ccec-46ab-bc08-641dde51c148 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:55.521814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7a61b-ccec-46ab-bc08-641dde51c148 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:55.523391 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7a61b-ccec-46ab-bc08-641dde51c148 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-53e7a61b-ccec-46ab-bc08-641dde51c148 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:42:55.547051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:55.548258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:55.549508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:55.549508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:55.549508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:42:55.549508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:42:55.549508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:42:55.549508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:42:55.549508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:42:55.549508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:42:55.549508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 20:42:55.549508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:42:55.549508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 609/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:42:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:55.556495 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81936b3c-0ce2-487f-81de-2245be5b12ab None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:55.699799 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81936b3c-0ce2-487f-81de-2245be5b12ab None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:55.749927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccd05c-a228-4f8b-8a67-3fd1406cdb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:55.750576 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccd05c-a228-4f8b-8a67-3fd1406cdb98 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:55.750856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccd05c-a228-4f8b-8a67-3fd1406cdb98 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:55.751130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccd05c-a228-4f8b-8a67-3fd1406cdb98 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:55.751996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccd05c-a228-4f8b-8a67-3fd1406cdb98 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:55.752308 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccd05c-a228-4f8b-8a67-3fd1406cdb98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:55.753903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccd05c-a228-4f8b-8a67-3fd1406cdb98 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:55.781779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 604/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Tue May 31 20:42:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:55.788280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7a61b-ccec-46ab-bc08-641dde51c148 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:55.909641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7a61b-ccec-46ab-bc08-641dde51c148 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:55.947400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3b956-b830-4ab4-8f7b-12d99f448cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:55.948225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3b956-b830-4ab4-8f7b-12d99f448cd9 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:55.948603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3b956-b830-4ab4-8f7b-12d99f448cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:55.949546 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3b956-b830-4ab4-8f7b-12d99f448cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:55.984913 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:56.030765 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3b956-b830-4ab4-8f7b-12d99f448cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:56.032313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3b956-b830-4ab4-8f7b-12d99f448cd9 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:56.144896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 610/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:42:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 31 20:42:56.150977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccd05c-a228-4f8b-8a67-3fd1406cdb98 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:56.173516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:56.264595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccd05c-a228-4f8b-8a67-3fd1406cdb98 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:56.302437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c3888-3ad8-4009-8d48-02f028ec209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:56.303318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c3888-3ad8-4009-8d48-02f028ec209a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:56.303736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c3888-3ad8-4009-8d48-02f028ec209a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:56.304294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c3888-3ad8-4009-8d48-02f028ec209a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:56.318545 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c3888-3ad8-4009-8d48-02f028ec209a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:56.320032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c3888-3ad8-4009-8d48-02f028ec209a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-7c1c3888-3ad8-4009-8d48-02f028ec209a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:42:56.338570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:56.340806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:56.342612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:42:56.342612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:42:56.342612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:42:56.342612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:42:56.342612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 605/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:56.346965 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3b956-b830-4ab4-8f7b-12d99f448cd9 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:56.450076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:56.503525 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3b956-b830-4ab4-8f7b-12d99f448cd9 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:56.549646 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b78638-5e63-4a81-829b-635da887c86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:56.550769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b78638-5e63-4a81-829b-635da887c86c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:56.551252 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b78638-5e63-4a81-829b-635da887c86c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:56.551749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b78638-5e63-4a81-829b-635da887c86c None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:56.553100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b78638-5e63-4a81-829b-635da887c86c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:56.553651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b78638-5e63-4a81-829b-635da887c86c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:56.556110 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b78638-5e63-4a81-829b-635da887c86c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:56.574465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 611/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:56.580929 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c3888-3ad8-4009-8d48-02f028ec209a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:56.676390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:56.709975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c3888-3ad8-4009-8d48-02f028ec209a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:56.747316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8e033-8f01-4bc2-9140-f990cd248eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:56.748121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8e033-8f01-4bc2-9140-f990cd248eff None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:56.748399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8e033-8f01-4bc2-9140-f990cd248eff None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:56.748668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8e033-8f01-4bc2-9140-f990cd248eff None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:56.756789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8e033-8f01-4bc2-9140-f990cd248eff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:56.758366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8e033-8f01-4bc2-9140-f990cd248eff None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-38f8e033-8f01-4bc2-9140-f990cd248eff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:42:56.774653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:56.776359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:56.777287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:42:56.777287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:42:56.777287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:42:56.777287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:42:56.777287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:42:56.777287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:42:56.777287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:42:56.777287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:42:56.777287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 606/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:42:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:42:56.786590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b78638-5e63-4a81-829b-635da887c86c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:56.903860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b78638-5e63-4a81-829b-635da887c86c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:56.934393 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:56.947318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f55a4d-ad12-4cfc-90f8-3d987f0d6b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:56.948008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f55a4d-ad12-4cfc-90f8-3d987f0d6b53 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:56.948294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f55a4d-ad12-4cfc-90f8-3d987f0d6b53 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:56.948575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f55a4d-ad12-4cfc-90f8-3d987f0d6b53 None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:56.950025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f55a4d-ad12-4cfc-90f8-3d987f0d6b53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:56.950352 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f55a4d-ad12-4cfc-90f8-3d987f0d6b53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:56.951865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f55a4d-ad12-4cfc-90f8-3d987f0d6b53 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:56.967221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 612/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:42:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:56.974364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8e033-8f01-4bc2-9140-f990cd248eff None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:57.099399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8e033-8f01-4bc2-9140-f990cd248eff None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:57.148303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:57.157099 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae08e8a-bea9-4a42-a4a7-89a803208c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:57.158110 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae08e8a-bea9-4a42-a4a7-89a803208c79 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:57.158549 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae08e8a-bea9-4a42-a4a7-89a803208c79 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:57.158969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae08e8a-bea9-4a42-a4a7-89a803208c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:57.160357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae08e8a-bea9-4a42-a4a7-89a803208c79 None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=619d0b5afa094289808516486a5e3c4a) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:57.160857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae08e8a-bea9-4a42-a4a7-89a803208c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:57.163168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae08e8a-bea9-4a42-a4a7-89a803208c79 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:57.172536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 607/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:42:56 2022] GET /identity/v3/role_assignments?user.id=619d0b5afa094289808516486a5e3c4a&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:59.503406 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c65218-7695-4674-aabc-aee7371dc4da None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:59.504038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c65218-7695-4674-aabc-aee7371dc4da None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:59.504038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c65218-7695-4674-aabc-aee7371dc4da None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:59.505982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 613/1220] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:42:59.512446 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfb452-55be-4339-87d1-08ad14500f8c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:59.513089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfb452-55be-4339-87d1-08ad14500f8c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:59.513196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfb452-55be-4339-87d1-08ad14500f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:59.533825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-15cfb452-55be-4339-87d1-08ad14500f8c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:59.535059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-15cfb452-55be-4339-87d1-08ad14500f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:59.622730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 608/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:42:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:42:59.647086 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c65218-7695-4674-aabc-aee7371dc4da None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:59.773954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c65218-7695-4674-aabc-aee7371dc4da None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:59.815901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c4d77-0734-45c4-adda-9fec1543dee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:59.816915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4d77-0734-45c4-adda-9fec1543dee4 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:59.817197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4d77-0734-45c4-adda-9fec1543dee4 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:59.817515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4d77-0734-45c4-adda-9fec1543dee4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:59.830434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c4d77-0734-45c4-adda-9fec1543dee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-6c9c4d77-0734-45c4-adda-9fec1543dee4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:59.838377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:59.840342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:59.842461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:59.842461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:59.842461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:59.842461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:59.842461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:59.842461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:59.842461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:59.842461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:59.842461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:59.842461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:59.842461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:42:59.842461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:42:59.842461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 614/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:42:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:59.848259 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfb452-55be-4339-87d1-08ad14500f8c None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:59.978152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfb452-55be-4339-87d1-08ad14500f8c None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:00.003784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:00.016062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22183125-fcd7-4837-bf41-f33dfaf49135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:00.016732 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22183125-fcd7-4837-bf41-f33dfaf49135 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:00.017013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22183125-fcd7-4837-bf41-f33dfaf49135 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:00.017287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22183125-fcd7-4837-bf41-f33dfaf49135 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:00.018085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22183125-fcd7-4837-bf41-f33dfaf49135 None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:00.018392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22183125-fcd7-4837-bf41-f33dfaf49135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:00.019776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22183125-fcd7-4837-bf41-f33dfaf49135 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:00.028642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 609/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:42:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:00.035058 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c4d77-0734-45c4-adda-9fec1543dee4 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:00.084578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:00.150938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c4d77-0734-45c4-adda-9fec1543dee4 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:00.211409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81228a-1f39-4700-a871-af05c050f991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:00.212690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81228a-1f39-4700-a871-af05c050f991 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:00.213436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81228a-1f39-4700-a871-af05c050f991 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:00.213793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81228a-1f39-4700-a871-af05c050f991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:00.233490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81228a-1f39-4700-a871-af05c050f991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:00.236230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81228a-1f39-4700-a871-af05c050f991 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-3c81228a-1f39-4700-a871-af05c050f991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:00.269742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:00.270929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:00.271977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:00.271977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:00.271977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:00.271977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:00.272347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 615/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:00.277973 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22183125-fcd7-4837-bf41-f33dfaf49135 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:00.395281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22183125-fcd7-4837-bf41-f33dfaf49135 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:00.445974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f8fd4-5fef-461b-a082-76be454db275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:00.446718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f8fd4-5fef-461b-a082-76be454db275 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:00.447003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f8fd4-5fef-461b-a082-76be454db275 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:00.447280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f8fd4-5fef-461b-a082-76be454db275 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:00.448009 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f8fd4-5fef-461b-a082-76be454db275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:00.448318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f8fd4-5fef-461b-a082-76be454db275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:00.449739 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f8fd4-5fef-461b-a082-76be454db275 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:00.464116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 610/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:00.471622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81228a-1f39-4700-a871-af05c050f991 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:00.616336 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:00.624687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81228a-1f39-4700-a871-af05c050f991 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:00.661766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4fb45-4d09-4faf-979c-f413e2c03db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:00.662590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4fb45-4d09-4faf-979c-f413e2c03db6 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:00.662869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4fb45-4d09-4faf-979c-f413e2c03db6 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:00.663140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4fb45-4d09-4faf-979c-f413e2c03db6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:00.672146 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4fb45-4d09-4faf-979c-f413e2c03db6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:00.673621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4fb45-4d09-4faf-979c-f413e2c03db6 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-c3f4fb45-4d09-4faf-979c-f413e2c03db6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:00.689331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:00.691274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:00.693299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:00.693299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:00.693299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:00.693299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:00.693299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:00.693299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:00.693299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:00.693299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:00.693299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 20:43:00.693299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:00.693299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 616/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:00.698379 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f8fd4-5fef-461b-a082-76be454db275 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:00.751363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:00.807916 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f8fd4-5fef-461b-a082-76be454db275 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:00.856485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41071f-39c8-4c97-9d4d-a253973b31f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:00.858255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41071f-39c8-4c97-9d4d-a253973b31f1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:00.858745 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41071f-39c8-4c97-9d4d-a253973b31f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:00.859223 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41071f-39c8-4c97-9d4d-a253973b31f1 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:00.860915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41071f-39c8-4c97-9d4d-a253973b31f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:00.861496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41071f-39c8-4c97-9d4d-a253973b31f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:00.864172 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41071f-39c8-4c97-9d4d-a253973b31f1 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:00.895291 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 611/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Tue May 31 20:43:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:00.901276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4fb45-4d09-4faf-979c-f413e2c03db6 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:01.040242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4fb45-4d09-4faf-979c-f413e2c03db6 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:01.078405 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed731c7c-2473-46f6-a173-0c9038cbc3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:01.079475 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed731c7c-2473-46f6-a173-0c9038cbc3e3 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:01.079758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed731c7c-2473-46f6-a173-0c9038cbc3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:01.080042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed731c7c-2473-46f6-a173-0c9038cbc3e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.092380 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed731c7c-2473-46f6-a173-0c9038cbc3e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:01.093965 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed731c7c-2473-46f6-a173-0c9038cbc3e3 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-ed731c7c-2473-46f6-a173-0c9038cbc3e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:01.112837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:01.114250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:01.115884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:01.115884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:01.115884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:01.115884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:01.115884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 617/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:01.122277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41071f-39c8-4c97-9d4d-a253973b31f1 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:01.239253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41071f-39c8-4c97-9d4d-a253973b31f1 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:01.241934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:01.277921 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416121f3-fe22-48bd-b42a-424be4bf6b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:01.278594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416121f3-fe22-48bd-b42a-424be4bf6b15 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:01.278875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416121f3-fe22-48bd-b42a-424be4bf6b15 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:01.279147 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416121f3-fe22-48bd-b42a-424be4bf6b15 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.280488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416121f3-fe22-48bd-b42a-424be4bf6b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:01.280794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416121f3-fe22-48bd-b42a-424be4bf6b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:01.282244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416121f3-fe22-48bd-b42a-424be4bf6b15 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:01.295247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 612/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:01.301163 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed731c7c-2473-46f6-a173-0c9038cbc3e3 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:01.314100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:01.435699 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed731c7c-2473-46f6-a173-0c9038cbc3e3 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:01.472085 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd85dad-a98e-41ac-a6e2-7ed31b1de97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:01.472882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd85dad-a98e-41ac-a6e2-7ed31b1de97e None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:01.473164 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd85dad-a98e-41ac-a6e2-7ed31b1de97e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:01.473486 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd85dad-a98e-41ac-a6e2-7ed31b1de97e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.480612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd85dad-a98e-41ac-a6e2-7ed31b1de97e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:01.482130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd85dad-a98e-41ac-a6e2-7ed31b1de97e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-cfd85dad-a98e-41ac-a6e2-7ed31b1de97e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:01.496757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:01.498936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:01.501120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:01.501120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:01.501120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:01.501120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:01.501120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:01.501120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:01.501120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:01.501120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:01.501120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 618/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:01.506107 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416121f3-fe22-48bd-b42a-424be4bf6b15 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:01.621165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416121f3-fe22-48bd-b42a-424be4bf6b15 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:01.657801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9e5c1-f4ae-4c7a-a2e8-8fddb96584a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:01.658462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9e5c1-f4ae-4c7a-a2e8-8fddb96584a4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:01.658745 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9e5c1-f4ae-4c7a-a2e8-8fddb96584a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:01.659018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9e5c1-f4ae-4c7a-a2e8-8fddb96584a4 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.659809 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9e5c1-f4ae-4c7a-a2e8-8fddb96584a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:01.660113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9e5c1-f4ae-4c7a-a2e8-8fddb96584a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:01.661563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9e5c1-f4ae-4c7a-a2e8-8fddb96584a4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:01.674892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 613/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:01.681985 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd85dad-a98e-41ac-a6e2-7ed31b1de97e None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:01.756370 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:01.792658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd85dad-a98e-41ac-a6e2-7ed31b1de97e None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:01.829910 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d7b7d-4f16-4378-9410-42b5bf4169a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:01.830869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d7b7d-4f16-4378-9410-42b5bf4169a0 None admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:01.831191 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d7b7d-4f16-4378-9410-42b5bf4169a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:01.831508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d7b7d-4f16-4378-9410-42b5bf4169a0 None admin] PATH_INFO: `/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/619d0b5afa094289808516486a5e3c4a/roles/1d87f67726f0470f81f36098070998b8` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.847512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d7b7d-4f16-4378-9410-42b5bf4169a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d14229f6554a34bf9084d36cffe8ac, user_id=619d0b5afa094289808516486a5e3c4a, role_id=1d87f67726f0470f81f36098070998b8)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:01.849082 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d7b7d-4f16-4378-9410-42b5bf4169a0 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:01.981054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 619/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:43:01 2022] PUT /identity/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/619d0b5afa094289808516486a5e3c4a/roles/1d87f67726f0470f81f36098070998b8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:04.342175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a7360-9176-494d-aafe-cb22f738581a None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:04.342863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a7360-9176-494d-aafe-cb22f738581a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:04.342863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a7360-9176-494d-aafe-cb22f738581a None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:04.344392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 614/1233] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:04.350651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ec974-2bcc-4cd3-b7ae-26642fdb1bd7 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:04.358263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ec974-2bcc-4cd3-b7ae-26642fdb1bd7 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:04.358263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ec974-2bcc-4cd3-b7ae-26642fdb1bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:04.369817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-e50ec974-2bcc-4cd3-b7ae-26642fdb1bd7 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:04.371205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e50ec974-2bcc-4cd3-b7ae-26642fdb1bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:04.445187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 620/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:43:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:43:04.469693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a7360-9176-494d-aafe-cb22f738581a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:04.499000 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:04.581520 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a7360-9176-494d-aafe-cb22f738581a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:04.619208 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95b1d2-5f40-45f7-a580-26cdfae2d253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:04.620012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95b1d2-5f40-45f7-a580-26cdfae2d253 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:04.620301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95b1d2-5f40-45f7-a580-26cdfae2d253 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:04.620580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95b1d2-5f40-45f7-a580-26cdfae2d253 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:04.631905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95b1d2-5f40-45f7-a580-26cdfae2d253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-4a95b1d2-5f40-45f7-a580-26cdfae2d253 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:04.640170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:04.646004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:04.646927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:04.646927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:04.646927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:04.646927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:04.646927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:04.646927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:04.646927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:04.646927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:04.646927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:04.646927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:04.646927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:04.646927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:43:04.646927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 615/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Tue May 31 20:43:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:04.651922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ec974-2bcc-4cd3-b7ae-26642fdb1bd7 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:04.711903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:04.769612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ec974-2bcc-4cd3-b7ae-26642fdb1bd7 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:04.809290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6c762-ea59-49cb-9ac5-fb4b5c3ee19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:04.810004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6c762-ea59-49cb-9ac5-fb4b5c3ee19f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:04.810350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6c762-ea59-49cb-9ac5-fb4b5c3ee19f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:04.810572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6c762-ea59-49cb-9ac5-fb4b5c3ee19f None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:04.811329 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6c762-ea59-49cb-9ac5-fb4b5c3ee19f None admin] RBAC: Adding query filter params (name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:04.811641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6c762-ea59-49cb-9ac5-fb4b5c3ee19f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:04.813054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6c762-ea59-49cb-9ac5-fb4b5c3ee19f None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:04.822913 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 621/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Tue May 31 20:43:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:04.829045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95b1d2-5f40-45f7-a580-26cdfae2d253 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:04.927926 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:04.944634 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95b1d2-5f40-45f7-a580-26cdfae2d253 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:04.985766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d2bdb-01d7-4591-b49a-8f9756850b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:04.986566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2bdb-01d7-4591-b49a-8f9756850b65 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:04.986848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2bdb-01d7-4591-b49a-8f9756850b65 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:04.987123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2bdb-01d7-4591-b49a-8f9756850b65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:04.999027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d2bdb-01d7-4591-b49a-8f9756850b65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:05.000624 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d2bdb-01d7-4591-b49a-8f9756850b65 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-fa7d2bdb-01d7-4591-b49a-8f9756850b65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:05.023813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:05.038335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:05.039455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:05.039455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:05.039455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:05.039455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:43:05.039455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 616/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:05.039767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6c762-ea59-49cb-9ac5-fb4b5c3ee19f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:05.159767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6c762-ea59-49cb-9ac5-fb4b5c3ee19f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:05.170938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:05.200226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3cfba-0e16-4045-ae0e-d0d25e3fb100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:05.200925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3cfba-0e16-4045-ae0e-d0d25e3fb100 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:05.201211 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3cfba-0e16-4045-ae0e-d0d25e3fb100 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:05.201526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3cfba-0e16-4045-ae0e-d0d25e3fb100 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:05.202297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3cfba-0e16-4045-ae0e-d0d25e3fb100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:05.202609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3cfba-0e16-4045-ae0e-d0d25e3fb100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:05.204625 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3cfba-0e16-4045-ae0e-d0d25e3fb100 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:05.219414 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 622/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:05.226808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d2bdb-01d7-4591-b49a-8f9756850b65 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:05.345642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d2bdb-01d7-4591-b49a-8f9756850b65 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:05.384170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cc55e-1475-4fba-acf0-047509fdad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:05.384979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cc55e-1475-4fba-acf0-047509fdad97 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:05.385260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cc55e-1475-4fba-acf0-047509fdad97 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:05.385766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cc55e-1475-4fba-acf0-047509fdad97 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:05.388979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:05.395243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cc55e-1475-4fba-acf0-047509fdad97 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:05.396845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cc55e-1475-4fba-acf0-047509fdad97 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-bd0cc55e-1475-4fba-acf0-047509fdad97 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:05.413158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:05.416227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:05.418536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:05.418536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:05.418536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:05.418536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:05.418536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:05.418536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:05.418536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:05.418536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:05.418536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 20:43:05.418536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:43:05.418536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 617/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:05.420787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3cfba-0e16-4045-ae0e-d0d25e3fb100 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:05.563511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3cfba-0e16-4045-ae0e-d0d25e3fb100 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:05.604403 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac677e-3211-473b-ab8c-2ef2b8b91489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:05.605103 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac677e-3211-473b-ab8c-2ef2b8b91489 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:05.605416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac677e-3211-473b-ab8c-2ef2b8b91489 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:05.605706 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac677e-3211-473b-ab8c-2ef2b8b91489 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:05.606578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac677e-3211-473b-ab8c-2ef2b8b91489 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:05.606893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac677e-3211-473b-ab8c-2ef2b8b91489 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:05.608607 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac677e-3211-473b-ab8c-2ef2b8b91489 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:05.629910 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 623/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Tue May 31 20:43:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:05.636726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cc55e-1475-4fba-acf0-047509fdad97 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:05.783823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cc55e-1475-4fba-acf0-047509fdad97 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:05.824982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea455637-c0f2-4040-85ea-a24a881b28dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:05.824982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea455637-c0f2-4040-85ea-a24a881b28dc None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:05.824982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea455637-c0f2-4040-85ea-a24a881b28dc None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:05.824982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea455637-c0f2-4040-85ea-a24a881b28dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:05.893326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:05.900584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea455637-c0f2-4040-85ea-a24a881b28dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:05.902212 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea455637-c0f2-4040-85ea-a24a881b28dc None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:06.061631 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 618/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:43:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:43:06.068028 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac677e-3211-473b-ab8c-2ef2b8b91489 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:06.100432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:06.214502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac677e-3211-473b-ab8c-2ef2b8b91489 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:06.273445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74307e1-1d72-45bb-98a2-e200605d5927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:06.274732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74307e1-1d72-45bb-98a2-e200605d5927 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.275087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74307e1-1d72-45bb-98a2-e200605d5927 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.275365 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74307e1-1d72-45bb-98a2-e200605d5927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.292042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74307e1-1d72-45bb-98a2-e200605d5927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:06.294237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74307e1-1d72-45bb-98a2-e200605d5927 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-a74307e1-1d72-45bb-98a2-e200605d5927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:06.317899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:06.319093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:06.320299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:06.320299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:06.320299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:06.320299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:06.320299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 624/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:06.326471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea455637-c0f2-4040-85ea-a24a881b28dc None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:06.430895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:06.436796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea455637-c0f2-4040-85ea-a24a881b28dc None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:06.472857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d37123-c912-434b-8d07-a4657cbca6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:06.473554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d37123-c912-434b-8d07-a4657cbca6ab None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.473836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d37123-c912-434b-8d07-a4657cbca6ab None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.474159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d37123-c912-434b-8d07-a4657cbca6ab None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.474982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d37123-c912-434b-8d07-a4657cbca6ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:06.475286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d37123-c912-434b-8d07-a4657cbca6ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:06.476673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d37123-c912-434b-8d07-a4657cbca6ab None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:06.489277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 619/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:06.495755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74307e1-1d72-45bb-98a2-e200605d5927 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:06.600274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:06.623199 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74307e1-1d72-45bb-98a2-e200605d5927 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:06.660328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c3de3-a8cb-4b75-8084-c157838d3b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:06.661174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c3de3-a8cb-4b75-8084-c157838d3b36 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.661489 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c3de3-a8cb-4b75-8084-c157838d3b36 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.661763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c3de3-a8cb-4b75-8084-c157838d3b36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.669353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c3de3-a8cb-4b75-8084-c157838d3b36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:06.670842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c3de3-a8cb-4b75-8084-c157838d3b36 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-6f5c3de3-a8cb-4b75-8084-c157838d3b36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:06.685113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:06.686904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:06.689097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:06.689097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:06.689097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:06.689097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:06.689097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:06.689097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:06.689097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:06.689097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:06.689097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 625/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:43:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:06.694115 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d37123-c912-434b-8d07-a4657cbca6ab None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:06.816905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d37123-c912-434b-8d07-a4657cbca6ab None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:06.857711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28dd49-1ed1-4b76-8f8a-114f5f715783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:06.858376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28dd49-1ed1-4b76-8f8a-114f5f715783 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.858654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28dd49-1ed1-4b76-8f8a-114f5f715783 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.858921 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28dd49-1ed1-4b76-8f8a-114f5f715783 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.859709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28dd49-1ed1-4b76-8f8a-114f5f715783 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:06.860143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28dd49-1ed1-4b76-8f8a-114f5f715783 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:06.861543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28dd49-1ed1-4b76-8f8a-114f5f715783 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:06.879045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 620/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:06.885935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c3de3-a8cb-4b75-8084-c157838d3b36 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:07.001226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c3de3-a8cb-4b75-8084-c157838d3b36 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:07.037771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e1d83-091c-41eb-bdb3-8f88aac60cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:07.038437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e1d83-091c-41eb-bdb3-8f88aac60cb6 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:07.038723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e1d83-091c-41eb-bdb3-8f88aac60cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:07.039001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e1d83-091c-41eb-bdb3-8f88aac60cb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:07.039835 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e1d83-091c-41eb-bdb3-8f88aac60cb6 None admin] RBAC: Adding query filter params (role.id=1d87f67726f0470f81f36098070998b8, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=619d0b5afa094289808516486a5e3c4a) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:07.040151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e1d83-091c-41eb-bdb3-8f88aac60cb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:07.041626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e1d83-091c-41eb-bdb3-8f88aac60cb6 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:07.048547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 626/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:43:06 2022] GET /identity/v3/role_assignments?user.id=619d0b5afa094289808516486a5e3c4a&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=1d87f67726f0470f81f36098070998b8 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:09.555498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb68c-022c-4f53-9cd4-37a1dc1a9923 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:09.556269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb68c-022c-4f53-9cd4-37a1dc1a9923 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:09.556503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb68c-022c-4f53-9cd4-37a1dc1a9923 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:09.559080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 621/1247] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:43:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:09.565968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b886554-5d92-4b8d-abdd-1884f5335c3d None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:09.566493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b886554-5d92-4b8d-abdd-1884f5335c3d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:09.566651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b886554-5d92-4b8d-abdd-1884f5335c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:09.571795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:09.584778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4b886554-5d92-4b8d-abdd-1884f5335c3d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:09.586183 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4b886554-5d92-4b8d-abdd-1884f5335c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:09.658399 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 627/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:43:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:43:09.701717 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebb68c-022c-4f53-9cd4-37a1dc1a9923 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:09.733675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:09.828971 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebb68c-022c-4f53-9cd4-37a1dc1a9923 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:09.869402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec6403-0ddc-4c9c-98a5-37f82de95f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:09.870244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec6403-0ddc-4c9c-98a5-37f82de95f0a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:09.870663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec6403-0ddc-4c9c-98a5-37f82de95f0a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:09.870964 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec6403-0ddc-4c9c-98a5-37f82de95f0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:09.884180 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec6403-0ddc-4c9c-98a5-37f82de95f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-01ec6403-0ddc-4c9c-98a5-37f82de95f0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:09.892455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:09.894109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:09.895094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:09.895094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:09.895094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:09.895094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:09.895094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:09.895094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:09.895094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:09.895094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:09.895094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:09.895094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:09.895094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:09.895094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:43:09.895094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 622/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:43:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:09.900485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b886554-5d92-4b8d-abdd-1884f5335c3d None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.021963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b886554-5d92-4b8d-abdd-1884f5335c3d None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:10.057217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:10.062692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e25ad-d573-43ca-9d1c-ffb4490c1f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:10.063427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e25ad-d573-43ca-9d1c-ffb4490c1f81 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.063771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e25ad-d573-43ca-9d1c-ffb4490c1f81 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.064233 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e25ad-d573-43ca-9d1c-ffb4490c1f81 None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.065121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e25ad-d573-43ca-9d1c-ffb4490c1f81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:10.065512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e25ad-d573-43ca-9d1c-ffb4490c1f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:10.066981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e25ad-d573-43ca-9d1c-ffb4490c1f81 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:10.076052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 628/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:43:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:10.089709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec6403-0ddc-4c9c-98a5-37f82de95f0a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.176199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:10.200880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec6403-0ddc-4c9c-98a5-37f82de95f0a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:10.239137 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c4d7e-df33-4732-a240-2cbfd394b225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:10.239983 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c4d7e-df33-4732-a240-2cbfd394b225 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.240264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c4d7e-df33-4732-a240-2cbfd394b225 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.240542 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c4d7e-df33-4732-a240-2cbfd394b225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.251973 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c4d7e-df33-4732-a240-2cbfd394b225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:10.253476 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c4d7e-df33-4732-a240-2cbfd394b225 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-b13c4d7e-df33-4732-a240-2cbfd394b225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:10.272832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:10.274026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:10.275230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:10.275230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:10.275230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:10.275230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:43:10.275230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 623/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:10.280153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e25ad-d573-43ca-9d1c-ffb4490c1f81 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.392065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e25ad-d573-43ca-9d1c-ffb4490c1f81 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:10.428443 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc055511-2f21-450c-ad53-1699a55c812b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:10.429130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc055511-2f21-450c-ad53-1699a55c812b None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.429433 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc055511-2f21-450c-ad53-1699a55c812b None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.429711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc055511-2f21-450c-ad53-1699a55c812b None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.430445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc055511-2f21-450c-ad53-1699a55c812b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:10.430753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc055511-2f21-450c-ad53-1699a55c812b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:10.432196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc055511-2f21-450c-ad53-1699a55c812b None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:10.446152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 629/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:10.452323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c4d7e-df33-4732-a240-2cbfd394b225 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.570681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c4d7e-df33-4732-a240-2cbfd394b225 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:10.601778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:10.610787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947c0e0-69ff-419e-ba54-93bb317d9d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:10.611642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947c0e0-69ff-419e-ba54-93bb317d9d94 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.611921 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947c0e0-69ff-419e-ba54-93bb317d9d94 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.612194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947c0e0-69ff-419e-ba54-93bb317d9d94 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.620867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947c0e0-69ff-419e-ba54-93bb317d9d94 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:10.622335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947c0e0-69ff-419e-ba54-93bb317d9d94 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-f947c0e0-69ff-419e-ba54-93bb317d9d94 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:10.639140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:10.640399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:10.641697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:10.641697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:10.641697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:10.641697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:10.641697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:10.641697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:10.641697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:10.641697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:10.641697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 20:43:10.641697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:43:10.644296 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 624/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:10.649454 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc055511-2f21-450c-ad53-1699a55c812b None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.711628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:10.760092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc055511-2f21-450c-ad53-1699a55c812b None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:10.795694 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc6e95-5e41-492a-9d41-22da743cb33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:10.796371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc6e95-5e41-492a-9d41-22da743cb33a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.796644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc6e95-5e41-492a-9d41-22da743cb33a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.796916 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc6e95-5e41-492a-9d41-22da743cb33a None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.797789 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc6e95-5e41-492a-9d41-22da743cb33a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:10.798094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc6e95-5e41-492a-9d41-22da743cb33a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:10.799611 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc6e95-5e41-492a-9d41-22da743cb33a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:10.819034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 630/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Tue May 31 20:43:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:10.825435 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947c0e0-69ff-419e-ba54-93bb317d9d94 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.944111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947c0e0-69ff-419e-ba54-93bb317d9d94 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:10.982725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba3788-6697-4aa7-ae2d-519a4e6ce5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:10.983503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba3788-6697-4aa7-ae2d-519a4e6ce5a2 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.983763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba3788-6697-4aa7-ae2d-519a4e6ce5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.984032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba3788-6697-4aa7-ae2d-519a4e6ce5a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:11.051734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:11.063859 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba3788-6697-4aa7-ae2d-519a4e6ce5a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:11.065996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba3788-6697-4aa7-ae2d-519a4e6ce5a2 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:11.175896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 625/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:43:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:43:11.182204 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc6e95-5e41-492a-9d41-22da743cb33a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:11.303934 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc6e95-5e41-492a-9d41-22da743cb33a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:11.321352 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:11.355928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38801e-809c-42a5-bc60-126317384a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:11.357320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38801e-809c-42a5-bc60-126317384a02 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:11.357857 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38801e-809c-42a5-bc60-126317384a02 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:11.358346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38801e-809c-42a5-bc60-126317384a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:11.378064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38801e-809c-42a5-bc60-126317384a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:11.380882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38801e-809c-42a5-bc60-126317384a02 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-8c38801e-809c-42a5-bc60-126317384a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:11.413869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:11.415044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:11.416275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:11.416275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:11.416275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:11.416275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:11.416275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 631/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:11.422420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba3788-6697-4aa7-ae2d-519a4e6ce5a2 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:11.522537 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:11.535992 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba3788-6697-4aa7-ae2d-519a4e6ce5a2 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:11.571529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9102e-b29c-48af-bc90-38fedafec0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:11.572182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9102e-b29c-48af-bc90-38fedafec0b1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:11.572384 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9102e-b29c-48af-bc90-38fedafec0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:11.572654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9102e-b29c-48af-bc90-38fedafec0b1 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:11.573408 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9102e-b29c-48af-bc90-38fedafec0b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:11.573719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9102e-b29c-48af-bc90-38fedafec0b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:11.575100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9102e-b29c-48af-bc90-38fedafec0b1 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:11.588353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 626/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:11.594689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38801e-809c-42a5-bc60-126317384a02 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:11.708797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38801e-809c-42a5-bc60-126317384a02 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:11.749811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f22c6f-3135-46a8-9ebf-37e80bb3d201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:11.750639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f22c6f-3135-46a8-9ebf-37e80bb3d201 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:11.750925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f22c6f-3135-46a8-9ebf-37e80bb3d201 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:11.751203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f22c6f-3135-46a8-9ebf-37e80bb3d201 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:11.759721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f22c6f-3135-46a8-9ebf-37e80bb3d201 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:11.761279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f22c6f-3135-46a8-9ebf-37e80bb3d201 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-50f22c6f-3135-46a8-9ebf-37e80bb3d201 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:11.776972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:11.778953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:11.780748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:11.780748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:11.780748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:11.780748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:11.780748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:11.780748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:11.780748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:11.780748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:11.780748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 632/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:11.785566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9102e-b29c-48af-bc90-38fedafec0b1 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:11.906122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9102e-b29c-48af-bc90-38fedafec0b1 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:11.950833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbf7b3-a480-4228-9134-6655a6748018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:11.951506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf7b3-a480-4228-9134-6655a6748018 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:11.951786 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf7b3-a480-4228-9134-6655a6748018 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:11.952060 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf7b3-a480-4228-9134-6655a6748018 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:11.952861 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbf7b3-a480-4228-9134-6655a6748018 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:11.953169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbf7b3-a480-4228-9134-6655a6748018 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:11.954815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbf7b3-a480-4228-9134-6655a6748018 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:11.969929 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 627/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:11.977157 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f22c6f-3135-46a8-9ebf-37e80bb3d201 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:12.010001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:12.094682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f22c6f-3135-46a8-9ebf-37e80bb3d201 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:12.134077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef1e62-ae8d-46ca-8e13-5dfb3f702f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:12.134725 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef1e62-ae8d-46ca-8e13-5dfb3f702f6e None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:12.135005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef1e62-ae8d-46ca-8e13-5dfb3f702f6e None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:12.135277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef1e62-ae8d-46ca-8e13-5dfb3f702f6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:12.136092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef1e62-ae8d-46ca-8e13-5dfb3f702f6e None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=619d0b5afa094289808516486a5e3c4a) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:12.136405 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef1e62-ae8d-46ca-8e13-5dfb3f702f6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:12.137969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef1e62-ae8d-46ca-8e13-5dfb3f702f6e None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:12.144744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 633/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:43:11 2022] GET /identity/v3/role_assignments?user.id=619d0b5afa094289808516486a5e3c4a&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:14.449123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2bb71-e40f-4dea-adcb-b0f2a838074d None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:14.449942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2bb71-e40f-4dea-adcb-b0f2a838074d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:14.449942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2bb71-e40f-4dea-adcb-b0f2a838074d None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:14.451089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 628/1261] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:14.457000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570438cb-93dc-470f-a200-11e624423be8 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:14.457525 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570438cb-93dc-470f-a200-11e624423be8 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:14.457680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570438cb-93dc-470f-a200-11e624423be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:14.475668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-570438cb-93dc-470f-a200-11e624423be8 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:14.476879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-570438cb-93dc-470f-a200-11e624423be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:14.563679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 634/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:43:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:43:14.587360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2bb71-e40f-4dea-adcb-b0f2a838074d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:14.599407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:14.706447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2bb71-e40f-4dea-adcb-b0f2a838074d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:14.749584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1809a-cf9b-4a3c-b105-fbfcd1dbfb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:14.750687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1809a-cf9b-4a3c-b105-fbfcd1dbfb23 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:14.751058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1809a-cf9b-4a3c-b105-fbfcd1dbfb23 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:14.751547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1809a-cf9b-4a3c-b105-fbfcd1dbfb23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:14.764464 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1809a-cf9b-4a3c-b105-fbfcd1dbfb23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-8de1809a-cf9b-4a3c-b105-fbfcd1dbfb23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:14.772343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:14.774167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:14.775282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:14.775282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:14.775282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:14.775282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:14.775282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:14.775282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:14.775282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:14.775282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:14.775282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:14.775282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:14.775282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:14.775282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:43:14.775282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 629/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:43:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:14.782048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570438cb-93dc-470f-a200-11e624423be8 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:14.817499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:14.916340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570438cb-93dc-470f-a200-11e624423be8 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:14.954715 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caffe0-70d7-46d2-b537-dd3c6ff1624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:14.955462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caffe0-70d7-46d2-b537-dd3c6ff1624c None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:14.955795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caffe0-70d7-46d2-b537-dd3c6ff1624c None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:14.956121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caffe0-70d7-46d2-b537-dd3c6ff1624c None admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:14.957515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19caffe0-70d7-46d2-b537-dd3c6ff1624c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:14.957869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19caffe0-70d7-46d2-b537-dd3c6ff1624c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:14.959327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19caffe0-70d7-46d2-b537-dd3c6ff1624c None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:14.969197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 635/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:43:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:14.976104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1809a-cf9b-4a3c-b105-fbfcd1dbfb23 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:15.056064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:15.095299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1809a-cf9b-4a3c-b105-fbfcd1dbfb23 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:15.131126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ff9c7-aabf-4d7b-b54a-1c85c71ddf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:15.131919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ff9c7-aabf-4d7b-b54a-1c85c71ddf70 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:15.132201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ff9c7-aabf-4d7b-b54a-1c85c71ddf70 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:15.132482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ff9c7-aabf-4d7b-b54a-1c85c71ddf70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:15.145429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ff9c7-aabf-4d7b-b54a-1c85c71ddf70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:15.147017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ff9c7-aabf-4d7b-b54a-1c85c71ddf70 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-3b5ff9c7-aabf-4d7b-b54a-1c85c71ddf70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:15.165675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:15.167470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:15.169643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:15.169643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:15.169643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:15.169643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:43:15.169643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 630/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:15.174611 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caffe0-70d7-46d2-b537-dd3c6ff1624c None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:15.270113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:15.292826 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caffe0-70d7-46d2-b537-dd3c6ff1624c None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:15.340055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb2aaa-4cc8-49e1-a58f-2666284902f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:15.341014 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb2aaa-4cc8-49e1-a58f-2666284902f8 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:15.341447 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb2aaa-4cc8-49e1-a58f-2666284902f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:15.341834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb2aaa-4cc8-49e1-a58f-2666284902f8 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:15.342677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb2aaa-4cc8-49e1-a58f-2666284902f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:15.343082 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb2aaa-4cc8-49e1-a58f-2666284902f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:15.344590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb2aaa-4cc8-49e1-a58f-2666284902f8 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:15.358648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 636/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:15.365682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ff9c7-aabf-4d7b-b54a-1c85c71ddf70 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:15.481641 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ff9c7-aabf-4d7b-b54a-1c85c71ddf70 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:15.504789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:15.519630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaedb96-2c82-43c7-b291-ede9426f0603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:15.520438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaedb96-2c82-43c7-b291-ede9426f0603 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:15.520742 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaedb96-2c82-43c7-b291-ede9426f0603 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:15.521015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaedb96-2c82-43c7-b291-ede9426f0603 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:15.529301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaedb96-2c82-43c7-b291-ede9426f0603 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:15.530800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaedb96-2c82-43c7-b291-ede9426f0603 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-eaaedb96-2c82-43c7-b291-ede9426f0603 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:15.546637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:15.548756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:15.550373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:15.550373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:15.550373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:15.550373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:15.550373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:15.550373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:15.550373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:15.550373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:15.550373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 20:43:15.550373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:43:15.550373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 631/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:15.558851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb2aaa-4cc8-49e1-a58f-2666284902f8 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:15.671690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb2aaa-4cc8-49e1-a58f-2666284902f8 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:15.714192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6958a-b826-47d1-82f6-209e03d227f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:15.714869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6958a-b826-47d1-82f6-209e03d227f1 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:15.715156 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6958a-b826-47d1-82f6-209e03d227f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:15.715437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6958a-b826-47d1-82f6-209e03d227f1 None admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:15.716282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6958a-b826-47d1-82f6-209e03d227f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:15.716594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6958a-b826-47d1-82f6-209e03d227f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:15.718073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6958a-b826-47d1-82f6-209e03d227f1 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:15.727824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:15.737179 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 637/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Tue May 31 20:43:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:15.744401 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaedb96-2c82-43c7-b291-ede9426f0603 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:15.885587 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaedb96-2c82-43c7-b291-ede9426f0603 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:15.946538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24b299-ce5e-4e41-8644-40c21d87ec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:15.947794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b299-ce5e-4e41-8644-40c21d87ec24 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:15.948488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b299-ce5e-4e41-8644-40c21d87ec24 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:15.948975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b299-ce5e-4e41-8644-40c21d87ec24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:15.968433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24b299-ce5e-4e41-8644-40c21d87ec24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:15.971131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24b299-ce5e-4e41-8644-40c21d87ec24 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-1c24b299-ce5e-4e41-8644-40c21d87ec24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:16.004933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:16.006773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:16.008566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:16.008566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:16.008566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:16.008566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:43:16.008566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 632/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:16.013282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6958a-b826-47d1-82f6-209e03d227f1 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:16.133690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6958a-b826-47d1-82f6-209e03d227f1 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:16.171667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe304f7-433e-48b9-b561-83e1ecbb7d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:16.172334 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe304f7-433e-48b9-b561-83e1ecbb7d51 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:16.172696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe304f7-433e-48b9-b561-83e1ecbb7d51 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:16.173004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe304f7-433e-48b9-b561-83e1ecbb7d51 None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:16.173756 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe304f7-433e-48b9-b561-83e1ecbb7d51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:16.174065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe304f7-433e-48b9-b561-83e1ecbb7d51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:16.175447 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe304f7-433e-48b9-b561-83e1ecbb7d51 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:16.188053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 638/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:16.194231 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24b299-ce5e-4e41-8644-40c21d87ec24 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:16.240653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:16.317930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24b299-ce5e-4e41-8644-40c21d87ec24 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:16.358057 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8cc7b-ad7d-4159-9e19-c7c4a470c8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:16.358860 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8cc7b-ad7d-4159-9e19-c7c4a470c8ab None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:16.359146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8cc7b-ad7d-4159-9e19-c7c4a470c8ab None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:16.359420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8cc7b-ad7d-4159-9e19-c7c4a470c8ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:16.367223 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8cc7b-ad7d-4159-9e19-c7c4a470c8ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:16.368677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8cc7b-ad7d-4159-9e19-c7c4a470c8ab None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-54e8cc7b-ad7d-4159-9e19-c7c4a470c8ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:16.383550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:16.385095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:16.386950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:16.386950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:16.386950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:16.386950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:16.386950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:16.386950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:16.386950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:16.386950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:43:16.386950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 633/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:16.392566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe304f7-433e-48b9-b561-83e1ecbb7d51 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:16.459624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:16.504913 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe304f7-433e-48b9-b561-83e1ecbb7d51 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:16.558128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6ea02-eeaa-427a-8a04-f5a73afd6ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:16.559285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6ea02-eeaa-427a-8a04-f5a73afd6ade None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:16.559825 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6ea02-eeaa-427a-8a04-f5a73afd6ade None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:16.560311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6ea02-eeaa-427a-8a04-f5a73afd6ade None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:16.561831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6ea02-eeaa-427a-8a04-f5a73afd6ade None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:16.562384 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6ea02-eeaa-427a-8a04-f5a73afd6ade None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:16.565154 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6ea02-eeaa-427a-8a04-f5a73afd6ade None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:16.587771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 639/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:16.594424 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8cc7b-ad7d-4159-9e19-c7c4a470c8ab None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:16.728111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:16.737876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8cc7b-ad7d-4159-9e19-c7c4a470c8ab None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:16.775506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267236e-b685-4b97-9ad9-be0d9867032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:16.776597 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267236e-b685-4b97-9ad9-be0d9867032c None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:16.776974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267236e-b685-4b97-9ad9-be0d9867032c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:16.777258 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267236e-b685-4b97-9ad9-be0d9867032c None admin] PATH_INFO: `/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/619d0b5afa094289808516486a5e3c4a/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:16.780062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267236e-b685-4b97-9ad9-be0d9867032c None admin] RBAC: Authorizing `identity:create_grant(project_id=69d14229f6554a34bf9084d36cffe8ac, user_id=619d0b5afa094289808516486a5e3c4a, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:16.781560 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267236e-b685-4b97-9ad9-be0d9867032c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:16.913145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 634/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Tue May 31 20:43:16 2022] PUT /identity/v3/projects/69d14229f6554a34bf9084d36cffe8ac/users/619d0b5afa094289808516486a5e3c4a/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:19.244028 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61173c4c-9c42-488e-b38c-88e901ef144b None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.244658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61173c4c-9c42-488e-b38c-88e901ef144b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.244658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61173c4c-9c42-488e-b38c-88e901ef144b None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.245968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 640/1274] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:19.251918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee8684-ee13-4814-a96f-90a69d4f89cf None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.252546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee8684-ee13-4814-a96f-90a69d4f89cf None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.252546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee8684-ee13-4814-a96f-90a69d4f89cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.272595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-82ee8684-ee13-4814-a96f-90a69d4f89cf None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:19.273928 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-82ee8684-ee13-4814-a96f-90a69d4f89cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:19.356198 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 635/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:43:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:43:19.380153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61173c4c-9c42-488e-b38c-88e901ef144b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:19.525237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61173c4c-9c42-488e-b38c-88e901ef144b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:19.545581 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:19.564980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43023e-c555-4f54-a3ec-ef928c05188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:19.565896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43023e-c555-4f54-a3ec-ef928c05188f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.566175 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43023e-c555-4f54-a3ec-ef928c05188f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.566444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43023e-c555-4f54-a3ec-ef928c05188f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.580130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43023e-c555-4f54-a3ec-ef928c05188f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-1f43023e-c555-4f54-a3ec-ef928c05188f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:19.589267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:19.591113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:19.593121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:19.593121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:19.593121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:19.593121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:19.593121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:19.593121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:19.593121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:19.593121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:19.593121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:19.593121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:19.593121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:19.593121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:19.593121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 641/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Tue May 31 20:43:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:19.598752 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee8684-ee13-4814-a96f-90a69d4f89cf None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:19.696651 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:19.717286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee8684-ee13-4814-a96f-90a69d4f89cf None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:19.759868 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1debb69-a332-4149-b80f-bd97047d1271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:19.760585 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1debb69-a332-4149-b80f-bd97047d1271 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.760901 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1debb69-a332-4149-b80f-bd97047d1271 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.761174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1debb69-a332-4149-b80f-bd97047d1271 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.761961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1debb69-a332-4149-b80f-bd97047d1271 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:19.762280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1debb69-a332-4149-b80f-bd97047d1271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:19.763661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1debb69-a332-4149-b80f-bd97047d1271 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:19.773543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 636/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Tue May 31 20:43:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:19.781437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43023e-c555-4f54-a3ec-ef928c05188f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:19.920845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43023e-c555-4f54-a3ec-ef928c05188f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:19.958717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e346565-fa54-4541-9e80-0906cda5ba5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:19.959555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e346565-fa54-4541-9e80-0906cda5ba5a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.960018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e346565-fa54-4541-9e80-0906cda5ba5a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.960306 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e346565-fa54-4541-9e80-0906cda5ba5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.973003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e346565-fa54-4541-9e80-0906cda5ba5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:19.974513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e346565-fa54-4541-9e80-0906cda5ba5a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-3e346565-fa54-4541-9e80-0906cda5ba5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:19.993767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:19.995238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:19.996341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:19.996341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:19.996341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:19.996341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:19.996341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 642/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:20.001987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1debb69-a332-4149-b80f-bd97047d1271 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:20.116716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1debb69-a332-4149-b80f-bd97047d1271 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:20.153866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c43e1e-1938-4bdf-bcfe-7da8ea2bc9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:20.154519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43e1e-1938-4bdf-bcfe-7da8ea2bc9dc None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:20.154799 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43e1e-1938-4bdf-bcfe-7da8ea2bc9dc None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:20.155070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43e1e-1938-4bdf-bcfe-7da8ea2bc9dc None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:20.155793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c43e1e-1938-4bdf-bcfe-7da8ea2bc9dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:20.156096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c43e1e-1938-4bdf-bcfe-7da8ea2bc9dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:20.157511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c43e1e-1938-4bdf-bcfe-7da8ea2bc9dc None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:20.181053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 637/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:20.189647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e346565-fa54-4541-9e80-0906cda5ba5a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:20.226124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:20.332805 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e346565-fa54-4541-9e80-0906cda5ba5a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:20.378754 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef77c9-4929-49d5-9afa-fdb672b6fb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:20.379502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef77c9-4929-49d5-9afa-fdb672b6fb6f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:20.379788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef77c9-4929-49d5-9afa-fdb672b6fb6f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:20.380067 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef77c9-4929-49d5-9afa-fdb672b6fb6f None admin] PATH_INFO: `/v3/users/placement` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:20.389904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef77c9-4929-49d5-9afa-fdb672b6fb6f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:20.391516 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef77c9-4929-49d5-9afa-fdb672b6fb6f None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-dcef77c9-4929-49d5-9afa-fdb672b6fb6f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:20.408440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:20.418732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:20.420966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:20.420966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:20.420966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:20.420966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:20.420966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:20.420966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:20.420966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:20.420966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:20.420966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 20:43:20.420966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:20.420966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 643/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:20.424668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c43e1e-1938-4bdf-bcfe-7da8ea2bc9dc None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:20.432105 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:20.572506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c43e1e-1938-4bdf-bcfe-7da8ea2bc9dc None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:20.618984 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c803a3-510f-47c5-9c49-cc6736c64f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:20.619673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c803a3-510f-47c5-9c49-cc6736c64f72 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:20.619954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c803a3-510f-47c5-9c49-cc6736c64f72 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:20.620230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c803a3-510f-47c5-9c49-cc6736c64f72 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:20.621093 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c803a3-510f-47c5-9c49-cc6736c64f72 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:20.621497 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c803a3-510f-47c5-9c49-cc6736c64f72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:20.622924 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c803a3-510f-47c5-9c49-cc6736c64f72 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:20.645342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 638/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Tue May 31 20:43:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:20.652357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef77c9-4929-49d5-9afa-fdb672b6fb6f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:20.904451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:20.915848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef77c9-4929-49d5-9afa-fdb672b6fb6f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:20.952997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a1d0f-9e37-43bf-967a-195de41bf648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:20.953694 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a1d0f-9e37-43bf-967a-195de41bf648 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:20.953971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a1d0f-9e37-43bf-967a-195de41bf648 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:20.954246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a1d0f-9e37-43bf-967a-195de41bf648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.033992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a1d0f-9e37-43bf-967a-195de41bf648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.035488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a1d0f-9e37-43bf-967a-195de41bf648 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.134062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:21.145263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 644/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Tue May 31 20:43:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 31 20:43:21.152121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c803a3-510f-47c5-9c49-cc6736c64f72 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:21.221888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:21.265460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c803a3-510f-47c5-9c49-cc6736c64f72 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:21.302959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e104730-6cce-4307-9b78-1f910e17ea67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:21.304179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e104730-6cce-4307-9b78-1f910e17ea67 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:21.304653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e104730-6cce-4307-9b78-1f910e17ea67 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:21.305120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e104730-6cce-4307-9b78-1f910e17ea67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.318221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e104730-6cce-4307-9b78-1f910e17ea67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.320690 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e104730-6cce-4307-9b78-1f910e17ea67 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-8e104730-6cce-4307-9b78-1f910e17ea67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:21.340982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:21.342765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:21.344571 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:21.344571 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:21.344571 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:21.344571 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:43:21.344571 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 639/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:21.348759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a1d0f-9e37-43bf-967a-195de41bf648 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:21.467565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a1d0f-9e37-43bf-967a-195de41bf648 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:21.509542 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66bce3-2509-40ab-9137-5c21f28abe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:21.510153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66bce3-2509-40ab-9137-5c21f28abe7f None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:21.510434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66bce3-2509-40ab-9137-5c21f28abe7f None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:21.510711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66bce3-2509-40ab-9137-5c21f28abe7f None admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.511472 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66bce3-2509-40ab-9137-5c21f28abe7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:21.511780 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66bce3-2509-40ab-9137-5c21f28abe7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.513276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66bce3-2509-40ab-9137-5c21f28abe7f None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.526332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 645/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Tue May 31 20:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:21.532997 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e104730-6cce-4307-9b78-1f910e17ea67 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:21.660804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e104730-6cce-4307-9b78-1f910e17ea67 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:21.679698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:21.705792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119d356-8bf2-43f0-9b0c-47426fe6b646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:21.706672 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119d356-8bf2-43f0-9b0c-47426fe6b646 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:21.706999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119d356-8bf2-43f0-9b0c-47426fe6b646 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:21.707318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119d356-8bf2-43f0-9b0c-47426fe6b646 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.716148 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119d356-8bf2-43f0-9b0c-47426fe6b646 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.717910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119d356-8bf2-43f0-9b0c-47426fe6b646 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-7119d356-8bf2-43f0-9b0c-47426fe6b646 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:21.734314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:21.736173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:21.737524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:21.737524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:21.737524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:21.737524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:21.737524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:21.737524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:21.737524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:21.737524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: ERROR keystone.server.flask.application May 31 20:43:21.737524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 640/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Tue May 31 20:43:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:21.742526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66bce3-2509-40ab-9137-5c21f28abe7f None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:21.803606 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:21.866353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66bce3-2509-40ab-9137-5c21f28abe7f None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:21.904500 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2b2fe-7b31-4c2b-b293-6aa37e5b27dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:21.905233 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2b2fe-7b31-4c2b-b293-6aa37e5b27dc None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:21.905589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2b2fe-7b31-4c2b-b293-6aa37e5b27dc None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:21.905941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2b2fe-7b31-4c2b-b293-6aa37e5b27dc None admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.906861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2b2fe-7b31-4c2b-b293-6aa37e5b27dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:21.907209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2b2fe-7b31-4c2b-b293-6aa37e5b27dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.908886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2b2fe-7b31-4c2b-b293-6aa37e5b27dc None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.924112 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 646/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Tue May 31 20:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:21.931711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119d356-8bf2-43f0-9b0c-47426fe6b646 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:22.050649 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119d356-8bf2-43f0-9b0c-47426fe6b646 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:22.092476 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c74bd7-f5fb-4961-b0ec-bef8ab14e842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:22.093632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c74bd7-f5fb-4961-b0ec-bef8ab14e842 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:22.094148 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c74bd7-f5fb-4961-b0ec-bef8ab14e842 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:22.094653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c74bd7-f5fb-4961-b0ec-bef8ab14e842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:22.096379 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c74bd7-f5fb-4961-b0ec-bef8ab14e842 None admin] RBAC: Adding query filter params (role.id=d6267bb2c2ba44d59374878eafd62b49, scope.project.id=69d14229f6554a34bf9084d36cffe8ac, user.id=619d0b5afa094289808516486a5e3c4a) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:22.097318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c74bd7-f5fb-4961-b0ec-bef8ab14e842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:22.099100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c74bd7-f5fb-4961-b0ec-bef8ab14e842 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:22.115758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 641/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Tue May 31 20:43:21 2022] GET /identity/v3/role_assignments?user.id=619d0b5afa094289808516486a5e3c4a&scope.project.id=69d14229f6554a34bf9084d36cffe8ac&role.id=d6267bb2c2ba44d59374878eafd62b49 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:24.477425 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3e3ec-29b9-4ab2-9488-3f31c4ebc6a4 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:24.478142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3e3ec-29b9-4ab2-9488-3f31c4ebc6a4 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:24.478142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3e3ec-29b9-4ab2-9488-3f31c4ebc6a4 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:24.479495 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 647/1288] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:24.485982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724f21f-78dc-4b99-863b-182462b04bd1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:24.486723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724f21f-78dc-4b99-863b-182462b04bd1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:24.486723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724f21f-78dc-4b99-863b-182462b04bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:24.504829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b724f21f-78dc-4b99-863b-182462b04bd1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:24.508689 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b724f21f-78dc-4b99-863b-182462b04bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:24.544541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:24.607339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 642/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:43:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:43:24.630105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3e3ec-29b9-4ab2-9488-3f31c4ebc6a4 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:24.745258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3e3ec-29b9-4ab2-9488-3f31c4ebc6a4 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:24.758533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:24.785686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b38f05-d539-4723-bff3-ad32b14014b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:24.786496 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b38f05-d539-4723-bff3-ad32b14014b8 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:24.786782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b38f05-d539-4723-bff3-ad32b14014b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:24.787098 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b38f05-d539-4723-bff3-ad32b14014b8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:24.787758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b38f05-d539-4723-bff3-ad32b14014b8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:24.789180 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b38f05-d539-4723-bff3-ad32b14014b8 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-b9b38f05-d539-4723-bff3-ad32b14014b8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:24.801931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:24.803726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:24.805555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 648/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Tue May 31 20:43:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:24.810033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724f21f-78dc-4b99-863b-182462b04bd1 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:24.921515 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724f21f-78dc-4b99-863b-182462b04bd1 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:24.957403 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc409d9-cc04-440c-b7bb-2d49debd1b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:24.958075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc409d9-cc04-440c-b7bb-2d49debd1b65 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:24.958400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc409d9-cc04-440c-b7bb-2d49debd1b65 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:24.958687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc409d9-cc04-440c-b7bb-2d49debd1b65 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:24.959402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc409d9-cc04-440c-b7bb-2d49debd1b65 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:24.959719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc409d9-cc04-440c-b7bb-2d49debd1b65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:24.961705 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc409d9-cc04-440c-b7bb-2d49debd1b65 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:24.967511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 643/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Tue May 31 20:43:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:24.973939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b38f05-d539-4723-bff3-ad32b14014b8 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:25.092571 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b38f05-d539-4723-bff3-ad32b14014b8 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:25.137703 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfa2f2-fd7f-4997-9a4b-30d126c7deb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:25.138501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfa2f2-fd7f-4997-9a4b-30d126c7deb2 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:25.138855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfa2f2-fd7f-4997-9a4b-30d126c7deb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:25.139069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfa2f2-fd7f-4997-9a4b-30d126c7deb2 None admin] PATH_INFO: `/v3/services` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:25.139804 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfa2f2-fd7f-4997-9a4b-30d126c7deb2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:25.140115 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfa2f2-fd7f-4997-9a4b-30d126c7deb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:25.141574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfa2f2-fd7f-4997-9a4b-30d126c7deb2 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:25.147331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 649/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Tue May 31 20:43:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:27.545711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d6a30-1841-478a-9ad1-ced7f59eaa8e None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:27.546352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d6a30-1841-478a-9ad1-ced7f59eaa8e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:27.546352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d6a30-1841-478a-9ad1-ced7f59eaa8e None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:27.547641 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 644/1293] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:27.554034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774a17b-9788-41ee-9abb-b0d8af3f932b None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:27.554594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774a17b-9788-41ee-9abb-b0d8af3f932b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:27.558489 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774a17b-9788-41ee-9abb-b0d8af3f932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:27.579553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4774a17b-9788-41ee-9abb-b0d8af3f932b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:27.580799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4774a17b-9788-41ee-9abb-b0d8af3f932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:27.616674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:27.657702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 650/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:43:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:43:27.681468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d6a30-1841-478a-9ad1-ced7f59eaa8e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:27.715944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:27.795390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d6a30-1841-478a-9ad1-ced7f59eaa8e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:27.836465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5455427-e075-449b-9994-9797cdcf52aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:27.837587 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5455427-e075-449b-9994-9797cdcf52aa None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:27.838096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5455427-e075-449b-9994-9797cdcf52aa None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:27.838643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5455427-e075-449b-9994-9797cdcf52aa None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:27.840225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5455427-e075-449b-9994-9797cdcf52aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:27.842775 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5455427-e075-449b-9994-9797cdcf52aa None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:27.953612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 645/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Tue May 31 20:43:27 2022] POST /identity/v3/services => generated 246 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:43:30.307812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b02f6-b9ae-45a2-ba3c-8271d6f1756e None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.308262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b02f6-b9ae-45a2-ba3c-8271d6f1756e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.308378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b02f6-b9ae-45a2-ba3c-8271d6f1756e None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.309847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 651/1296] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:30.315934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56fe53-dcce-4d57-b92c-4acd9929b6f4 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.316456 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56fe53-dcce-4d57-b92c-4acd9929b6f4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.316548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56fe53-dcce-4d57-b92c-4acd9929b6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.334550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-eb56fe53-dcce-4d57-b92c-4acd9929b6f4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:30.335743 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-eb56fe53-dcce-4d57-b92c-4acd9929b6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:30.416910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 646/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:43:30 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:43:30.440106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b02f6-b9ae-45a2-ba3c-8271d6f1756e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:30.568466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b02f6-b9ae-45a2-ba3c-8271d6f1756e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:30.607635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cd670-401f-49fb-b4bf-adf930e3221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:30.608477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cd670-401f-49fb-b4bf-adf930e3221a None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.608760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cd670-401f-49fb-b4bf-adf930e3221a None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.609037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cd670-401f-49fb-b4bf-adf930e3221a None admin] PATH_INFO: `/v3/services/placement` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.609738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cd670-401f-49fb-b4bf-adf930e3221a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:30.611222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cd670-401f-49fb-b4bf-adf930e3221a None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-293cd670-401f-49fb-b4bf-adf930e3221a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:30.633081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:30.639346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:43:30.640264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:30.643888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 652/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Tue May 31 20:43:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:30.645238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56fe53-dcce-4d57-b92c-4acd9929b6f4 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:30.667915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:30.789186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56fe53-dcce-4d57-b92c-4acd9929b6f4 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:30.825081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9aa38-429e-4155-b49e-00d69573d8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:30.825792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9aa38-429e-4155-b49e-00d69573d8ee None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.826079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9aa38-429e-4155-b49e-00d69573d8ee None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.826356 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9aa38-429e-4155-b49e-00d69573d8ee None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.827072 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9aa38-429e-4155-b49e-00d69573d8ee None admin] RBAC: Adding query filter params (name=placement) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:30.827380 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9aa38-429e-4155-b49e-00d69573d8ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:30.828782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9aa38-429e-4155-b49e-00d69573d8ee None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:30.834522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 647/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Tue May 31 20:43:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:30.841258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cd670-401f-49fb-b4bf-adf930e3221a None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:30.878002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:30.968833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cd670-401f-49fb-b4bf-adf930e3221a None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:31.012238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568ca9a-763b-47ec-8fcb-f8721f7db2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:31.012933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568ca9a-763b-47ec-8fcb-f8721f7db2f9 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:31.013217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568ca9a-763b-47ec-8fcb-f8721f7db2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:31.013534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568ca9a-763b-47ec-8fcb-f8721f7db2f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:31.014408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568ca9a-763b-47ec-8fcb-f8721f7db2f9 None admin] RBAC: Adding query filter params (interface=public, service_id=d9bb9185027f47769ae9e451249936d7, region_id=RegionOne) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:31.014696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568ca9a-763b-47ec-8fcb-f8721f7db2f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:31.016137 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568ca9a-763b-47ec-8fcb-f8721f7db2f9 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:31.022661 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 653/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Tue May 31 20:43:30 2022] GET /identity/v3/endpoints?service_id=d9bb9185027f47769ae9e451249936d7&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:31.030625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9aa38-429e-4155-b49e-00d69573d8ee None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:31.137666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:31.168136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9aa38-429e-4155-b49e-00d69573d8ee None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:31.207069 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd83fc-a69d-460e-acc8-b235673b5e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:31.208086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd83fc-a69d-460e-acc8-b235673b5e42 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:31.208375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd83fc-a69d-460e-acc8-b235673b5e42 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:31.208654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd83fc-a69d-460e-acc8-b235673b5e42 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:31.209341 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd83fc-a69d-460e-acc8-b235673b5e42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:31.210755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd83fc-a69d-460e-acc8-b235673b5e42 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:31.219323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 648/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Tue May 31 20:43:31 2022] GET /identity/v3/services => generated 2191 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:43:33.567089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70349cd2-bfec-486c-88f7-d0742477693e None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:33.567685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70349cd2-bfec-486c-88f7-d0742477693e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:33.567685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70349cd2-bfec-486c-88f7-d0742477693e None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:33.568947 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 654/1302] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:33.575342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcf747-6649-4b20-8474-4493133bf500 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:33.576005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcf747-6649-4b20-8474-4493133bf500 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:33.576005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcf747-6649-4b20-8474-4493133bf500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:33.594457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-0fbcf747-6649-4b20-8474-4493133bf500 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:33.595753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0fbcf747-6649-4b20-8474-4493133bf500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:33.670998 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 649/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:43:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:43:33.701143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70349cd2-bfec-486c-88f7-d0742477693e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:33.805096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:33.812888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70349cd2-bfec-486c-88f7-d0742477693e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:33.848604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70357f-c7b9-43bb-9ea8-ac49e6c49408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:33.849334 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70357f-c7b9-43bb-9ea8-ac49e6c49408 None admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:33.849628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70357f-c7b9-43bb-9ea8-ac49e6c49408 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:33.849907 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70357f-c7b9-43bb-9ea8-ac49e6c49408 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:33.850563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70357f-c7b9-43bb-9ea8-ac49e6c49408 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:33.851954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70357f-c7b9-43bb-9ea8-ac49e6c49408 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application [None req-db70357f-c7b9-43bb-9ea8-ac49e6c49408 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:33.866374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:33.868149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application with Lock( May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:43:33.870575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: ERROR keystone.server.flask.application May 31 20:43:33.873312 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 655/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Tue May 31 20:43:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:33.876350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcf747-6649-4b20-8474-4493133bf500 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:33.982195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:34.007076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcf747-6649-4b20-8474-4493133bf500 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:34.045163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a50bde-e17e-453a-8493-6affe400e45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:34.045869 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a50bde-e17e-453a-8493-6affe400e45a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:34.046157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a50bde-e17e-453a-8493-6affe400e45a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:34.046440 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a50bde-e17e-453a-8493-6affe400e45a None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:34.047156 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a50bde-e17e-453a-8493-6affe400e45a None admin] RBAC: Adding query filter params (name=placement) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:34.047470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a50bde-e17e-453a-8493-6affe400e45a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:34.048865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a50bde-e17e-453a-8493-6affe400e45a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:34.054674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 650/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Tue May 31 20:43:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:34.061447 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70357f-c7b9-43bb-9ea8-ac49e6c49408 None admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:34.171664 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70357f-c7b9-43bb-9ea8-ac49e6c49408 None admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:34.209236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4fd5a-5a09-4578-aab2-6a713a0b6153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:34.209951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4fd5a-5a09-4578-aab2-6a713a0b6153 None admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:34.210237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4fd5a-5a09-4578-aab2-6a713a0b6153 None admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:34.210514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4fd5a-5a09-4578-aab2-6a713a0b6153 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:34.211273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4fd5a-5a09-4578-aab2-6a713a0b6153 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:34.212684 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4fd5a-5a09-4578-aab2-6a713a0b6153 None admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:34.335353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 656/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Tue May 31 20:43:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:43:44.089644 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=30 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:44.330306 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:26.894634 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13e1bd-4cb7-4715-b509-2cab6371acff None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:26.895972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13e1bd-4cb7-4715-b509-2cab6371acff None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:26.896485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13e1bd-4cb7-4715-b509-2cab6371acff None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:26.903854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a3904-6305-4b66-a2d9-3539bd8fed98 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:26.904812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a3904-6305-4b66-a2d9-3539bd8fed98 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:26.905313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a3904-6305-4b66-a2d9-3539bd8fed98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:26.909780 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 651/1307] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:50:26 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:50:26.981953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b64a3904-6305-4b66-a2d9-3539bd8fed98 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:50:26.983550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b64a3904-6305-4b66-a2d9-3539bd8fed98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:27.105757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 657/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:50:27.145180 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805419b-428b-4115-bc11-bb61db727919 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:27.145459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805419b-428b-4115-bc11-bb61db727919 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:27.145876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805419b-428b-4115-bc11-bb61db727919 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:27.147601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 652/1309] 10.222.0.39 () {54 vars in 964 bytes} [Tue May 31 20:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:50:27.154075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e3928-d941-4735-a7e0-21568250d30b None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:27.154644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e3928-d941-4735-a7e0-21568250d30b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:27.155075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e3928-d941-4735-a7e0-21568250d30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:27.307005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-c39e3928-d941-4735-a7e0-21568250d30b None None] MFA Rules not processed for user `16a77c08d2844e7cb81ac1370c527cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:50:27.308702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c39e3928-d941-4735-a7e0-21568250d30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:27.342605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:27.432058 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 658/1310] 10.222.0.39 () {58 vars in 1061 bytes} [Tue May 31 20:50:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:50:27.432766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805419b-428b-4115-bc11-bb61db727919 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:50:27.434545 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a805419b-428b-4115-bc11-bb61db727919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:27.573797 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805419b-428b-4115-bc11-bb61db727919 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:50:27.657261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3545b-7f6a-4633-8d4b-2cceab58c264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:50:27.658043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3545b-7f6a-4633-8d4b-2cceab58c264 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:27.658349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3545b-7f6a-4633-8d4b-2cceab58c264 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:27.658721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3545b-7f6a-4633-8d4b-2cceab58c264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:27.660351 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-eec3545b-7f6a-4633-8d4b-2cceab58c264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:27.722567 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:27.780128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3545b-7f6a-4633-8d4b-2cceab58c264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:50:27.781708 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3545b-7f6a-4633-8d4b-2cceab58c264 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:50:27.802765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 653/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:50:30.356589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288ae5-0047-4500-83ee-d277f7fcd145 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:30.357116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288ae5-0047-4500-83ee-d277f7fcd145 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:30.357116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288ae5-0047-4500-83ee-d277f7fcd145 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:30.358669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 659/1312] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:50:30.364404 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56870b5f-cbbc-41fe-8ae2-6498c7075a1b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:30.364841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56870b5f-cbbc-41fe-8ae2-6498c7075a1b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:30.364965 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56870b5f-cbbc-41fe-8ae2-6498c7075a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:30.452959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-56870b5f-cbbc-41fe-8ae2-6498c7075a1b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:50:30.454218 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-56870b5f-cbbc-41fe-8ae2-6498c7075a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:30.552846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 654/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:50:30.591052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c288ae5-0047-4500-83ee-d277f7fcd145 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:50:30.592626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6c288ae5-0047-4500-83ee-d277f7fcd145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:30.699143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c288ae5-0047-4500-83ee-d277f7fcd145 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:50:30.769507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:30.772075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584c422-1ea7-4cb5-b49a-a974fda86e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:50:30.772718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584c422-1ea7-4cb5-b49a-a974fda86e5f service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:30.772999 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584c422-1ea7-4cb5-b49a-a974fda86e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:30.773271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584c422-1ea7-4cb5-b49a-a974fda86e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:30.774953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2584c422-1ea7-4cb5-b49a-a974fda86e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:30.886776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584c422-1ea7-4cb5-b49a-a974fda86e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:50:30.888213 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584c422-1ea7-4cb5-b49a-a974fda86e5f service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:50:30.907431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 660/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:50:33.740183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3b63e-1b43-468c-9034-0856ffef68bf None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:33.740713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3b63e-1b43-468c-9034-0856ffef68bf None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:33.740810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3b63e-1b43-468c-9034-0856ffef68bf None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:33.742178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 655/1315] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:50:33.747868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306de45-435d-49d2-909e-0c9bbec39fff None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:33.748325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306de45-435d-49d2-909e-0c9bbec39fff None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:33.748422 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306de45-435d-49d2-909e-0c9bbec39fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:33.821611 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4306de45-435d-49d2-909e-0c9bbec39fff None None] MFA Rules not processed for user `f181777203f94db981ca69cf76ab0e44`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:50:33.822794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4306de45-435d-49d2-909e-0c9bbec39fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:33.873873 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:33.921678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 661/1316] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:50:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:50:33.961582 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3b63e-1b43-468c-9034-0856ffef68bf None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:50:33.963149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f5d3b63e-1b43-468c-9034-0856ffef68bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:33.974198 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:34.073803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3b63e-1b43-468c-9034-0856ffef68bf None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:50:34.148798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c361e-7b4f-4392-b342-20374875d9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:50:34.149487 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c361e-7b4f-4392-b342-20374875d9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:34.149773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c361e-7b4f-4392-b342-20374875d9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:34.150046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c361e-7b4f-4392-b342-20374875d9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:34.151698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-198c361e-7b4f-4392-b342-20374875d9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:34.215891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:34.263438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c361e-7b4f-4392-b342-20374875d9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:50:34.264878 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c361e-7b4f-4392-b342-20374875d9c6 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:50:34.283327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 656/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:50:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:50:37.346272 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c757f3-f942-4a0f-93a2-135b54b75313 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:37.346776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c757f3-f942-4a0f-93a2-135b54b75313 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:37.346776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c757f3-f942-4a0f-93a2-135b54b75313 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:37.348191 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 662/1318] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:50:37.353689 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daed668-3e5f-4edb-aa20-8e7ad33cb771 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:37.354121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daed668-3e5f-4edb-aa20-8e7ad33cb771 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:37.354246 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daed668-3e5f-4edb-aa20-8e7ad33cb771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:37.419689 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7daed668-3e5f-4edb-aa20-8e7ad33cb771 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:50:37.420897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7daed668-3e5f-4edb-aa20-8e7ad33cb771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:37.519861 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 657/1319] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:50:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:50:37.558286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c757f3-f942-4a0f-93a2-135b54b75313 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:50:37.560068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-10c757f3-f942-4a0f-93a2-135b54b75313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:37.663977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c757f3-f942-4a0f-93a2-135b54b75313 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:50:37.737025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ea6c5-1cf6-45f8-a82a-190fb011d126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:50:37.737775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ea6c5-1cf6-45f8-a82a-190fb011d126 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:37.738061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ea6c5-1cf6-45f8-a82a-190fb011d126 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:37.738339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ea6c5-1cf6-45f8-a82a-190fb011d126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:37.740079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-462ea6c5-1cf6-45f8-a82a-190fb011d126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:37.748933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:37.849308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ea6c5-1cf6-45f8-a82a-190fb011d126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:50:37.850777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ea6c5-1cf6-45f8-a82a-190fb011d126 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:50:37.869236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 663/1320] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:50:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:50:41.211846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f57da-7e78-4e88-a688-b2ce9c59a232 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:41.212373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f57da-7e78-4e88-a688-b2ce9c59a232 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:41.212494 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f57da-7e78-4e88-a688-b2ce9c59a232 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:41.213876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 658/1321] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:50:41.219863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15affd-80b0-4fa3-a162-9f9ceb42a3ea None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:41.220314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15affd-80b0-4fa3-a162-9f9ceb42a3ea None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:41.220421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15affd-80b0-4fa3-a162-9f9ceb42a3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:41.285920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-5e15affd-80b0-4fa3-a162-9f9ceb42a3ea None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:50:41.287122 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5e15affd-80b0-4fa3-a162-9f9ceb42a3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:41.350532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:41.392487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 664/1322] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:50:41.428558 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f57da-7e78-4e88-a688-b2ce9c59a232 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:50:41.430162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0c2f57da-7e78-4e88-a688-b2ce9c59a232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:41.449924 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:41.536653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f57da-7e78-4e88-a688-b2ce9c59a232 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:50:41.614374 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7e45f-3a8c-4e33-8d4b-3a351d984890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:50:41.614934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e45f-3a8c-4e33-8d4b-3a351d984890 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:41.615212 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e45f-3a8c-4e33-8d4b-3a351d984890 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:41.615479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e45f-3a8c-4e33-8d4b-3a351d984890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:41.617088 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1bf7e45f-3a8c-4e33-8d4b-3a351d984890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:41.690227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:41.729278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7e45f-3a8c-4e33-8d4b-3a351d984890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:50:41.730785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7e45f-3a8c-4e33-8d4b-3a351d984890 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:50:41.752006 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 659/1323] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:50:44.101154 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357cdc2-b964-409c-8756-4bff50cfa181 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:44.101822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357cdc2-b964-409c-8756-4bff50cfa181 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:44.101822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357cdc2-b964-409c-8756-4bff50cfa181 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:44.103165 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 665/1324] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:50:44.108491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd741e8-3ffd-4be6-99e0-28aee58b1f48 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:44.109048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd741e8-3ffd-4be6-99e0-28aee58b1f48 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:44.109159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd741e8-3ffd-4be6-99e0-28aee58b1f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:44.175248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-5fd741e8-3ffd-4be6-99e0-28aee58b1f48 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:50:44.176454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5fd741e8-3ffd-4be6-99e0-28aee58b1f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:44.282525 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 660/1325] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:50:44.319547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357cdc2-b964-409c-8756-4bff50cfa181 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:50:44.321153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1357cdc2-b964-409c-8756-4bff50cfa181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:44.426710 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357cdc2-b964-409c-8756-4bff50cfa181 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:50:44.502308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9d2a4-2dbe-4de3-942e-83cc2ec5725a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:50:44.502954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9d2a4-2dbe-4de3-942e-83cc2ec5725a service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:44.503237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9d2a4-2dbe-4de3-942e-83cc2ec5725a service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:44.503509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9d2a4-2dbe-4de3-942e-83cc2ec5725a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:44.505142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5ab9d2a4-2dbe-4de3-942e-83cc2ec5725a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:44.521314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:44.614385 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9d2a4-2dbe-4de3-942e-83cc2ec5725a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:50:44.615816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9d2a4-2dbe-4de3-942e-83cc2ec5725a service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:50:44.634784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 666/1326] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:50:46.939011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fd91b-27e9-42bb-8f47-1c0ca94eb679 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:46.939571 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fd91b-27e9-42bb-8f47-1c0ca94eb679 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:46.939571 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fd91b-27e9-42bb-8f47-1c0ca94eb679 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:46.941043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 661/1327] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:50:46.946223 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ae4a5-0d1e-439f-865e-9ea16a114214 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:46.946673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ae4a5-0d1e-439f-865e-9ea16a114214 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:46.946785 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ae4a5-0d1e-439f-865e-9ea16a114214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:47.011362 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b93ae4a5-0d1e-439f-865e-9ea16a114214 None None] MFA Rules not processed for user `f181777203f94db981ca69cf76ab0e44`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:50:47.012546 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b93ae4a5-0d1e-439f-865e-9ea16a114214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:47.076967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:47.111201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 667/1328] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:50:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:50:47.148321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fd91b-27e9-42bb-8f47-1c0ca94eb679 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:50:47.150054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7a6fd91b-27e9-42bb-8f47-1c0ca94eb679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:47.185174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:47.258436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fd91b-27e9-42bb-8f47-1c0ca94eb679 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:50:47.334292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c9693-9d56-4fd0-8be4-9e1b1dc54322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:50:47.335211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c9693-9d56-4fd0-8be4-9e1b1dc54322 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:47.335499 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c9693-9d56-4fd0-8be4-9e1b1dc54322 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:47.335773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c9693-9d56-4fd0-8be4-9e1b1dc54322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:47.337458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cc3c9693-9d56-4fd0-8be4-9e1b1dc54322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:47.414913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:47.447020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c9693-9d56-4fd0-8be4-9e1b1dc54322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:50:47.448527 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c9693-9d56-4fd0-8be4-9e1b1dc54322 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:50:47.467996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 662/1329] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:50:47 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:50:50.191074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c21a2-30d2-424b-8b40-dba7f861f78f None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:50.191600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c21a2-30d2-424b-8b40-dba7f861f78f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:50.191600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c21a2-30d2-424b-8b40-dba7f861f78f None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:50.193003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 668/1330] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:50:50.198661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc7088-e95f-496a-8789-9693e1048b18 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:50.199114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc7088-e95f-496a-8789-9693e1048b18 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:50.199215 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc7088-e95f-496a-8789-9693e1048b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:50.264781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-3edc7088-e95f-496a-8789-9693e1048b18 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:50:50.266520 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-3edc7088-e95f-496a-8789-9693e1048b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:50.365125 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 663/1331] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:50:50.401733 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c21a2-30d2-424b-8b40-dba7f861f78f None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:50:50.403262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-308c21a2-30d2-424b-8b40-dba7f861f78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:50.506669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c21a2-30d2-424b-8b40-dba7f861f78f None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:50:50.582971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b82714-158d-4eed-85da-4c2c1f0f7462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:50:50.583624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b82714-158d-4eed-85da-4c2c1f0f7462 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:50.583907 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b82714-158d-4eed-85da-4c2c1f0f7462 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:50.584181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b82714-158d-4eed-85da-4c2c1f0f7462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:50.586097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-23b82714-158d-4eed-85da-4c2c1f0f7462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:50.615704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:50.704875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b82714-158d-4eed-85da-4c2c1f0f7462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:50:50.706367 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b82714-158d-4eed-85da-4c2c1f0f7462 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:50:50.725956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 669/1332] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:50:53.053713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895be92-7aba-4d2d-b56c-a9760ee50409 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:53.054285 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895be92-7aba-4d2d-b56c-a9760ee50409 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:53.054285 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895be92-7aba-4d2d-b56c-a9760ee50409 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:53.055630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 664/1333] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:50:53.060918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4fa3-6790-45ac-9055-467025bc2793 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:53.061369 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4fa3-6790-45ac-9055-467025bc2793 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:53.061501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4fa3-6790-45ac-9055-467025bc2793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:53.128304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4b0f4fa3-6790-45ac-9055-467025bc2793 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:50:53.129520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4b0f4fa3-6790-45ac-9055-467025bc2793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:53.205963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:53.228603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 670/1334] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:50:53.270539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895be92-7aba-4d2d-b56c-a9760ee50409 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:50:53.272073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0895be92-7aba-4d2d-b56c-a9760ee50409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:53.312050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:53.377290 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895be92-7aba-4d2d-b56c-a9760ee50409 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:50:53.449770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92168197-d32a-4f7c-902b-17c7ea665bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:50:53.450417 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92168197-d32a-4f7c-902b-17c7ea665bfd service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:53.450702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92168197-d32a-4f7c-902b-17c7ea665bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:53.450977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92168197-d32a-4f7c-902b-17c7ea665bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:53.452599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-92168197-d32a-4f7c-902b-17c7ea665bfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:53.535777 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:53.561715 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92168197-d32a-4f7c-902b-17c7ea665bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:50:53.563136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92168197-d32a-4f7c-902b-17c7ea665bfd service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:50:53.581406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 665/1335] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:50:56.402704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019413c9-c52e-4b22-938e-e166a18f4676 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:56.403286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019413c9-c52e-4b22-938e-e166a18f4676 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:56.403286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019413c9-c52e-4b22-938e-e166a18f4676 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:56.404573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 671/1336] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:50:56.410338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff8d1b-13f4-41cb-84f4-e7ed47ab5d43 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:56.410795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff8d1b-13f4-41cb-84f4-e7ed47ab5d43 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:56.410906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff8d1b-13f4-41cb-84f4-e7ed47ab5d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:56.475299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-21ff8d1b-13f4-41cb-84f4-e7ed47ab5d43 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:50:56.476496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-21ff8d1b-13f4-41cb-84f4-e7ed47ab5d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:56.574928 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 666/1337] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:50:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:50:56.612018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019413c9-c52e-4b22-938e-e166a18f4676 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:50:56.613637 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-019413c9-c52e-4b22-938e-e166a18f4676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:56.715280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019413c9-c52e-4b22-938e-e166a18f4676 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:50:56.789156 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e04e90-74d4-4121-bce3-3c298746f562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:50:56.789836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e04e90-74d4-4121-bce3-3c298746f562 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:50:56.790116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e04e90-74d4-4121-bce3-3c298746f562 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:50:56.790389 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e04e90-74d4-4121-bce3-3c298746f562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:50:56.792040 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e6e04e90-74d4-4121-bce3-3c298746f562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:50:56.828462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:50:56.901209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e04e90-74d4-4121-bce3-3c298746f562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:50:56.902666 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e04e90-74d4-4121-bce3-3c298746f562 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:50:56.920685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 672/1338] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:50:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:01.590187 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35b0c-65b0-4946-ba01-8a9cf42df55b None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:01.590692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35b0c-65b0-4946-ba01-8a9cf42df55b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:01.590817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35b0c-65b0-4946-ba01-8a9cf42df55b None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:01.592114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 667/1339] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:01.598116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13434-e990-4cde-b85e-74f15cca6077 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:01.598604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13434-e990-4cde-b85e-74f15cca6077 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:01.598697 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13434-e990-4cde-b85e-74f15cca6077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:01.674741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-cce13434-e990-4cde-b85e-74f15cca6077 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:01.675973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-cce13434-e990-4cde-b85e-74f15cca6077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:01.775408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:51:01.788822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 673/1340] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:01.827714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e35b0c-65b0-4946-ba01-8a9cf42df55b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:01.829895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-01e35b0c-65b0-4946-ba01-8a9cf42df55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:01.880614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:51:01.926458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e35b0c-65b0-4946-ba01-8a9cf42df55b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:01.929983 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b49ca0-571b-4e29-ba8f-995e835383ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:01.930626 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b49ca0-571b-4e29-ba8f-995e835383ff service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:01.930910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b49ca0-571b-4e29-ba8f-995e835383ff service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:01.931187 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b49ca0-571b-4e29-ba8f-995e835383ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:01.940629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b49ca0-571b-4e29-ba8f-995e835383ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:01.942767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b49ca0-571b-4e29-ba8f-995e835383ff service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:01.953488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 668/1341] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:05.342628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c833ba-4a1e-4130-a753-ccddc51dea77 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:05.343181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c833ba-4a1e-4130-a753-ccddc51dea77 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:05.343181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c833ba-4a1e-4130-a753-ccddc51dea77 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:05.344809 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 674/1342] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:05.350024 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c79c43-e5aa-49eb-94e9-42d3260c5484 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:05.350455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c79c43-e5aa-49eb-94e9-42d3260c5484 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:05.350583 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c79c43-e5aa-49eb-94e9-42d3260c5484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:05.380835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c1c79c43-e5aa-49eb-94e9-42d3260c5484 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:05.382059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c1c79c43-e5aa-49eb-94e9-42d3260c5484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:05.461277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 669/1343] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:05.499270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c833ba-4a1e-4130-a753-ccddc51dea77 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:05.510128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c833ba-4a1e-4130-a753-ccddc51dea77 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:05.513682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58804e72-e70f-402d-955f-c0c4e57fcf74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:05.514408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804e72-e70f-402d-955f-c0c4e57fcf74 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:05.514758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804e72-e70f-402d-955f-c0c4e57fcf74 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:05.515111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804e72-e70f-402d-955f-c0c4e57fcf74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:05.524449 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58804e72-e70f-402d-955f-c0c4e57fcf74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:05.525959 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58804e72-e70f-402d-955f-c0c4e57fcf74 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:05.536030 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 675/1344] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:10.188596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee76fde-3880-43e2-b9cc-0f52d096d04c None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:10.189220 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee76fde-3880-43e2-b9cc-0f52d096d04c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:10.189220 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee76fde-3880-43e2-b9cc-0f52d096d04c None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:10.190614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 670/1345] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:10.195906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1814-c98f-45d3-8fcc-5573b45b8293 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:10.196343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1814-c98f-45d3-8fcc-5573b45b8293 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:10.196495 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1814-c98f-45d3-8fcc-5573b45b8293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:10.214293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-53ec1814-c98f-45d3-8fcc-5573b45b8293 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:10.215500 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-53ec1814-c98f-45d3-8fcc-5573b45b8293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:10.224038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 676/1346] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:10.262810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee76fde-3880-43e2-b9cc-0f52d096d04c None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:10.274077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee76fde-3880-43e2-b9cc-0f52d096d04c None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:10.277589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a04251-4455-4f37-aaca-73726fac40cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:10.278218 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a04251-4455-4f37-aaca-73726fac40cb service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:10.278502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a04251-4455-4f37-aaca-73726fac40cb service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:10.278778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a04251-4455-4f37-aaca-73726fac40cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:10.288311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a04251-4455-4f37-aaca-73726fac40cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:10.289769 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a04251-4455-4f37-aaca-73726fac40cb service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:10.299075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 671/1347] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 20:51:15.736666 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15523-dc05-45e8-98b4-640f7edda50b None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:15.737237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15523-dc05-45e8-98b4-640f7edda50b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:15.737678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15523-dc05-45e8-98b4-640f7edda50b None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:15.739169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 677/1348] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 20:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:15.744055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e95b1-7d28-4e53-85ce-dfc6e2ac820c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:15.744488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e95b1-7d28-4e53-85ce-dfc6e2ac820c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:15.745065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e95b1-7d28-4e53-85ce-dfc6e2ac820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:15.821161 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-db1e95b1-7d28-4e53-85ce-dfc6e2ac820c None None] MFA Rules not processed for user `619d0b5afa094289808516486a5e3c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:15.822456 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-db1e95b1-7d28-4e53-85ce-dfc6e2ac820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:15.852360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:51:15.903137 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 672/1349] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 20:51:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:20.209063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=13 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:51:20.333660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2fef7-8a14-4abd-87f7-9925f4560749 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:20.334083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2fef7-8a14-4abd-87f7-9925f4560749 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:20.334499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2fef7-8a14-4abd-87f7-9925f4560749 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:20.336151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 678/1350] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 20:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:20.341163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0a5e5-e1a8-400b-bc86-3a5b1fcd567a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:20.341979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0a5e5-e1a8-400b-bc86-3a5b1fcd567a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:20.342420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0a5e5-e1a8-400b-bc86-3a5b1fcd567a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:20.363003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-87e0a5e5-e1a8-400b-bc86-3a5b1fcd567a None None] MFA Rules not processed for user `619d0b5afa094289808516486a5e3c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:20.364465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-87e0a5e5-e1a8-400b-bc86-3a5b1fcd567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:20.373969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 673/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 20:51:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:22.342553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc790f-0f9f-46dc-9095-a5a7764ccfa8 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:22.343096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc790f-0f9f-46dc-9095-a5a7764ccfa8 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:22.343096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc790f-0f9f-46dc-9095-a5a7764ccfa8 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:22.344682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 679/1352] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 20:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:22.350528 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e3fa2-28f6-4066-a1d4-1dd54f2a127d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:22.350948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e3fa2-28f6-4066-a1d4-1dd54f2a127d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:22.351145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e3fa2-28f6-4066-a1d4-1dd54f2a127d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:22.369830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-499e3fa2-28f6-4066-a1d4-1dd54f2a127d None None] MFA Rules not processed for user `619d0b5afa094289808516486a5e3c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:22.371413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-499e3fa2-28f6-4066-a1d4-1dd54f2a127d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:22.380321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 674/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 20:51:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:26.041228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9187a-4453-44cc-975e-e5024b2b43e2 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:26.041838 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9187a-4453-44cc-975e-e5024b2b43e2 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:26.042201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9187a-4453-44cc-975e-e5024b2b43e2 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:26.044001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 680/1354] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:26.050211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6afa9a-56c8-4b46-bfa0-143995511ec4 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:26.050687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6afa9a-56c8-4b46-bfa0-143995511ec4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:26.050800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6afa9a-56c8-4b46-bfa0-143995511ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:26.070114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-1f6afa9a-56c8-4b46-bfa0-143995511ec4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:26.071259 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1f6afa9a-56c8-4b46-bfa0-143995511ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:26.081156 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 675/1355] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:26.140119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c258d-7826-4b5b-801f-001f40f7c6f5 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:26.140119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c258d-7826-4b5b-801f-001f40f7c6f5 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:26.140119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c258d-7826-4b5b-801f-001f40f7c6f5 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:26.141854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 681/1356] 10.222.0.39 () {54 vars in 961 bytes} [Tue May 31 20:51:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:26.150118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754a38-a1a4-40b5-952a-9fd5849acfdc None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:26.150475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754a38-a1a4-40b5-952a-9fd5849acfdc None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:26.150823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754a38-a1a4-40b5-952a-9fd5849acfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:26.206315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e0754a38-a1a4-40b5-952a-9fd5849acfdc None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:26.207872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e0754a38-a1a4-40b5-952a-9fd5849acfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:26.310907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 676/1357] 10.222.0.39 () {58 vars in 1058 bytes} [Tue May 31 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:26.313177 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c258d-7826-4b5b-801f-001f40f7c6f5 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:26.328864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c258d-7826-4b5b-801f-001f40f7c6f5 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:26.336336 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3f199-14fc-4ddf-9ac4-dc876ccf786d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:26.337234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3f199-14fc-4ddf-9ac4-dc876ccf786d service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:26.337741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3f199-14fc-4ddf-9ac4-dc876ccf786d service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:26.338222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3f199-14fc-4ddf-9ac4-dc876ccf786d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:26.349139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3f199-14fc-4ddf-9ac4-dc876ccf786d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:26.351862 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3f199-14fc-4ddf-9ac4-dc876ccf786d service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:26.363257 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 682/1358] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:28.859507 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765c78e-2894-4b0e-8dd6-afd44de735fd None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:28.860538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765c78e-2894-4b0e-8dd6-afd44de735fd None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:28.860822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765c78e-2894-4b0e-8dd6-afd44de735fd None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:28.862347 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 677/1359] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:28.868087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214f392-cb3a-4e96-b391-dbdfcbdf6f76 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:28.868515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214f392-cb3a-4e96-b391-dbdfcbdf6f76 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:28.868662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214f392-cb3a-4e96-b391-dbdfcbdf6f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:28.889731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-2214f392-cb3a-4e96-b391-dbdfcbdf6f76 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:28.891172 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2214f392-cb3a-4e96-b391-dbdfcbdf6f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:28.900303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 683/1360] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:28.945681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765c78e-2894-4b0e-8dd6-afd44de735fd None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:28.961679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765c78e-2894-4b0e-8dd6-afd44de735fd None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:28.967683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4db2bb-8101-40b1-bc6a-d701bb36ab38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:28.968413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4db2bb-8101-40b1-bc6a-d701bb36ab38 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:28.968854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4db2bb-8101-40b1-bc6a-d701bb36ab38 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:28.969199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4db2bb-8101-40b1-bc6a-d701bb36ab38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:28.978429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4db2bb-8101-40b1-bc6a-d701bb36ab38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:28.980200 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4db2bb-8101-40b1-bc6a-d701bb36ab38 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:28.991001 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 678/1361] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:31.733095 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4cadb-b1b5-4148-a851-ba2dca571653 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:31.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4cadb-b1b5-4148-a851-ba2dca571653 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:31.733622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4cadb-b1b5-4148-a851-ba2dca571653 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:31.734968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 684/1362] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:31.741170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65af7b5-b29a-472c-9c68-5ebed3583cd3 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:31.742265 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65af7b5-b29a-472c-9c68-5ebed3583cd3 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:31.742265 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65af7b5-b29a-472c-9c68-5ebed3583cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:31.761041 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c65af7b5-b29a-472c-9c68-5ebed3583cd3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:31.762308 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c65af7b5-b29a-472c-9c68-5ebed3583cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:31.770196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 679/1363] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:31.817196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d91180-0533-4839-977f-a9047a07ab50 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:31.817520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d91180-0533-4839-977f-a9047a07ab50 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:31.817804 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d91180-0533-4839-977f-a9047a07ab50 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:31.819255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 685/1364] 10.222.0.39 () {54 vars in 961 bytes} [Tue May 31 20:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:31.824640 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870c104-3470-4083-a2f9-e62022d42e2d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:31.827740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870c104-3470-4083-a2f9-e62022d42e2d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:31.827740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870c104-3470-4083-a2f9-e62022d42e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:31.843256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2870c104-3470-4083-a2f9-e62022d42e2d None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:31.844418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2870c104-3470-4083-a2f9-e62022d42e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:31.853985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 680/1365] 10.222.0.39 () {58 vars in 1058 bytes} [Tue May 31 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:31.862662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d91180-0533-4839-977f-a9047a07ab50 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:31.877031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d91180-0533-4839-977f-a9047a07ab50 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:31.882493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec35b7-ef5f-4f68-8b4a-cffc93894831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:31.883129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec35b7-ef5f-4f68-8b4a-cffc93894831 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:31.883415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec35b7-ef5f-4f68-8b4a-cffc93894831 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:31.883691 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec35b7-ef5f-4f68-8b4a-cffc93894831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:31.892110 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec35b7-ef5f-4f68-8b4a-cffc93894831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:31.893716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec35b7-ef5f-4f68-8b4a-cffc93894831 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:31.903266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 686/1366] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:34.475781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1302c-6daa-43bf-84cf-5e70d5bb5ae1 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:34.476344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1302c-6daa-43bf-84cf-5e70d5bb5ae1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:34.476429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1302c-6daa-43bf-84cf-5e70d5bb5ae1 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:34.479268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb50a8-e0c7-4ec9-8b4f-9032a7336767 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:34.479810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 681/1367] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:34.479900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb50a8-e0c7-4ec9-8b4f-9032a7336767 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:34.479900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb50a8-e0c7-4ec9-8b4f-9032a7336767 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:34.481247 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 687/1368] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:34.484035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0be0cd-82f9-4482-a6b1-ca90dd5e5ed3 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:34.484316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0be0cd-82f9-4482-a6b1-ca90dd5e5ed3 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:34.484654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0be0cd-82f9-4482-a6b1-ca90dd5e5ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:34.487147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28527ca2-2ce0-42f4-850e-fb7b0cbe2f93 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:34.487511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28527ca2-2ce0-42f4-850e-fb7b0cbe2f93 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:34.487857 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28527ca2-2ce0-42f4-850e-fb7b0cbe2f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:34.503658 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2f0be0cd-82f9-4482-a6b1-ca90dd5e5ed3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:34.504873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2f0be0cd-82f9-4482-a6b1-ca90dd5e5ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:34.509518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-28527ca2-2ce0-42f4-850e-fb7b0cbe2f93 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:34.510736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-28527ca2-2ce0-42f4-850e-fb7b0cbe2f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:34.512714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 682/1369] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:34.520426 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 688/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:51:34.570774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0be0cd-82f9-4482-a6b1-ca90dd5e5ed3 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:34.579454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0be0cd-82f9-4482-a6b1-ca90dd5e5ed3 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:34.585775 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10542a6c-0576-472c-a577-89d949891bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:34.586427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10542a6c-0576-472c-a577-89d949891bb2 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:34.586709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10542a6c-0576-472c-a577-89d949891bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:34.586980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10542a6c-0576-472c-a577-89d949891bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:34.596940 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10542a6c-0576-472c-a577-89d949891bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:34.598623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10542a6c-0576-472c-a577-89d949891bb2 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:34.608846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 683/1371] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:34.834343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076b2b1-0d33-4202-b445-adf158638978 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:34.834631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076b2b1-0d33-4202-b445-adf158638978 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:34.834911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076b2b1-0d33-4202-b445-adf158638978 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:34.836288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 689/1372] 10.222.0.39 () {54 vars in 963 bytes} [Tue May 31 20:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:34.841522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7345d7-2e37-4855-bed0-ad49eda8627e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:34.841901 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7345d7-2e37-4855-bed0-ad49eda8627e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:34.842249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7345d7-2e37-4855-bed0-ad49eda8627e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:34.853346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:51:34.909244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7b7345d7-2e37-4855-bed0-ad49eda8627e None None] MFA Rules not processed for user `7cfcecd035214e2181622eb6b30ddf62`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:34.910677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7b7345d7-2e37-4855-bed0-ad49eda8627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:34.987666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 684/1373] 10.222.0.39 () {58 vars in 1060 bytes} [Tue May 31 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:34.996134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076b2b1-0d33-4202-b445-adf158638978 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:35.008329 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076b2b1-0d33-4202-b445-adf158638978 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:35.012341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ae4ef-209c-4c3f-9556-0b55135eb671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:35.013006 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ae4ef-209c-4c3f-9556-0b55135eb671 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:35.013437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ae4ef-209c-4c3f-9556-0b55135eb671 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:35.013727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ae4ef-209c-4c3f-9556-0b55135eb671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:35.024959 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ae4ef-209c-4c3f-9556-0b55135eb671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:35.026461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ae4ef-209c-4c3f-9556-0b55135eb671 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:35.039565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 690/1374] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:37.127222 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51071a-60d6-4c15-87d1-4ae91ee155de None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:37.127856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51071a-60d6-4c15-87d1-4ae91ee155de None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:37.127856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51071a-60d6-4c15-87d1-4ae91ee155de None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:37.129204 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 685/1375] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:37.135074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bd263-7394-481b-8f3d-5e7604671b85 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:37.135649 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bd263-7394-481b-8f3d-5e7604671b85 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:37.135746 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bd263-7394-481b-8f3d-5e7604671b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:37.153947 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-802bd263-7394-481b-8f3d-5e7604671b85 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:37.155163 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-802bd263-7394-481b-8f3d-5e7604671b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:37.164847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 691/1376] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:37.210994 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51071a-60d6-4c15-87d1-4ae91ee155de None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:37.225892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51071a-60d6-4c15-87d1-4ae91ee155de None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:37.231838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb26c6-3ea1-4ba6-acd0-b29120ff4ff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:37.232508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb26c6-3ea1-4ba6-acd0-b29120ff4ff3 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:37.232887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb26c6-3ea1-4ba6-acd0-b29120ff4ff3 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:37.233169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb26c6-3ea1-4ba6-acd0-b29120ff4ff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:37.242160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb26c6-3ea1-4ba6-acd0-b29120ff4ff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:37.243744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb26c6-3ea1-4ba6-acd0-b29120ff4ff3 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:37.254579 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 686/1377] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:39.756824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05a54e-3d7b-4873-930e-c7c929f0ef17 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:39.757416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05a54e-3d7b-4873-930e-c7c929f0ef17 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:39.757416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05a54e-3d7b-4873-930e-c7c929f0ef17 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:39.758935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 692/1378] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:39.763951 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b91c8-ba72-4279-8492-214b71ab584f None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:39.764734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b91c8-ba72-4279-8492-214b71ab584f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:39.765010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b91c8-ba72-4279-8492-214b71ab584f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:39.785006 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-402b91c8-ba72-4279-8492-214b71ab584f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:39.786320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-402b91c8-ba72-4279-8492-214b71ab584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:39.794560 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 687/1379] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:39.839345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05a54e-3d7b-4873-930e-c7c929f0ef17 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:39.854435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05a54e-3d7b-4873-930e-c7c929f0ef17 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:39.859960 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d592e5-4bae-4cf9-bd5d-e327a2179fd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:39.860621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d592e5-4bae-4cf9-bd5d-e327a2179fd2 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:39.860910 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d592e5-4bae-4cf9-bd5d-e327a2179fd2 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:39.861189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d592e5-4bae-4cf9-bd5d-e327a2179fd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:39.869605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d592e5-4bae-4cf9-bd5d-e327a2179fd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:39.871454 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d592e5-4bae-4cf9-bd5d-e327a2179fd2 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:39.881835 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 693/1380] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:42.368657 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888f5bd-cc44-4935-9b8a-94b5f1ecf1ec None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:42.369184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888f5bd-cc44-4935-9b8a-94b5f1ecf1ec None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:42.369184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888f5bd-cc44-4935-9b8a-94b5f1ecf1ec None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:42.370615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 688/1381] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:51:42.376177 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90092828-a876-485e-a1be-8a0df693d3e6 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:42.376650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90092828-a876-485e-a1be-8a0df693d3e6 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:42.376747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90092828-a876-485e-a1be-8a0df693d3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:42.394656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-90092828-a876-485e-a1be-8a0df693d3e6 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:42.395869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-90092828-a876-485e-a1be-8a0df693d3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:42.403815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 694/1382] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:42.447287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888f5bd-cc44-4935-9b8a-94b5f1ecf1ec None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:42.462544 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888f5bd-cc44-4935-9b8a-94b5f1ecf1ec None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:42.468219 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d7d7a-e4d6-4cba-a922-34ec7be1a296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:42.469102 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d7d7a-e4d6-4cba-a922-34ec7be1a296 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:42.469606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d7d7a-e4d6-4cba-a922-34ec7be1a296 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:42.470077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d7d7a-e4d6-4cba-a922-34ec7be1a296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:42.479317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d7d7a-e4d6-4cba-a922-34ec7be1a296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:42.481097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d7d7a-e4d6-4cba-a922-34ec7be1a296 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:42.491047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 689/1383] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:44.805155 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa952c3-7a03-4445-953c-5b193bc0c376 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:44.805752 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa952c3-7a03-4445-953c-5b193bc0c376 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:44.806094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa952c3-7a03-4445-953c-5b193bc0c376 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:44.808183 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 695/1384] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:44.814021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d262c8-9a62-47d3-80b8-bb57c5dec5c5 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:44.815201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d262c8-9a62-47d3-80b8-bb57c5dec5c5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:44.815201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d262c8-9a62-47d3-80b8-bb57c5dec5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:44.833788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d5d262c8-9a62-47d3-80b8-bb57c5dec5c5 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:44.835055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d5d262c8-9a62-47d3-80b8-bb57c5dec5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:44.843883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 690/1385] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:44.891173 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa952c3-7a03-4445-953c-5b193bc0c376 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:44.928658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa952c3-7a03-4445-953c-5b193bc0c376 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:44.939093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f126d7-0e50-4a9a-a072-a9666ac84898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:44.940097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f126d7-0e50-4a9a-a072-a9666ac84898 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:44.941118 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f126d7-0e50-4a9a-a072-a9666ac84898 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:44.941118 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f126d7-0e50-4a9a-a072-a9666ac84898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:44.951220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f126d7-0e50-4a9a-a072-a9666ac84898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:44.953157 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f126d7-0e50-4a9a-a072-a9666ac84898 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:44.964337 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 696/1386] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:47.589573 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e55127-c971-433f-8d71-592be9e813ac None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:47.590137 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e55127-c971-433f-8d71-592be9e813ac None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:47.590309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e55127-c971-433f-8d71-592be9e813ac None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:47.592422 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 691/1387] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:47.600684 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b065b1-6c86-44b7-a232-24fe4c50acda None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:47.601243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b065b1-6c86-44b7-a232-24fe4c50acda None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:47.601470 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b065b1-6c86-44b7-a232-24fe4c50acda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:47.622652 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-f7b065b1-6c86-44b7-a232-24fe4c50acda None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:47.623932 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-f7b065b1-6c86-44b7-a232-24fe4c50acda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:47.632705 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 697/1388] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:47.738686 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e55127-c971-433f-8d71-592be9e813ac None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:47.761690 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e55127-c971-433f-8d71-592be9e813ac None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:47.770112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31c81b-39c6-4aa4-b09e-4a38d5dd597c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:47.771016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31c81b-39c6-4aa4-b09e-4a38d5dd597c service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:47.771449 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31c81b-39c6-4aa4-b09e-4a38d5dd597c service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:47.771821 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31c81b-39c6-4aa4-b09e-4a38d5dd597c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:47.785866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31c81b-39c6-4aa4-b09e-4a38d5dd597c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:47.790594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31c81b-39c6-4aa4-b09e-4a38d5dd597c service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:47.818794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 692/1389] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:50.449260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a801033-c4cf-42d8-90f5-caa6bc8e8905 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:50.449892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a801033-c4cf-42d8-90f5-caa6bc8e8905 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:50.450058 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a801033-c4cf-42d8-90f5-caa6bc8e8905 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:50.451516 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 698/1390] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:50.458055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f4d0a-675b-456d-85d9-2e4281a19843 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:50.458539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f4d0a-675b-456d-85d9-2e4281a19843 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:50.458746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f4d0a-675b-456d-85d9-2e4281a19843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:50.477068 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-812f4d0a-675b-456d-85d9-2e4281a19843 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:50.478321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-812f4d0a-675b-456d-85d9-2e4281a19843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:50.486239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 693/1391] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:50.531384 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a801033-c4cf-42d8-90f5-caa6bc8e8905 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:50.539785 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=46 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:51:50.546590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a801033-c4cf-42d8-90f5-caa6bc8e8905 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:50.552218 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05b788-f919-41e2-8590-296cd1cef09e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:50.554879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05b788-f919-41e2-8590-296cd1cef09e service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:50.554879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05b788-f919-41e2-8590-296cd1cef09e service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:50.554879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05b788-f919-41e2-8590-296cd1cef09e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:50.561765 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05b788-f919-41e2-8590-296cd1cef09e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:50.563373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05b788-f919-41e2-8590-296cd1cef09e service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:50.573421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 699/1392] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:51.464901 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19593b7b-09a1-4559-ad5e-67c1532ea544 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:51.465574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19593b7b-09a1-4559-ad5e-67c1532ea544 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:51.465574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19593b7b-09a1-4559-ad5e-67c1532ea544 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:51.466839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 694/1393] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:51.472555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5ae68-ae6f-4908-8b5b-11e0d2d10062 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:51.473003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5ae68-ae6f-4908-8b5b-11e0d2d10062 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:51.473187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5ae68-ae6f-4908-8b5b-11e0d2d10062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:51.491828 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-0da5ae68-ae6f-4908-8b5b-11e0d2d10062 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:51.492904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0da5ae68-ae6f-4908-8b5b-11e0d2d10062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:51.501445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 700/1394] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:51.556918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663cac1-253d-4705-ab73-bc4cafe281c7 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:51.557188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663cac1-253d-4705-ab73-bc4cafe281c7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:51.557499 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663cac1-253d-4705-ab73-bc4cafe281c7 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:51.558852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 695/1395] 10.222.0.39 () {54 vars in 962 bytes} [Tue May 31 20:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:51.564431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f0f87-9a70-414e-9f84-77cbbc74f0b3 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:51.564920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f0f87-9a70-414e-9f84-77cbbc74f0b3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:51.565216 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f0f87-9a70-414e-9f84-77cbbc74f0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:51.621253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-ad0f0f87-9a70-414e-9f84-77cbbc74f0b3 None None] MFA Rules not processed for user `01a22cd803304a19a58bfbe17addb11f`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:51.622785 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ad0f0f87-9a70-414e-9f84-77cbbc74f0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:51.684280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 701/1396] 10.222.0.39 () {58 vars in 1059 bytes} [Tue May 31 20:51:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:51.692023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663cac1-253d-4705-ab73-bc4cafe281c7 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:51.702643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663cac1-253d-4705-ab73-bc4cafe281c7 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:51.706704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b72e52-09b6-4407-b934-9cfa2a9c8b76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a22cd803304a19a58bfbe17addb11f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:51.707337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b72e52-09b6-4407-b934-9cfa2a9c8b76 service glance] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:51.707622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b72e52-09b6-4407-b934-9cfa2a9c8b76 service glance] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:51.707905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b72e52-09b6-4407-b934-9cfa2a9c8b76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:51.716969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b72e52-09b6-4407-b934-9cfa2a9c8b76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:51.718392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b72e52-09b6-4407-b934-9cfa2a9c8b76 service glance] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:51.728978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 696/1397] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:52.419821 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b11d-7272-4285-8d8f-dfcf3ebfaecc None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:52.420107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b11d-7272-4285-8d8f-dfcf3ebfaecc None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:52.420378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b11d-7272-4285-8d8f-dfcf3ebfaecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:52.468759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-2350b11d-7272-4285-8d8f-dfcf3ebfaecc None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:52.469993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2350b11d-7272-4285-8d8f-dfcf3ebfaecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:52.537754 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 702/1398] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 20:51:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:52.585616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f777-17a3-4b24-937f-f9b6f66af877 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:52.586393 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f777-17a3-4b24-937f-f9b6f66af877 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:52.586393 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f777-17a3-4b24-937f-f9b6f66af877 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:52.587615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 697/1399] 10.222.0.39 () {54 vars in 942 bytes} [Tue May 31 20:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:52.594293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70b8fb-2786-49db-8c47-492f70382502 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:52.594659 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70b8fb-2786-49db-8c47-492f70382502 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:52.595008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70b8fb-2786-49db-8c47-492f70382502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:52.645955 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:51:52.649863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6d70b8fb-2786-49db-8c47-492f70382502 None None] MFA Rules not processed for user `90867ac821dd4adb8d52075fbd85caba`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:52.651124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6d70b8fb-2786-49db-8c47-492f70382502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:52.731400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 703/1400] 10.222.0.39 () {58 vars in 1039 bytes} [Tue May 31 20:51:52 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:52.741305 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932f777-17a3-4b24-937f-f9b6f66af877 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:52.756027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932f777-17a3-4b24-937f-f9b6f66af877 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:52.760867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b41d3e-0ff1-49db-a1e6-808ba96bce8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:52.761567 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41d3e-0ff1-49db-a1e6-808ba96bce8c service swift] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:52.761850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41d3e-0ff1-49db-a1e6-808ba96bce8c service swift] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:52.762123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41d3e-0ff1-49db-a1e6-808ba96bce8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:52.771340 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b41d3e-0ff1-49db-a1e6-808ba96bce8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:52.772904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b41d3e-0ff1-49db-a1e6-808ba96bce8c service swift] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:52.781677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 698/1401] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 20:51:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 31 20:51:53.066432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db514c62-a4bc-4ee5-86a9-1b4613c825ca None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:53.066723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db514c62-a4bc-4ee5-86a9-1b4613c825ca None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:53.067004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db514c62-a4bc-4ee5-86a9-1b4613c825ca None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:53.068402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 704/1402] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:53.074381 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a567-24df-4ba4-975d-6383debf6f66 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:53.074683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a567-24df-4ba4-975d-6383debf6f66 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:53.074968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a567-24df-4ba4-975d-6383debf6f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:53.094309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7cd7a567-24df-4ba4-975d-6383debf6f66 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:53.097500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7cd7a567-24df-4ba4-975d-6383debf6f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:53.103446 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 699/1403] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:53.148579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db514c62-a4bc-4ee5-86a9-1b4613c825ca None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:53.166048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db514c62-a4bc-4ee5-86a9-1b4613c825ca None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:53.171585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2bf0d-d6b6-4f63-aac5-c594488f8fd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:53.172238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2bf0d-d6b6-4f63-aac5-c594488f8fd3 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:53.172511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2bf0d-d6b6-4f63-aac5-c594488f8fd3 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:53.172787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2bf0d-d6b6-4f63-aac5-c594488f8fd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:53.181329 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2bf0d-d6b6-4f63-aac5-c594488f8fd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:53.183032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2bf0d-d6b6-4f63-aac5-c594488f8fd3 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:53.192429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 705/1404] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:51:55.654222 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23f0c3-8748-4e5f-a980-f343040467f0 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:55.654865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23f0c3-8748-4e5f-a980-f343040467f0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:55.654865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23f0c3-8748-4e5f-a980-f343040467f0 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:55.656167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 700/1405] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:51:55.662027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09212606-fd07-480a-89e3-0795a411323c None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:55.662458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09212606-fd07-480a-89e3-0795a411323c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:55.662636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09212606-fd07-480a-89e3-0795a411323c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:55.681410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-09212606-fd07-480a-89e3-0795a411323c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:51:55.682653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-09212606-fd07-480a-89e3-0795a411323c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:51:55.691762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 706/1406] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:51:55.737432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23f0c3-8748-4e5f-a980-f343040467f0 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:51:55.755247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23f0c3-8748-4e5f-a980-f343040467f0 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:51:55.760822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae5e6b-390e-4af5-b5ba-7bb070f9993c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:51:55.761583 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5e6b-390e-4af5-b5ba-7bb070f9993c service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:51:55.761940 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5e6b-390e-4af5-b5ba-7bb070f9993c service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:51:55.762286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5e6b-390e-4af5-b5ba-7bb070f9993c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:51:55.772152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae5e6b-390e-4af5-b5ba-7bb070f9993c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:51:55.773914 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae5e6b-390e-4af5-b5ba-7bb070f9993c service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:51:55.784963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 701/1407] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:05.677653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=39 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:52:05.779274 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=84 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:52:17.313918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cff1e-738f-41d2-86a7-57a379dd9825 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:17.314402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cff1e-738f-41d2-86a7-57a379dd9825 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:17.314509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cff1e-738f-41d2-86a7-57a379dd9825 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:17.315877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 707/1408] 10.222.0.39 () {54 vars in 918 bytes} [Tue May 31 20:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:17.321196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69975e9-6d64-4a87-8b6a-25fece855724 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:17.321656 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69975e9-6d64-4a87-8b6a-25fece855724 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:17.321850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69975e9-6d64-4a87-8b6a-25fece855724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:17.340174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-f69975e9-6d64-4a87-8b6a-25fece855724 None None] MFA Rules not processed for user `619d0b5afa094289808516486a5e3c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:17.341509 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f69975e9-6d64-4a87-8b6a-25fece855724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:17.350565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 702/1409] 10.222.0.39 () {58 vars in 1015 bytes} [Tue May 31 20:52:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:17.364702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36156af-5615-45a3-8da7-2c38fdf08854 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:17.364993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36156af-5615-45a3-8da7-2c38fdf08854 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:17.365273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36156af-5615-45a3-8da7-2c38fdf08854 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:17.366663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 708/1410] 10.222.0.39 () {54 vars in 918 bytes} [Tue May 31 20:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:17.371223 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979992b-1db8-4cd7-8ec5-d15d4c18151e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:17.371512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979992b-1db8-4cd7-8ec5-d15d4c18151e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:17.371787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979992b-1db8-4cd7-8ec5-d15d4c18151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:17.389883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b979992b-1db8-4cd7-8ec5-d15d4c18151e None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:17.391010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b979992b-1db8-4cd7-8ec5-d15d4c18151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:17.400578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 703/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Tue May 31 20:52:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:20.131180 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdbe63-02e6-4293-bc11-b1901d2cc141 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:20.131757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdbe63-02e6-4293-bc11-b1901d2cc141 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:20.131757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdbe63-02e6-4293-bc11-b1901d2cc141 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:20.133107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 709/1412] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:20.138604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6c588-f5cb-4546-89aa-d78d3d7d1870 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:20.139022 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6c588-f5cb-4546-89aa-d78d3d7d1870 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:20.139173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6c588-f5cb-4546-89aa-d78d3d7d1870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:20.158124 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ebb6c588-f5cb-4546-89aa-d78d3d7d1870 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:20.159318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ebb6c588-f5cb-4546-89aa-d78d3d7d1870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:20.167549 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 704/1413] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:20.210998 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdbe63-02e6-4293-bc11-b1901d2cc141 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:20.226108 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdbe63-02e6-4293-bc11-b1901d2cc141 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:20.231560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3a8dd-3236-4639-87f1-fbd3bd63d1d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:20.232195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3a8dd-3236-4639-87f1-fbd3bd63d1d9 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:20.232479 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3a8dd-3236-4639-87f1-fbd3bd63d1d9 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:20.232757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3a8dd-3236-4639-87f1-fbd3bd63d1d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:20.241053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3a8dd-3236-4639-87f1-fbd3bd63d1d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:20.242679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3a8dd-3236-4639-87f1-fbd3bd63d1d9 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:20.252453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 710/1414] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:21.234945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d4c7-1551-4a2b-bfcb-6d01a2db28d6 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:21.236173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d4c7-1551-4a2b-bfcb-6d01a2db28d6 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:21.236173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d4c7-1551-4a2b-bfcb-6d01a2db28d6 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:21.236853 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 705/1415] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:21.242029 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa91fd-eabe-47ee-afd2-9c31aff7da83 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:21.242465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa91fd-eabe-47ee-afd2-9c31aff7da83 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:21.242574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa91fd-eabe-47ee-afd2-9c31aff7da83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:21.261868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-2eaa91fd-eabe-47ee-afd2-9c31aff7da83 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:21.263037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2eaa91fd-eabe-47ee-afd2-9c31aff7da83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:21.271315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 711/1416] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:21.424028 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294d4c7-1551-4a2b-bfcb-6d01a2db28d6 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:21.438527 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294d4c7-1551-4a2b-bfcb-6d01a2db28d6 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:21.444481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eb0de-3cb0-43cc-9a7e-bb575f7d9643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:21.445116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eb0de-3cb0-43cc-9a7e-bb575f7d9643 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:21.445425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eb0de-3cb0-43cc-9a7e-bb575f7d9643 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:21.445710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eb0de-3cb0-43cc-9a7e-bb575f7d9643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:21.454024 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eb0de-3cb0-43cc-9a7e-bb575f7d9643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:21.455599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eb0de-3cb0-43cc-9a7e-bb575f7d9643 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:21.465833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 706/1417] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:22.394548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbcc5f-d7ab-4eca-9a58-7da67b1ab543 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:22.395089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbcc5f-d7ab-4eca-9a58-7da67b1ab543 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:22.395089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbcc5f-d7ab-4eca-9a58-7da67b1ab543 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:22.396542 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 712/1418] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:22.401542 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5efe76-d90f-4f88-be7d-cfb4ac3b3488 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:22.401999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5efe76-d90f-4f88-be7d-cfb4ac3b3488 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:22.402112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5efe76-d90f-4f88-be7d-cfb4ac3b3488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:22.419982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-cc5efe76-d90f-4f88-be7d-cfb4ac3b3488 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:22.421163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cc5efe76-d90f-4f88-be7d-cfb4ac3b3488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:22.437493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 707/1419] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:22.588121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbcc5f-d7ab-4eca-9a58-7da67b1ab543 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:22.602936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbcc5f-d7ab-4eca-9a58-7da67b1ab543 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:22.608280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b17923-679f-4a33-88d8-51a8172acc4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:22.608919 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b17923-679f-4a33-88d8-51a8172acc4d service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:22.609198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b17923-679f-4a33-88d8-51a8172acc4d service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:22.609499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b17923-679f-4a33-88d8-51a8172acc4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:22.617674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b17923-679f-4a33-88d8-51a8172acc4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:22.625320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b17923-679f-4a33-88d8-51a8172acc4d service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:22.628954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 713/1420] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:23.542893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3092229-a7cc-43dd-958b-0bd51edb5303 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:23.543490 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3092229-a7cc-43dd-958b-0bd51edb5303 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:23.543490 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3092229-a7cc-43dd-958b-0bd51edb5303 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:23.544796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 708/1421] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:23.550251 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84894ea-48dd-4387-9417-85aa1dc08d3f None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:23.551473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84894ea-48dd-4387-9417-85aa1dc08d3f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:23.551473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84894ea-48dd-4387-9417-85aa1dc08d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:23.569408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-d84894ea-48dd-4387-9417-85aa1dc08d3f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:23.570637 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d84894ea-48dd-4387-9417-85aa1dc08d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:23.578497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 714/1422] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:52:23.729067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3092229-a7cc-43dd-958b-0bd51edb5303 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:23.743764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3092229-a7cc-43dd-958b-0bd51edb5303 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:23.749254 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9dc6f-63bc-4f51-a6d0-be22f301f9b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:23.749910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9dc6f-63bc-4f51-a6d0-be22f301f9b3 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:23.750190 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9dc6f-63bc-4f51-a6d0-be22f301f9b3 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:23.750460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9dc6f-63bc-4f51-a6d0-be22f301f9b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:23.758633 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9dc6f-63bc-4f51-a6d0-be22f301f9b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:23.760196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9dc6f-63bc-4f51-a6d0-be22f301f9b3 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:23.769341 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 709/1423] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:24.710063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7730f55-cf8e-453d-a2ca-928eed13ac80 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:24.710676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7730f55-cf8e-453d-a2ca-928eed13ac80 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:24.710676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7730f55-cf8e-453d-a2ca-928eed13ac80 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:24.711981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 715/1424] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:24.716948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a8052-e0a1-47b8-b48f-a9695d73ffb9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:24.717433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a8052-e0a1-47b8-b48f-a9695d73ffb9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:24.717533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a8052-e0a1-47b8-b48f-a9695d73ffb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:24.736065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e23a8052-e0a1-47b8-b48f-a9695d73ffb9 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:24.737261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e23a8052-e0a1-47b8-b48f-a9695d73ffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:24.745059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 710/1425] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:24.896158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7730f55-cf8e-453d-a2ca-928eed13ac80 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:24.910972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7730f55-cf8e-453d-a2ca-928eed13ac80 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:24.916308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9b828-14b8-41ed-b16b-e0f339f33cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:24.916948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9b828-14b8-41ed-b16b-e0f339f33cbf service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:24.917230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9b828-14b8-41ed-b16b-e0f339f33cbf service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:24.917535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9b828-14b8-41ed-b16b-e0f339f33cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:24.925713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9b828-14b8-41ed-b16b-e0f339f33cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:24.927350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9b828-14b8-41ed-b16b-e0f339f33cbf service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:24.936593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 716/1426] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:25.869903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bac24c-ac14-4d9b-9a56-fa2541628be4 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:25.870435 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bac24c-ac14-4d9b-9a56-fa2541628be4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:25.870565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bac24c-ac14-4d9b-9a56-fa2541628be4 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:25.871842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 711/1427] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:25.877160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4320ed-3706-457c-bba6-9da2f81dc49f None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:25.877665 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4320ed-3706-457c-bba6-9da2f81dc49f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:25.877811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4320ed-3706-457c-bba6-9da2f81dc49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:25.895891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-fd4320ed-3706-457c-bba6-9da2f81dc49f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:25.897083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-fd4320ed-3706-457c-bba6-9da2f81dc49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:25.905155 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 717/1428] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:26.054264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bac24c-ac14-4d9b-9a56-fa2541628be4 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:26.068689 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bac24c-ac14-4d9b-9a56-fa2541628be4 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:26.074006 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7d257-e740-46bc-ab3d-bb1c5b2a3465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:26.074629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7d257-e740-46bc-ab3d-bb1c5b2a3465 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:26.074928 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7d257-e740-46bc-ab3d-bb1c5b2a3465 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:26.075200 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7d257-e740-46bc-ab3d-bb1c5b2a3465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:26.084555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7d257-e740-46bc-ab3d-bb1c5b2a3465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:26.086264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7d257-e740-46bc-ab3d-bb1c5b2a3465 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:26.096588 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 712/1429] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:27.043925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144885fe-9dbc-4ddf-b120-fa7ed4a34833 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:27.044514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144885fe-9dbc-4ddf-b120-fa7ed4a34833 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:27.044514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144885fe-9dbc-4ddf-b120-fa7ed4a34833 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:27.045894 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 718/1430] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:27.051784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857057-3d7f-4b70-85bf-9b37f62cc633 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:27.052241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857057-3d7f-4b70-85bf-9b37f62cc633 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:27.052382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857057-3d7f-4b70-85bf-9b37f62cc633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:27.071313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-50857057-3d7f-4b70-85bf-9b37f62cc633 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:27.072864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-50857057-3d7f-4b70-85bf-9b37f62cc633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:27.080828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 713/1431] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:27.233120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144885fe-9dbc-4ddf-b120-fa7ed4a34833 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:27.247601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144885fe-9dbc-4ddf-b120-fa7ed4a34833 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:27.253322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8d8d5-6b17-4d38-81a0-7605022e409d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:27.254475 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8d8d5-6b17-4d38-81a0-7605022e409d service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:27.254803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8d8d5-6b17-4d38-81a0-7605022e409d service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:27.255082 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8d8d5-6b17-4d38-81a0-7605022e409d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:27.263276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8d8d5-6b17-4d38-81a0-7605022e409d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:27.264854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8d8d5-6b17-4d38-81a0-7605022e409d service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:27.274930 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 719/1432] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:28.193297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525984c2-f33b-4610-b47c-8f2b23dee16a None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:28.193886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525984c2-f33b-4610-b47c-8f2b23dee16a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:28.193886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525984c2-f33b-4610-b47c-8f2b23dee16a None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:28.195247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 714/1433] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:28.200343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f7f12-bd94-40f3-9c43-7f705d8b60e8 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:28.200761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f7f12-bd94-40f3-9c43-7f705d8b60e8 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:28.200902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f7f12-bd94-40f3-9c43-7f705d8b60e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:28.219364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-0e8f7f12-bd94-40f3-9c43-7f705d8b60e8 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:28.220543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0e8f7f12-bd94-40f3-9c43-7f705d8b60e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:28.228361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 720/1434] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:28.381863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525984c2-f33b-4610-b47c-8f2b23dee16a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:28.396467 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525984c2-f33b-4610-b47c-8f2b23dee16a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:28.401698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede411d-ed39-4763-9842-fcff89c91aeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:28.402389 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede411d-ed39-4763-9842-fcff89c91aeb service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:28.402667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede411d-ed39-4763-9842-fcff89c91aeb service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:28.402937 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede411d-ed39-4763-9842-fcff89c91aeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:28.411771 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede411d-ed39-4763-9842-fcff89c91aeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:28.413329 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede411d-ed39-4763-9842-fcff89c91aeb service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:28.422602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 715/1435] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:29.351159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4ba17-81b0-4f3a-840b-f9c9530a609e None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:29.351702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4ba17-81b0-4f3a-840b-f9c9530a609e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:29.351702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4ba17-81b0-4f3a-840b-f9c9530a609e None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:29.353096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 721/1436] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:29.358249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc9a37-5de8-4441-83dd-6d27d7375aa5 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:29.358697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc9a37-5de8-4441-83dd-6d27d7375aa5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:29.358810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc9a37-5de8-4441-83dd-6d27d7375aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:29.377510 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-23cc9a37-5de8-4441-83dd-6d27d7375aa5 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:29.378764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-23cc9a37-5de8-4441-83dd-6d27d7375aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:29.386595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 716/1437] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:29.535599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4ba17-81b0-4f3a-840b-f9c9530a609e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:29.550470 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4ba17-81b0-4f3a-840b-f9c9530a609e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:29.556624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e0887-7ef5-49ae-a56e-af86410835b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:29.557252 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e0887-7ef5-49ae-a56e-af86410835b8 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:29.557565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e0887-7ef5-49ae-a56e-af86410835b8 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:29.557840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e0887-7ef5-49ae-a56e-af86410835b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:29.565888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e0887-7ef5-49ae-a56e-af86410835b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:29.567530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e0887-7ef5-49ae-a56e-af86410835b8 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:29.577406 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 722/1438] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:31.726047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be05d54-dd96-4b10-82a8-7ef7e79c2122 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:31.726623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be05d54-dd96-4b10-82a8-7ef7e79c2122 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:31.726623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be05d54-dd96-4b10-82a8-7ef7e79c2122 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:31.727980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 717/1439] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:31.733669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e58e53-e98a-44a3-af0b-da15bce3f8b6 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:31.734139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e58e53-e98a-44a3-af0b-da15bce3f8b6 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:31.734252 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e58e53-e98a-44a3-af0b-da15bce3f8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:31.753898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-35e58e53-e98a-44a3-af0b-da15bce3f8b6 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:31.755043 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-35e58e53-e98a-44a3-af0b-da15bce3f8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:31.762902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 723/1440] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:31.801413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be05d54-dd96-4b10-82a8-7ef7e79c2122 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:31.812649 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be05d54-dd96-4b10-82a8-7ef7e79c2122 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:31.816263 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c49d3-f046-4a95-93ae-421534bf7edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:31.816894 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c49d3-f046-4a95-93ae-421534bf7edb service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:31.817171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c49d3-f046-4a95-93ae-421534bf7edb service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:31.817480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c49d3-f046-4a95-93ae-421534bf7edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:31.826444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c49d3-f046-4a95-93ae-421534bf7edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:31.827897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c49d3-f046-4a95-93ae-421534bf7edb service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:31.837346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 718/1441] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:34.251386 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e83e36-d95a-4bc4-b0f4-e0bb9896ea07 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:34.251981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e83e36-d95a-4bc4-b0f4-e0bb9896ea07 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:34.251981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e83e36-d95a-4bc4-b0f4-e0bb9896ea07 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:34.253362 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 724/1442] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:34.259362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a347bc4-e8e2-4add-acb1-93ff75c047d6 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:34.259802 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a347bc4-e8e2-4add-acb1-93ff75c047d6 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:34.259924 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a347bc4-e8e2-4add-acb1-93ff75c047d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:34.277711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-0a347bc4-e8e2-4add-acb1-93ff75c047d6 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:34.278906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0a347bc4-e8e2-4add-acb1-93ff75c047d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:34.286833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 719/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:34.325280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e83e36-d95a-4bc4-b0f4-e0bb9896ea07 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:34.336022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e83e36-d95a-4bc4-b0f4-e0bb9896ea07 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:34.339572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947401ab-7bb4-48b3-9df3-d7b4c728164b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:34.340201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947401ab-7bb4-48b3-9df3-d7b4c728164b service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:34.340484 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947401ab-7bb4-48b3-9df3-d7b4c728164b service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:34.340759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947401ab-7bb4-48b3-9df3-d7b4c728164b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:34.349691 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947401ab-7bb4-48b3-9df3-d7b4c728164b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:34.351120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947401ab-7bb4-48b3-9df3-d7b4c728164b service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:34.360712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 725/1444] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:37.162834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04452c-e96b-4939-8fae-eae30705b740 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:37.163451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04452c-e96b-4939-8fae-eae30705b740 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:37.163451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04452c-e96b-4939-8fae-eae30705b740 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:37.164995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 720/1445] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:37.170736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28916b7-6d33-46e5-b138-cfe7ff62c7ce None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:37.171203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28916b7-6d33-46e5-b138-cfe7ff62c7ce None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:37.171305 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28916b7-6d33-46e5-b138-cfe7ff62c7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:37.188886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a28916b7-6d33-46e5-b138-cfe7ff62c7ce None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:37.190103 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a28916b7-6d33-46e5-b138-cfe7ff62c7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:37.198384 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 726/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:37.236564 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04452c-e96b-4939-8fae-eae30705b740 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:37.248580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04452c-e96b-4939-8fae-eae30705b740 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:37.252166 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035b15d-5971-4bde-83e2-ec6b8026265d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:37.252795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035b15d-5971-4bde-83e2-ec6b8026265d service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:37.253082 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035b15d-5971-4bde-83e2-ec6b8026265d service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:37.253359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035b15d-5971-4bde-83e2-ec6b8026265d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:37.263104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035b15d-5971-4bde-83e2-ec6b8026265d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:37.264533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035b15d-5971-4bde-83e2-ec6b8026265d service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:37.274318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 721/1447] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:39.632845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf39c-4997-4c7d-9081-0bb5a08c0d89 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:39.633431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf39c-4997-4c7d-9081-0bb5a08c0d89 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:39.633431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf39c-4997-4c7d-9081-0bb5a08c0d89 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:39.634822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 727/1448] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:39.640972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9fc7e-cd84-4206-9a2b-e0392eedba9e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:39.641469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9fc7e-cd84-4206-9a2b-e0392eedba9e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:39.641690 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9fc7e-cd84-4206-9a2b-e0392eedba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:39.661119 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-71c9fc7e-cd84-4206-9a2b-e0392eedba9e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:39.662361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-71c9fc7e-cd84-4206-9a2b-e0392eedba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:39.670264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 722/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:39.709390 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abf39c-4997-4c7d-9081-0bb5a08c0d89 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:39.720153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abf39c-4997-4c7d-9081-0bb5a08c0d89 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:39.723665 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161beb5c-e39a-498c-a3df-6cf4d9c902d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:39.724295 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161beb5c-e39a-498c-a3df-6cf4d9c902d3 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:39.724580 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161beb5c-e39a-498c-a3df-6cf4d9c902d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:39.724854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161beb5c-e39a-498c-a3df-6cf4d9c902d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:39.733707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161beb5c-e39a-498c-a3df-6cf4d9c902d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:39.735122 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161beb5c-e39a-498c-a3df-6cf4d9c902d3 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:39.744982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 728/1450] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:42.235281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5d1bf-97e1-45bf-9e1b-909a8fa95cad None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:42.235854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5d1bf-97e1-45bf-9e1b-909a8fa95cad None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:42.235854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5d1bf-97e1-45bf-9e1b-909a8fa95cad None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:42.237195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 723/1451] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:42.242620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7081f-219b-4fbf-b36e-9df46d813f44 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:42.243084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7081f-219b-4fbf-b36e-9df46d813f44 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:42.243324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7081f-219b-4fbf-b36e-9df46d813f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:42.261966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-02f7081f-219b-4fbf-b36e-9df46d813f44 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:42.262915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-02f7081f-219b-4fbf-b36e-9df46d813f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:42.271159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 729/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:52:42.309065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5d1bf-97e1-45bf-9e1b-909a8fa95cad None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:42.320409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5d1bf-97e1-45bf-9e1b-909a8fa95cad None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:42.324012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01db536-9e2a-4626-9131-ea7cafcc9296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:42.324665 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db536-9e2a-4626-9131-ea7cafcc9296 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:42.324933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db536-9e2a-4626-9131-ea7cafcc9296 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:42.325205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db536-9e2a-4626-9131-ea7cafcc9296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:42.335202 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01db536-9e2a-4626-9131-ea7cafcc9296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:42.336619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01db536-9e2a-4626-9131-ea7cafcc9296 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:42.346370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 724/1453] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:44.668799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fddf3-624a-49c2-ac05-707bb56b2aef None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:44.669372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fddf3-624a-49c2-ac05-707bb56b2aef None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:44.669372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fddf3-624a-49c2-ac05-707bb56b2aef None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:44.670781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 730/1454] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:44.676503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cff650-8253-45a9-894e-0e957afcdf05 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:44.676974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cff650-8253-45a9-894e-0e957afcdf05 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:44.677089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cff650-8253-45a9-894e-0e957afcdf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:44.695934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-48cff650-8253-45a9-894e-0e957afcdf05 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:44.697135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-48cff650-8253-45a9-894e-0e957afcdf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:44.704936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 725/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:44.743799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fddf3-624a-49c2-ac05-707bb56b2aef None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:44.755102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fddf3-624a-49c2-ac05-707bb56b2aef None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:44.759277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9867d-cc37-4ce1-95ce-25e788dcf3bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:44.759917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9867d-cc37-4ce1-95ce-25e788dcf3bf service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:44.760202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9867d-cc37-4ce1-95ce-25e788dcf3bf service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:44.760481 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9867d-cc37-4ce1-95ce-25e788dcf3bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:44.769872 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9867d-cc37-4ce1-95ce-25e788dcf3bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:44.772288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9867d-cc37-4ce1-95ce-25e788dcf3bf service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:44.781149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 731/1456] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:47.126443 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afe6b4-aeef-46f9-bbf7-fdcab0b1efa6 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:47.127050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afe6b4-aeef-46f9-bbf7-fdcab0b1efa6 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:47.127050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afe6b4-aeef-46f9-bbf7-fdcab0b1efa6 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:47.128392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 726/1457] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:47.133969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664239d-393d-49b8-bc69-246b11072b33 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:47.134432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664239d-393d-49b8-bc69-246b11072b33 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:47.134538 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664239d-393d-49b8-bc69-246b11072b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:47.140857 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=70 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:52:47.153330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-0664239d-393d-49b8-bc69-246b11072b33 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:47.157135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0664239d-393d-49b8-bc69-246b11072b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:47.163088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 732/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:47.205592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afe6b4-aeef-46f9-bbf7-fdcab0b1efa6 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:47.211441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=73 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:52:47.217150 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afe6b4-aeef-46f9-bbf7-fdcab0b1efa6 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:47.220739 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e8043-e2cf-4851-9787-917b12f45248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:47.230205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e8043-e2cf-4851-9787-917b12f45248 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:47.230205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e8043-e2cf-4851-9787-917b12f45248 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:47.230205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e8043-e2cf-4851-9787-917b12f45248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:47.231619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e8043-e2cf-4851-9787-917b12f45248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:47.233051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e8043-e2cf-4851-9787-917b12f45248 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:47.242416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 727/1459] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:49.542411 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f74110-6b11-43d9-a3ca-98e763a6d92c None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:49.542958 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f74110-6b11-43d9-a3ca-98e763a6d92c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:49.542958 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f74110-6b11-43d9-a3ca-98e763a6d92c None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:49.544354 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 733/1460] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:49.550026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db87f9d-b79e-456f-94a8-ecf08c5b5b16 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:49.550558 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db87f9d-b79e-456f-94a8-ecf08c5b5b16 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:49.550685 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db87f9d-b79e-456f-94a8-ecf08c5b5b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:49.569540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2db87f9d-b79e-456f-94a8-ecf08c5b5b16 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:49.570797 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2db87f9d-b79e-456f-94a8-ecf08c5b5b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:49.578678 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 728/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:49.616660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f74110-6b11-43d9-a3ca-98e763a6d92c None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:49.627788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f74110-6b11-43d9-a3ca-98e763a6d92c None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:49.631229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe893c37-d32e-4f1c-9eaf-25b427246531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:49.631855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893c37-d32e-4f1c-9eaf-25b427246531 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:49.632133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893c37-d32e-4f1c-9eaf-25b427246531 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:49.632403 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893c37-d32e-4f1c-9eaf-25b427246531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:49.641140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe893c37-d32e-4f1c-9eaf-25b427246531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:49.642608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe893c37-d32e-4f1c-9eaf-25b427246531 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:49.651871 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 734/1462] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:51.929426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4618-3e51-4997-9037-b1cc4683de6c None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:51.929980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4618-3e51-4997-9037-b1cc4683de6c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:51.930096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4618-3e51-4997-9037-b1cc4683de6c None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:51.931524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 729/1463] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:51.936901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2ab7f-dce5-4151-99a9-f6b0e6da2410 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:51.937342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2ab7f-dce5-4151-99a9-f6b0e6da2410 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:51.937483 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2ab7f-dce5-4151-99a9-f6b0e6da2410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:51.955690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-50f2ab7f-dce5-4151-99a9-f6b0e6da2410 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:51.956886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-50f2ab7f-dce5-4151-99a9-f6b0e6da2410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:51.965301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 735/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:52.001613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e4618-3e51-4997-9037-b1cc4683de6c None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:52.012542 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e4618-3e51-4997-9037-b1cc4683de6c None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:52.016170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3d0bf-8385-4e01-aac7-42cb28e739e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:52.016802 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3d0bf-8385-4e01-aac7-42cb28e739e9 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:52.017084 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3d0bf-8385-4e01-aac7-42cb28e739e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:52.017361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3d0bf-8385-4e01-aac7-42cb28e739e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:52.027243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3d0bf-8385-4e01-aac7-42cb28e739e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:52.028661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3d0bf-8385-4e01-aac7-42cb28e739e9 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:52.037992 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 730/1465] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:52:54.288798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc3eeb-ab93-4494-81f3-3aedb486b102 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:54.289368 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc3eeb-ab93-4494-81f3-3aedb486b102 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:54.289368 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc3eeb-ab93-4494-81f3-3aedb486b102 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:54.290783 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 736/1466] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:52:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:54.296418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e511b-3f11-4835-97f0-630a691ca93d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:54.296858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e511b-3f11-4835-97f0-630a691ca93d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:54.297093 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e511b-3f11-4835-97f0-630a691ca93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:54.315494 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ee7e511b-3f11-4835-97f0-630a691ca93d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:54.316709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ee7e511b-3f11-4835-97f0-630a691ca93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:54.324397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 731/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:54.374470 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64826-239b-43a7-945e-22e31b2ece7d None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:54.374761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64826-239b-43a7-945e-22e31b2ece7d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:54.375045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64826-239b-43a7-945e-22e31b2ece7d None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:54.376454 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 737/1468] 10.222.0.39 () {54 vars in 964 bytes} [Tue May 31 20:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:52:54.382193 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd359ab0-e19d-4275-89a5-6d2733ae6e95 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:54.382479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd359ab0-e19d-4275-89a5-6d2733ae6e95 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:54.382756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd359ab0-e19d-4275-89a5-6d2733ae6e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:54.419455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-bd359ab0-e19d-4275-89a5-6d2733ae6e95 None None] MFA Rules not processed for user `16a77c08d2844e7cb81ac1370c527cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:52:54.420699 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-bd359ab0-e19d-4275-89a5-6d2733ae6e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:52:54.427138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 732/1469] 10.222.0.39 () {58 vars in 1061 bytes} [Tue May 31 20:52:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:52:54.436867 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c64826-239b-43a7-945e-22e31b2ece7d None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:52:54.447553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c64826-239b-43a7-945e-22e31b2ece7d None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:52:54.451136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978dddf-01f4-424f-b6d0-ae03d77dd962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:52:54.451804 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978dddf-01f4-424f-b6d0-ae03d77dd962 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:52:54.452087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978dddf-01f4-424f-b6d0-ae03d77dd962 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:52:54.452360 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978dddf-01f4-424f-b6d0-ae03d77dd962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:52:54.461671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978dddf-01f4-424f-b6d0-ae03d77dd962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:52:54.463100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978dddf-01f4-424f-b6d0-ae03d77dd962 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:52:54.472811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 738/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:53:04.416886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=26 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:53:04.468215 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=17 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:53:27.625391 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28afa1-9bd6-49a8-9531-c8f171c453b4 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:27.626026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28afa1-9bd6-49a8-9531-c8f171c453b4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:27.626026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28afa1-9bd6-49a8-9531-c8f171c453b4 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:27.627456 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 733/1471] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:53:27.633725 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9204c66-6951-47dd-871f-49917a17fd9c None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:27.634204 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9204c66-6951-47dd-871f-49917a17fd9c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:27.634311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9204c66-6951-47dd-871f-49917a17fd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:27.651586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-c9204c66-6951-47dd-871f-49917a17fd9c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:53:27.652752 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c9204c66-6951-47dd-871f-49917a17fd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:53:27.660401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 739/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:53:27.707443 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15fc85-9158-4cb5-9725-2fd577c3d709 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:27.707734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15fc85-9158-4cb5-9725-2fd577c3d709 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:27.708014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15fc85-9158-4cb5-9725-2fd577c3d709 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:27.709391 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 734/1473] 10.222.0.39 () {54 vars in 962 bytes} [Tue May 31 20:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:53:27.714077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b2d4f-5e25-43a0-8a7d-b6b824f8ed9a None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:27.714370 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b2d4f-5e25-43a0-8a7d-b6b824f8ed9a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:27.714678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b2d4f-5e25-43a0-8a7d-b6b824f8ed9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:27.732243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-863b2d4f-5e25-43a0-8a7d-b6b824f8ed9a None None] MFA Rules not processed for user `01a22cd803304a19a58bfbe17addb11f`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:53:27.733428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-863b2d4f-5e25-43a0-8a7d-b6b824f8ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:53:27.739871 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 740/1474] 10.222.0.39 () {58 vars in 1059 bytes} [Tue May 31 20:53:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:53:27.747743 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15fc85-9158-4cb5-9725-2fd577c3d709 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:53:27.759395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15fc85-9158-4cb5-9725-2fd577c3d709 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:53:27.762815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1e506-97fa-4d21-9044-d8530a9cae1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a22cd803304a19a58bfbe17addb11f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:53:27.763430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1e506-97fa-4d21-9044-d8530a9cae1b service glance] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:27.763711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1e506-97fa-4d21-9044-d8530a9cae1b service glance] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:27.763983 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1e506-97fa-4d21-9044-d8530a9cae1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:27.772901 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1e506-97fa-4d21-9044-d8530a9cae1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:53:27.774368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1e506-97fa-4d21-9044-d8530a9cae1b service glance] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:53:27.783592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 735/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:53:30.137711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a62e8-d8ae-43fe-a464-9936ed190496 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:30.138288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a62e8-d8ae-43fe-a464-9936ed190496 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:30.138288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a62e8-d8ae-43fe-a464-9936ed190496 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:30.139634 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 741/1476] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:53:30.144972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c277b1-42be-411a-8781-0c658d4ba8ee None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:30.145408 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c277b1-42be-411a-8781-0c658d4ba8ee None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:30.145654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c277b1-42be-411a-8781-0c658d4ba8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:30.164506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-28c277b1-42be-411a-8781-0c658d4ba8ee None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:53:30.165711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-28c277b1-42be-411a-8781-0c658d4ba8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:53:30.173653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 736/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:53:30.197761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a62e8-d8ae-43fe-a464-9936ed190496 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:53:30.210077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a62e8-d8ae-43fe-a464-9936ed190496 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:53:30.215072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a7df6-602a-4af5-a55f-91244ef1fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:53:30.215714 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a7df6-602a-4af5-a55f-91244ef1fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:30.215994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a7df6-602a-4af5-a55f-91244ef1fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:30.216266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a7df6-602a-4af5-a55f-91244ef1fbd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:30.216981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a7df6-602a-4af5-a55f-91244ef1fbd1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:53:30.218753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: WARNING py.warnings [None req-a46a7df6-602a-4af5-a55f-91244ef1fbd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:53:30.218753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: warnings.warn(msg) May 31 20:53:30.218753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: May 31 20:53:30.219877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a7df6-602a-4af5-a55f-91244ef1fbd1 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:53:30.238554 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 742/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Tue May 31 20:53:30 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:53:32.520652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4775e4-94ad-442f-a4bd-28ab21b7ce3f None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:32.521242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4775e4-94ad-442f-a4bd-28ab21b7ce3f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:32.521242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4775e4-94ad-442f-a4bd-28ab21b7ce3f None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:32.522655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 737/1479] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:53:32.528470 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcaa42-743f-40e4-a6ae-2ce458b4c28e None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:32.528877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcaa42-743f-40e4-a6ae-2ce458b4c28e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:32.529033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcaa42-743f-40e4-a6ae-2ce458b4c28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:32.546755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-dbbcaa42-743f-40e4-a6ae-2ce458b4c28e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:53:32.547954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-dbbcaa42-743f-40e4-a6ae-2ce458b4c28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:53:32.556241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 743/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:53:32.599762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4775e4-94ad-442f-a4bd-28ab21b7ce3f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:53:32.614319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4775e4-94ad-442f-a4bd-28ab21b7ce3f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:53:32.620186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef318a-d19f-40c2-b7f4-d024149f2f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:53:32.625166 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef318a-d19f-40c2-b7f4-d024149f2f85 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:32.625166 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef318a-d19f-40c2-b7f4-d024149f2f85 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:32.625166 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef318a-d19f-40c2-b7f4-d024149f2f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:32.629571 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef318a-d19f-40c2-b7f4-d024149f2f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:53:32.631136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef318a-d19f-40c2-b7f4-d024149f2f85 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:53:32.640210 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 738/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:53:35.064787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6820d-dd44-4b06-a04d-532579bcdda6 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:35.065359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6820d-dd44-4b06-a04d-532579bcdda6 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:35.065359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6820d-dd44-4b06-a04d-532579bcdda6 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:35.066734 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 744/1482] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:53:35.072663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0302-04f1-420d-99f2-e3c3d0aadb09 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:35.073089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0302-04f1-420d-99f2-e3c3d0aadb09 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:35.073286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0302-04f1-420d-99f2-e3c3d0aadb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:35.091177 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-df3e0302-04f1-420d-99f2-e3c3d0aadb09 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:53:35.092364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-df3e0302-04f1-420d-99f2-e3c3d0aadb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:53:35.100400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 739/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:53:35.137553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6820d-dd44-4b06-a04d-532579bcdda6 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:53:35.148829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6820d-dd44-4b06-a04d-532579bcdda6 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:53:35.152347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22a272-cdad-4172-bcea-1c26da0a4d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:53:35.153010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22a272-cdad-4172-bcea-1c26da0a4d72 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:35.153291 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22a272-cdad-4172-bcea-1c26da0a4d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:35.153601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22a272-cdad-4172-bcea-1c26da0a4d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:35.162521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22a272-cdad-4172-bcea-1c26da0a4d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:53:35.163941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22a272-cdad-4172-bcea-1c26da0a4d72 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:53:35.173171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 745/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:53:37.477317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74a75b-8281-4b07-ad36-361b5a45a3c8 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:37.477865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74a75b-8281-4b07-ad36-361b5a45a3c8 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:37.477865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74a75b-8281-4b07-ad36-361b5a45a3c8 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:37.479319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 740/1485] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:53:37.484542 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14f2a2-2d53-40cc-8548-8943fc1e7566 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:37.484951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14f2a2-2d53-40cc-8548-8943fc1e7566 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:37.485095 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14f2a2-2d53-40cc-8548-8943fc1e7566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:37.503465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6d14f2a2-2d53-40cc-8548-8943fc1e7566 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:53:37.504666 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6d14f2a2-2d53-40cc-8548-8943fc1e7566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:53:37.513080 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 746/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:53:37.551098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74a75b-8281-4b07-ad36-361b5a45a3c8 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:53:37.561598 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74a75b-8281-4b07-ad36-361b5a45a3c8 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:53:37.565010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f747de-5a09-4959-b1f0-108520e5fa6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:53:37.565662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f747de-5a09-4959-b1f0-108520e5fa6b service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:37.565947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f747de-5a09-4959-b1f0-108520e5fa6b service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:37.566222 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f747de-5a09-4959-b1f0-108520e5fa6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:37.575038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f747de-5a09-4959-b1f0-108520e5fa6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:53:37.576464 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f747de-5a09-4959-b1f0-108520e5fa6b service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:53:37.587883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 741/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 20:53:39.921926 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc28e5-a92c-4536-907e-1c1e497b8c7f None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:39.922511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc28e5-a92c-4536-907e-1c1e497b8c7f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:39.922511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc28e5-a92c-4536-907e-1c1e497b8c7f None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:39.923889 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 747/1488] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:53:39.929472 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1cc3f-1667-4a24-adf8-2a6a159a16bc None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:39.929938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1cc3f-1667-4a24-adf8-2a6a159a16bc None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:39.930211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1cc3f-1667-4a24-adf8-2a6a159a16bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:39.948130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b5e1cc3f-1667-4a24-adf8-2a6a159a16bc None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:53:39.949307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b5e1cc3f-1667-4a24-adf8-2a6a159a16bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:53:39.956854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 742/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:53:39.996900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc28e5-a92c-4536-907e-1c1e497b8c7f None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:53:40.008298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc28e5-a92c-4536-907e-1c1e497b8c7f None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:53:40.011858 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe71c18-66e0-42b4-8067-ca6bae847cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:53:40.012485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe71c18-66e0-42b4-8067-ca6bae847cec service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:40.012761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe71c18-66e0-42b4-8067-ca6bae847cec service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:40.013033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe71c18-66e0-42b4-8067-ca6bae847cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:40.021815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe71c18-66e0-42b4-8067-ca6bae847cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:53:40.023245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe71c18-66e0-42b4-8067-ca6bae847cec service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:53:40.033199 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 748/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:53:42.724901 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07350f-5623-4911-928e-bd97707e3ec0 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:42.725508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07350f-5623-4911-928e-bd97707e3ec0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:42.725508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07350f-5623-4911-928e-bd97707e3ec0 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:42.726878 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 743/1491] 10.222.0.39 () {54 vars in 926 bytes} [Tue May 31 20:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:53:42.732216 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a7326-6928-4e40-a48e-4436b287edd3 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:42.732626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a7326-6928-4e40-a48e-4436b287edd3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:42.732776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a7326-6928-4e40-a48e-4436b287edd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:42.750991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-f69a7326-6928-4e40-a48e-4436b287edd3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:53:42.752171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-f69a7326-6928-4e40-a48e-4436b287edd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:53:42.761020 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 749/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Tue May 31 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:53:42.800113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07350f-5623-4911-928e-bd97707e3ec0 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:53:42.811842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07350f-5623-4911-928e-bd97707e3ec0 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:53:42.815305 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0be8-7482-4db9-92a6-1c2c05ab26be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:53:42.815963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0be8-7482-4db9-92a6-1c2c05ab26be service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:53:42.816243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0be8-7482-4db9-92a6-1c2c05ab26be service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:53:42.816577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0be8-7482-4db9-92a6-1c2c05ab26be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:53:42.826012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0be8-7482-4db9-92a6-1c2c05ab26be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:53:42.827432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0be8-7482-4db9-92a6-1c2c05ab26be service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:53:42.837448 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 744/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:53:52.745651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=33 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:53:52.832652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=33 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:53.759635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620edbcd-ebe9-4b0f-88ab-854cd458ddd3 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:53.760315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620edbcd-ebe9-4b0f-88ab-854cd458ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:53.760315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620edbcd-ebe9-4b0f-88ab-854cd458ddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:53.779941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-620edbcd-ebe9-4b0f-88ab-854cd458ddd3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:53.781256 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-620edbcd-ebe9-4b0f-88ab-854cd458ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:53.790183 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 750/1494] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:53.798651 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8b2ab-b55a-4b65-a13a-fe4fb0d4d996 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:53.799326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8b2ab-b55a-4b65-a13a-fe4fb0d4d996 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:53.799326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8b2ab-b55a-4b65-a13a-fe4fb0d4d996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:53.818963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d2d8b2ab-b55a-4b65-a13a-fe4fb0d4d996 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:53.820190 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d2d8b2ab-b55a-4b65-a13a-fe4fb0d4d996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:53.828748 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 745/1495] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:53.833849 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620edbcd-ebe9-4b0f-88ab-854cd458ddd3 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:53.845040 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620edbcd-ebe9-4b0f-88ab-854cd458ddd3 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:53.849668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415523cb-00eb-4d66-995e-1a22006dfafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:53.850363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415523cb-00eb-4d66-995e-1a22006dfafa admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:53.850646 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415523cb-00eb-4d66-995e-1a22006dfafa admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:53.850920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415523cb-00eb-4d66-995e-1a22006dfafa admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:53.852266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415523cb-00eb-4d66-995e-1a22006dfafa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:55:53.852573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415523cb-00eb-4d66-995e-1a22006dfafa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:53.853644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: WARNING py.warnings [None req-415523cb-00eb-4d66-995e-1a22006dfafa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 20:55:53.853644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: warnings.warn(msg) May 31 20:55:53.853644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: May 31 20:55:53.854527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415523cb-00eb-4d66-995e-1a22006dfafa admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:53.867159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 751/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 20:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:55:53.875891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8b2ab-b55a-4b65-a13a-fe4fb0d4d996 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:53.886188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8b2ab-b55a-4b65-a13a-fe4fb0d4d996 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:53.891157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26892ec-44ca-4ddc-8d79-186aba80df9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:53.891870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26892ec-44ca-4ddc-8d79-186aba80df9f admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:53.892189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26892ec-44ca-4ddc-8d79-186aba80df9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:53.892500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26892ec-44ca-4ddc-8d79-186aba80df9f admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:53.893239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26892ec-44ca-4ddc-8d79-186aba80df9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:53.895062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: WARNING py.warnings [None req-c26892ec-44ca-4ddc-8d79-186aba80df9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:55:53.895062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: warnings.warn(msg) May 31 20:55:53.895062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: May 31 20:55:53.896377 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26892ec-44ca-4ddc-8d79-186aba80df9f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:54.051884 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 746/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:55:53 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:55:54.053610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415523cb-00eb-4d66-995e-1a22006dfafa admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:54.065184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415523cb-00eb-4d66-995e-1a22006dfafa admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:54.135812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb155269-1835-416f-aae6-46256dceea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:54.136484 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb155269-1835-416f-aae6-46256dceea56 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:54.136768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb155269-1835-416f-aae6-46256dceea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:54.137044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb155269-1835-416f-aae6-46256dceea56 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:54.137810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb155269-1835-416f-aae6-46256dceea56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:54.138881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: WARNING py.warnings [None req-cb155269-1835-416f-aae6-46256dceea56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:55:54.138881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: warnings.warn(msg) May 31 20:55:54.138881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: May 31 20:55:54.140152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb155269-1835-416f-aae6-46256dceea56 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:54.230868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 752/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:55:54 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:55:54.235287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26892ec-44ca-4ddc-8d79-186aba80df9f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:54.247117 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26892ec-44ca-4ddc-8d79-186aba80df9f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:54.252321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0539c7f-d473-4b45-92d6-5347995f7d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:54.253033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0539c7f-d473-4b45-92d6-5347995f7d42 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:54.253360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0539c7f-d473-4b45-92d6-5347995f7d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:54.253740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0539c7f-d473-4b45-92d6-5347995f7d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:54.254523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0539c7f-d473-4b45-92d6-5347995f7d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:54.255586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: WARNING py.warnings [None req-b0539c7f-d473-4b45-92d6-5347995f7d42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 20:55:54.255586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: warnings.warn(msg) May 31 20:55:54.255586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: May 31 20:55:54.256617 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0539c7f-d473-4b45-92d6-5347995f7d42 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:54.270663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 747/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:55:54.275502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb155269-1835-416f-aae6-46256dceea56 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:54.285927 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb155269-1835-416f-aae6-46256dceea56 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:54.291683 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140acca-ab8c-47c1-a415-1a2f9f7b1d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:54.292354 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140acca-ab8c-47c1-a415-1a2f9f7b1d8d admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:54.292639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140acca-ab8c-47c1-a415-1a2f9f7b1d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:54.292917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140acca-ab8c-47c1-a415-1a2f9f7b1d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:54.293677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140acca-ab8c-47c1-a415-1a2f9f7b1d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:54.294706 dv-cinder-839793-16-smb devstack@keystone.service[87215]: WARNING py.warnings [None req-1140acca-ab8c-47c1-a415-1a2f9f7b1d8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 20:55:54.294706 dv-cinder-839793-16-smb devstack@keystone.service[87215]: warnings.warn(msg) May 31 20:55:54.294706 dv-cinder-839793-16-smb devstack@keystone.service[87215]: May 31 20:55:54.295605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140acca-ab8c-47c1-a415-1a2f9f7b1d8d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:54.314100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 753/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:55:54.318586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0539c7f-d473-4b45-92d6-5347995f7d42 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:54.329365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0539c7f-d473-4b45-92d6-5347995f7d42 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:54.333989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58bcae-a9c8-4f52-9464-c306865af09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:54.334923 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58bcae-a9c8-4f52-9464-c306865af09e admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:54.335252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58bcae-a9c8-4f52-9464-c306865af09e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:54.335575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58bcae-a9c8-4f52-9464-c306865af09e admin admin] PATH_INFO: `/v3/projects/b74ef49e9bfd4243ba3fa34d88af7af0/users/f2c99acc27e741caaa0386e27d6dd6df/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:54.352658 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58bcae-a9c8-4f52-9464-c306865af09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74ef49e9bfd4243ba3fa34d88af7af0, user_id=f2c99acc27e741caaa0386e27d6dd6df, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:54.353753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: WARNING py.warnings [None req-6a58bcae-a9c8-4f52-9464-c306865af09e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:55:54.353753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: warnings.warn(msg) May 31 20:55:54.353753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: May 31 20:55:54.355705 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58bcae-a9c8-4f52-9464-c306865af09e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:54.422149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 748/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:55:54 2022] PUT /identity/v3/projects/b74ef49e9bfd4243ba3fa34d88af7af0/users/f2c99acc27e741caaa0386e27d6dd6df/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:55:54.435219 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b12e76-8cd2-4093-ac00-0c30ea6133aa None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:54.435523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b12e76-8cd2-4093-ac00-0c30ea6133aa None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:54.435831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b12e76-8cd2-4093-ac00-0c30ea6133aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:54.467321 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a1b12e76-8cd2-4093-ac00-0c30ea6133aa None None] MFA Rules not processed for user `f2c99acc27e741caaa0386e27d6dd6df`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:54.468592 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a1b12e76-8cd2-4093-ac00-0c30ea6133aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:54.538295 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 754/1502] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:55:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:54.551691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f1aa8-81d7-4cb2-bf0b-0ff15bd37676 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:54.551977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f1aa8-81d7-4cb2-bf0b-0ff15bd37676 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:54.552257 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f1aa8-81d7-4cb2-bf0b-0ff15bd37676 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:54.553709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 749/1503] 10.222.0.39 () {54 vars in 963 bytes} [Tue May 31 20:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:54.560296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bab526-c048-4333-a352-ff185735967e None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:54.560686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bab526-c048-4333-a352-ff185735967e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:54.561110 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bab526-c048-4333-a352-ff185735967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:54.589177 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-24bab526-c048-4333-a352-ff185735967e None None] MFA Rules not processed for user `7cfcecd035214e2181622eb6b30ddf62`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:54.591234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-24bab526-c048-4333-a352-ff185735967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:54.657720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:54.668726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 755/1504] 10.222.0.39 () {58 vars in 1060 bytes} [Tue May 31 20:55:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:54.677531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f1aa8-81d7-4cb2-bf0b-0ff15bd37676 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:54.690074 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f1aa8-81d7-4cb2-bf0b-0ff15bd37676 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:54.693862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8def8d-1dd0-4c5c-8eb2-3c6925bb2027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:54.694572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8def8d-1dd0-4c5c-8eb2-3c6925bb2027 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:54.694886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8def8d-1dd0-4c5c-8eb2-3c6925bb2027 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:54.695229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8def8d-1dd0-4c5c-8eb2-3c6925bb2027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:54.705426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8def8d-1dd0-4c5c-8eb2-3c6925bb2027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:54.707003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8def8d-1dd0-4c5c-8eb2-3c6925bb2027 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:54.717677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 750/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:55:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:54.769437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae6dcc-dba6-4411-b093-62df2bd5983f None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:54.770154 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae6dcc-dba6-4411-b093-62df2bd5983f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:54.770369 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae6dcc-dba6-4411-b093-62df2bd5983f None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:54.771794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 756/1506] 10.222.0.39 () {52 vars in 829 bytes} [Tue May 31 20:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:55:54.776965 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8def8d-1dd0-4c5c-8eb2-3c6925bb2027 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:54.845420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8def8d-1dd0-4c5c-8eb2-3c6925bb2027 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:54.850557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:54.852002 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:54.852288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:54.852560 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] PATH_INFO: `/v3/users/f2c99acc27e741caaa0386e27d6dd6df` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:54.853788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c99acc27e741caaa0386e27d6dd6df)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:54.854823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: WARNING py.warnings [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:55:54.854823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: warnings.warn(msg) May 31 20:55:54.854823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: May 31 20:55:54.856017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:55.114396 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c99acc27e741caaa0386e27d6dd6df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:55:55.201304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c99acc27e741caaa0386e27d6dd6df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:55:55.202086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c99acc27e741caaa0386e27d6dd6df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:55:55.215695 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c99acc27e741caaa0386e27d6dd6df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:55:55.216410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c99acc27e741caaa0386e27d6dd6df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:55:55.233067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:55.241259 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 751/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 20:55:54 2022] DELETE /identity/v3/users/f2c99acc27e741caaa0386e27d6dd6df => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:55:55.245836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb1ef2-d386-40b1-95e4-115b3ca6619b None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:55.246130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb1ef2-d386-40b1-95e4-115b3ca6619b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:55.246409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb1ef2-d386-40b1-95e4-115b3ca6619b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:55.264347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-d1fb1ef2-d386-40b1-95e4-115b3ca6619b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:55.265739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d1fb1ef2-d386-40b1-95e4-115b3ca6619b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:55.331115 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 757/1508] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:55.341752 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:55.343293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:55.410020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f54ff-2f03-409e-8d10-754e2de2153f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:55.413574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3d125-a36c-4d0b-a35c-c52c054b6407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:55.414863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3d125-a36c-4d0b-a35c-c52c054b6407 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:55.415142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3d125-a36c-4d0b-a35c-c52c054b6407 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:55.415440 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3d125-a36c-4d0b-a35c-c52c054b6407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:55.424740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3d125-a36c-4d0b-a35c-c52c054b6407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:55.426209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3d125-a36c-4d0b-a35c-c52c054b6407 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:55.435919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 752/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:56.097742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb1ef2-d386-40b1-95e4-115b3ca6619b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:56.099451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d1fb1ef2-d386-40b1-95e4-115b3ca6619b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:56.111834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb1ef2-d386-40b1-95e4-115b3ca6619b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:56.117709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:56.118769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:56.119270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:56.119762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b admin admin] PATH_INFO: `/v3/projects/b74ef49e9bfd4243ba3fa34d88af7af0` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:56.121498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74ef49e9bfd4243ba3fa34d88af7af0)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:56.124109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: WARNING py.warnings [None req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:55:56.124109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: warnings.warn(msg) May 31 20:55:56.124109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: May 31 20:55:56.126903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:56.275625 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74ef49e9bfd4243ba3fa34d88af7af0', 'request_id': 'req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:55:56.353498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74ef49e9bfd4243ba3fa34d88af7af0', 'request_id': 'req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:55:56.361577 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74ef49e9bfd4243ba3fa34d88af7af0', 'request_id': 'req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:55:56.382669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b admin admin] The token cache is being invalidate because project b74ef49e9bfd4243ba3fa34d88af7af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 20:55:56.382960 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:55:56.383655 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-ba901c84-6828-4bdf-ad8b-2ad5e133ec9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:55:56.385363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 758/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 20:55:56 2022] DELETE /identity/v3/projects/b74ef49e9bfd4243ba3fa34d88af7af0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:56:05.431565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:56:06.379245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:57:41.617637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f106aa-0c0d-4c9e-934f-4d2d2d3ab03c None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:41.618266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f106aa-0c0d-4c9e-934f-4d2d2d3ab03c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:41.618266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f106aa-0c0d-4c9e-934f-4d2d2d3ab03c None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:41.619488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:41.624345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03f253-4585-4a85-bd9d-a8efa52c56cd None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:41.624833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03f253-4585-4a85-bd9d-a8efa52c56cd None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:41.624944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03f253-4585-4a85-bd9d-a8efa52c56cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:41.645281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-2a03f253-4585-4a85-bd9d-a8efa52c56cd None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:41.646602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2a03f253-4585-4a85-bd9d-a8efa52c56cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:41.706205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:41.878133 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f106aa-0c0d-4c9e-934f-4d2d2d3ab03c None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:41.882202 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-54f106aa-0c0d-4c9e-934f-4d2d2d3ab03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:41.961251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f106aa-0c0d-4c9e-934f-4d2d2d3ab03c None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:41.966665 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328f903-328b-4a04-8d91-277e8a20b410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:41.967322 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328f903-328b-4a04-8d91-277e8a20b410 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:41.967608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328f903-328b-4a04-8d91-277e8a20b410 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:41.967886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328f903-328b-4a04-8d91-277e8a20b410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:41.976167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328f903-328b-4a04-8d91-277e8a20b410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:41.977825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328f903-328b-4a04-8d91-277e8a20b410 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:41.987421 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 754/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:42.871496 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c1fb9-92e4-4265-98db-be4fbcc10f52 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:42.872091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c1fb9-92e4-4265-98db-be4fbcc10f52 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:42.872091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c1fb9-92e4-4265-98db-be4fbcc10f52 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:42.873620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:42.879395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4c389-ba36-42ce-be76-0a319434369c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:42.879989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4c389-ba36-42ce-be76-0a319434369c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:42.879989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4c389-ba36-42ce-be76-0a319434369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:42.899534 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-18b4c389-ba36-42ce-be76-0a319434369c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:42.900730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-18b4c389-ba36-42ce-be76-0a319434369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:42.908557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:42.918352 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0588ee-b428-4b14-9cb4-0e93dd814560 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:42.918708 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0588ee-b428-4b14-9cb4-0e93dd814560 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:42.919079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0588ee-b428-4b14-9cb4-0e93dd814560 None None] PATH_INFO: `/v3` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:42.920352 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 761/1516] 10.222.0.32 () {54 vars in 925 bytes} [Tue May 31 20:57:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:57:42.926532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a3038-6636-451c-afd7-a7749d07d2e1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:42.926897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a3038-6636-451c-afd7-a7749d07d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:42.927235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a3038-6636-451c-afd7-a7749d07d2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:42.946634 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2b1a3038-6636-451c-afd7-a7749d07d2e1 None None] MFA Rules not processed for user `619d0b5afa094289808516486a5e3c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:42.947766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2b1a3038-6636-451c-afd7-a7749d07d2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:43.013082 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 756/1517] 10.222.0.32 () {58 vars in 1015 bytes} [Tue May 31 20:57:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:57:43.061336 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0588ee-b428-4b14-9cb4-0e93dd814560 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:43.076364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0588ee-b428-4b14-9cb4-0e93dd814560 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:43.081976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce712d-029b-4a11-89f9-9f076d05cdd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:43.082615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce712d-029b-4a11-89f9-9f076d05cdd9 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:43.082925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce712d-029b-4a11-89f9-9f076d05cdd9 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:43.083204 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce712d-029b-4a11-89f9-9f076d05cdd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:43.093049 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce712d-029b-4a11-89f9-9f076d05cdd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:43.094773 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce712d-029b-4a11-89f9-9f076d05cdd9 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:43.104586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 762/1518] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:47.141804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242a243-e9f3-42a4-8030-a1d22af5f297 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:47.142368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242a243-e9f3-42a4-8030-a1d22af5f297 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:47.142495 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242a243-e9f3-42a4-8030-a1d22af5f297 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:47.143831 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 757/1519] 10.222.0.39 () {54 vars in 960 bytes} [Tue May 31 20:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:47.150263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3e9e3-a3eb-41c6-87f0-84dbefe8b10f None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:47.150865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3e9e3-a3eb-41c6-87f0-84dbefe8b10f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:47.150865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3e9e3-a3eb-41c6-87f0-84dbefe8b10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:47.170533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-90f3e9e3-a3eb-41c6-87f0-84dbefe8b10f None None] MFA Rules not processed for user `619d0b5afa094289808516486a5e3c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:47.171749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-90f3e9e3-a3eb-41c6-87f0-84dbefe8b10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:47.180341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 763/1520] 10.222.0.39 () {58 vars in 1057 bytes} [Tue May 31 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:47.187904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242a243-e9f3-42a4-8030-a1d22af5f297 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:47.200931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242a243-e9f3-42a4-8030-a1d22af5f297 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:47.205961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bdea4-a65c-4245-8c6c-185200680b47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619d0b5afa094289808516486a5e3c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:47.206589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bdea4-a65c-4245-8c6c-185200680b47 service placement] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:47.206869 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bdea4-a65c-4245-8c6c-185200680b47 service placement] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:47.207141 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bdea4-a65c-4245-8c6c-185200680b47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:47.216176 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bdea4-a65c-4245-8c6c-185200680b47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:47.217805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bdea4-a65c-4245-8c6c-185200680b47 service placement] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:47.228028 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 758/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:57:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:54.403532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9e2f-3e02-4bb6-9fb0-f76f97812116 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:54.404197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9e2f-3e02-4bb6-9fb0-f76f97812116 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:54.404197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9e2f-3e02-4bb6-9fb0-f76f97812116 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:54.405348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:54.410703 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8713d15-96ae-4be4-995c-5646f7d388ae None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:54.411229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8713d15-96ae-4be4-995c-5646f7d388ae None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:54.411405 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8713d15-96ae-4be4-995c-5646f7d388ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:54.430047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a8713d15-96ae-4be4-995c-5646f7d388ae None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:54.431269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a8713d15-96ae-4be4-995c-5646f7d388ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:54.439308 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:54.595295 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9e2f-3e02-4bb6-9fb0-f76f97812116 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:54.609537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9e2f-3e02-4bb6-9fb0-f76f97812116 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:54.614805 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c554b98-3181-4fcc-aebb-6b7c1759e6f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:54.622914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c554b98-3181-4fcc-aebb-6b7c1759e6f4 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:54.622914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c554b98-3181-4fcc-aebb-6b7c1759e6f4 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:54.622914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c554b98-3181-4fcc-aebb-6b7c1759e6f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:54.624935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c554b98-3181-4fcc-aebb-6b7c1759e6f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:54.626811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c554b98-3181-4fcc-aebb-6b7c1759e6f4 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:54.637051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 765/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:55.515097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa2c6f-c61f-447d-b922-deaac52854b8 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:55.515674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa2c6f-c61f-447d-b922-deaac52854b8 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:55.515674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa2c6f-c61f-447d-b922-deaac52854b8 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:55.517006 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:55.522056 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533cc14-5d4d-491a-8b73-aeb5d1ecd335 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:55.522513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533cc14-5d4d-491a-8b73-aeb5d1ecd335 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:55.522619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533cc14-5d4d-491a-8b73-aeb5d1ecd335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:55.540836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-7533cc14-5d4d-491a-8b73-aeb5d1ecd335 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:55.542063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7533cc14-5d4d-491a-8b73-aeb5d1ecd335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:55.550258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:55.703765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa2c6f-c61f-447d-b922-deaac52854b8 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:55.717904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa2c6f-c61f-447d-b922-deaac52854b8 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:55.723284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb328d-2ce0-4f57-b89e-bed50ca1c45f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:55.723918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb328d-2ce0-4f57-b89e-bed50ca1c45f service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:55.724198 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb328d-2ce0-4f57-b89e-bed50ca1c45f service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:55.724472 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb328d-2ce0-4f57-b89e-bed50ca1c45f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:55.733489 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb328d-2ce0-4f57-b89e-bed50ca1c45f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:55.735076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb328d-2ce0-4f57-b89e-bed50ca1c45f service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:55.745163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 761/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:59.758681 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c0884-5705-40b0-911e-6507bfc45cfc None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:59.759310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c0884-5705-40b0-911e-6507bfc45cfc None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:59.759310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c0884-5705-40b0-911e-6507bfc45cfc None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:59.760627 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:59.766087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147add2-8c7a-4b1d-95e9-e84a5ed81260 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:59.766537 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147add2-8c7a-4b1d-95e9-e84a5ed81260 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:59.766637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147add2-8c7a-4b1d-95e9-e84a5ed81260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:59.784973 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e147add2-8c7a-4b1d-95e9-e84a5ed81260 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:59.786200 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e147add2-8c7a-4b1d-95e9-e84a5ed81260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:59.794570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:59.830501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c0884-5705-40b0-911e-6507bfc45cfc None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:59.832237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e53c0884-5705-40b0-911e-6507bfc45cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:59.894102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c0884-5705-40b0-911e-6507bfc45cfc None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:59.898203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248200a-279a-4490-8ca3-264f87e668b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:59.898854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248200a-279a-4490-8ca3-264f87e668b6 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:59.899136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248200a-279a-4490-8ca3-264f87e668b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:59.899412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248200a-279a-4490-8ca3-264f87e668b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:59.908518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248200a-279a-4490-8ca3-264f87e668b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:59.909991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248200a-279a-4490-8ca3-264f87e668b6 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:59.920219 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 768/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:58:02.220666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81919ec4-73c6-46aa-aa47-a38b2fd2b3d9 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:58:02.221242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81919ec4-73c6-46aa-aa47-a38b2fd2b3d9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:58:02.221453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81919ec4-73c6-46aa-aa47-a38b2fd2b3d9 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:58:02.223220 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:58:02.230004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c68c-4ee8-4036-bd38-d1ce88f5905b None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:58:02.230599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c68c-4ee8-4036-bd38-d1ce88f5905b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:58:02.230599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c68c-4ee8-4036-bd38-d1ce88f5905b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:58:02.251726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-cb44c68c-4ee8-4036-bd38-d1ce88f5905b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:58:02.252956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-cb44c68c-4ee8-4036-bd38-d1ce88f5905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:58:02.261918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:58:02.299313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81919ec4-73c6-46aa-aa47-a38b2fd2b3d9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:58:02.301211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-81919ec4-73c6-46aa-aa47-a38b2fd2b3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:58:02.315335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81919ec4-73c6-46aa-aa47-a38b2fd2b3d9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:58:02.319394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4373a28-c072-4a9e-b6ad-8a8349868ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:58:02.320057 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373a28-c072-4a9e-b6ad-8a8349868ffa service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:58:02.320337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373a28-c072-4a9e-b6ad-8a8349868ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:58:02.320608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373a28-c072-4a9e-b6ad-8a8349868ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:58:02.330083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4373a28-c072-4a9e-b6ad-8a8349868ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:58:02.331553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4373a28-c072-4a9e-b6ad-8a8349868ffa service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:58:02.341611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 764/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:58:06.127092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad791410-df97-4441-895d-99c08c11837f None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:58:06.127753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad791410-df97-4441-895d-99c08c11837f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:58:06.127753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad791410-df97-4441-895d-99c08c11837f None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:58:06.129018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:58:06.134963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47820bb-4280-4d44-9744-b9536c54d3f4 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:58:06.135395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47820bb-4280-4d44-9744-b9536c54d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:58:06.135524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47820bb-4280-4d44-9744-b9536c54d3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:58:06.143931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=91 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:58:06.156826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d47820bb-4280-4d44-9744-b9536c54d3f4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:58:06.158068 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d47820bb-4280-4d44-9744-b9536c54d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:58:06.166098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:58:06.441746 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad791410-df97-4441-895d-99c08c11837f None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:58:06.443421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ad791410-df97-4441-895d-99c08c11837f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:58:06.501290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad791410-df97-4441-895d-99c08c11837f None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:58:06.504805 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f9d65-21a3-4490-9ed5-5451aa2647a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:58:06.505588 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f9d65-21a3-4490-9ed5-5451aa2647a9 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:58:06.505905 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f9d65-21a3-4490-9ed5-5451aa2647a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:58:06.506186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f9d65-21a3-4490-9ed5-5451aa2647a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:58:06.515274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f9d65-21a3-4490-9ed5-5451aa2647a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:58:06.516710 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f9d65-21a3-4490-9ed5-5451aa2647a9 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:58:06.522194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:58:06.527117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 771/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:58:08.839707 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e3734-3be5-4e2c-a96d-b930dcbf6669 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:58:08.840346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e3734-3be5-4e2c-a96d-b930dcbf6669 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:58:08.840346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e3734-3be5-4e2c-a96d-b930dcbf6669 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:58:08.841767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:58:08.847265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd93f9-287d-4fe8-a259-9c460b9978b3 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:58:08.847807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd93f9-287d-4fe8-a259-9c460b9978b3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:58:08.847807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd93f9-287d-4fe8-a259-9c460b9978b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:58:08.866541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-d7bd93f9-287d-4fe8-a259-9c460b9978b3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:58:08.867778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d7bd93f9-287d-4fe8-a259-9c460b9978b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:58:08.876192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:58:09.157241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e3734-3be5-4e2c-a96d-b930dcbf6669 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:58:09.158984 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c27e3734-3be5-4e2c-a96d-b930dcbf6669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:58:09.172966 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e3734-3be5-4e2c-a96d-b930dcbf6669 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:58:09.176538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44e38a-7962-44c5-b5e2-df776ec7545d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:58:09.177169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e38a-7962-44c5-b5e2-df776ec7545d service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:58:09.177492 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e38a-7962-44c5-b5e2-df776ec7545d service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:58:09.178372 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e38a-7962-44c5-b5e2-df776ec7545d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:58:09.187498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44e38a-7962-44c5-b5e2-df776ec7545d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:58:09.188921 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44e38a-7962-44c5-b5e2-df776ec7545d service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:58:09.199528 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 767/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:58:18.860388 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:58:19.195040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=8 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:42.335399 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3818-09e2-486c-ab99-931fd485d4ad None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.336066 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3818-09e2-486c-ab99-931fd485d4ad None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.336066 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3818-09e2-486c-ab99-931fd485d4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.365772 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a2aa3818-09e2-486c-ab99-931fd485d4ad None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.366983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a2aa3818-09e2-486c-ab99-931fd485d4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.381027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 773/1540] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:42.390259 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f08d9-97fd-409f-a03b-07c4f6dccee2 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.390856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f08d9-97fd-409f-a03b-07c4f6dccee2 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.390856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f08d9-97fd-409f-a03b-07c4f6dccee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.401302 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7546ff8-41b7-43d1-ad29-204174c71fef None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.401659 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7546ff8-41b7-43d1-ad29-204174c71fef None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.401904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7546ff8-41b7-43d1-ad29-204174c71fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.421637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-425f08d9-97fd-409f-a03b-07c4f6dccee2 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.422875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-425f08d9-97fd-409f-a03b-07c4f6dccee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.425309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a7546ff8-41b7-43d1-ad29-204174c71fef None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.430737 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a7546ff8-41b7-43d1-ad29-204174c71fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.442585 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 768/1541] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:42.444589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 774/1542] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:59:42.447137 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f08d9-97fd-409f-a03b-07c4f6dccee2 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:42.457281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f08d9-97fd-409f-a03b-07c4f6dccee2 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:42.466052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8a63-d40d-4dbb-a88f-25c5ff54d700 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.466363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8a63-d40d-4dbb-a88f-25c5ff54d700 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.466685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8a63-d40d-4dbb-a88f-25c5ff54d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.471160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0423b-3f41-45c6-9c8e-81437103bf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:42.471947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0423b-3f41-45c6-9c8e-81437103bf21 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.472400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0423b-3f41-45c6-9c8e-81437103bf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.472684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0423b-3f41-45c6-9c8e-81437103bf21 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.473452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0423b-3f41-45c6-9c8e-81437103bf21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:59:42.473767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0423b-3f41-45c6-9c8e-81437103bf21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:42.475364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: WARNING py.warnings [None req-22d0423b-3f41-45c6-9c8e-81437103bf21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 20:59:42.475364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: warnings.warn(msg) May 31 20:59:42.475364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: May 31 20:59:42.476285 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0423b-3f41-45c6-9c8e-81437103bf21 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:42.495856 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-1e4a8a63-d40d-4dbb-a88f-25c5ff54d700 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.497083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1e4a8a63-d40d-4dbb-a88f-25c5ff54d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.498743 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 769/1543] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 20:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:59:42.500488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb282a67-b707-4788-972a-028c89015097 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.500784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb282a67-b707-4788-972a-028c89015097 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.501069 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb282a67-b707-4788-972a-028c89015097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.528025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 775/1544] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:42.529275 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-eb282a67-b707-4788-972a-028c89015097 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.529792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f2c12-f5e2-4440-b4b1-abc10a16d803 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.530091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f2c12-f5e2-4440-b4b1-abc10a16d803 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.530378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f2c12-f5e2-4440-b4b1-abc10a16d803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.530962 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-eb282a67-b707-4788-972a-028c89015097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.552012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 770/1545] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:42.552856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb282a67-b707-4788-972a-028c89015097 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:42.565152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-581f2c12-f5e2-4440-b4b1-abc10a16d803 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.566395 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-581f2c12-f5e2-4440-b4b1-abc10a16d803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.567594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb282a67-b707-4788-972a-028c89015097 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:42.573619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e8652-8b79-4eff-a6a6-ddee57c3dbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:42.574301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e8652-8b79-4eff-a6a6-ddee57c3dbdb admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.574586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e8652-8b79-4eff-a6a6-ddee57c3dbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.574862 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 776/1546] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:42.575702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f2c12-f5e2-4440-b4b1-abc10a16d803 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:42.581713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e8652-8b79-4eff-a6a6-ddee57c3dbdb admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.582537 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e8652-8b79-4eff-a6a6-ddee57c3dbdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:42.584473 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e8652-8b79-4eff-a6a6-ddee57c3dbdb admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:42.590366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f2c12-f5e2-4440-b4b1-abc10a16d803 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:42.598321 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3a7f2-1e60-4346-a6e3-0ed8727e32e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:42.599119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3a7f2-1e60-4346-a6e3-0ed8727e32e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.599427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3a7f2-1e60-4346-a6e3-0ed8727e32e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.599717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3a7f2-1e60-4346-a6e3-0ed8727e32e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.600451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3a7f2-1e60-4346-a6e3-0ed8727e32e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:59:42.600755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3a7f2-1e60-4346-a6e3-0ed8727e32e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:42.602684 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3a7f2-1e60-4346-a6e3-0ed8727e32e3 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:42.615507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 777/1547] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 20:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:59:42.621010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ae06c-58ac-40fd-b5ef-102a6a2cf556 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.621010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ae06c-58ac-40fd-b5ef-102a6a2cf556 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.621010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ae06c-58ac-40fd-b5ef-102a6a2cf556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.639373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-198ae06c-58ac-40fd-b5ef-102a6a2cf556 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.640561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-198ae06c-58ac-40fd-b5ef-102a6a2cf556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.649010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 778/1548] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:42.650954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e203f-934e-4cf7-9320-e244bc9465e9 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.650954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e203f-934e-4cf7-9320-e244bc9465e9 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.650954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e203f-934e-4cf7-9320-e244bc9465e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.669480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-085e203f-934e-4cf7-9320-e244bc9465e9 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.671855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 771/1549] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:42.679986 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-085e203f-934e-4cf7-9320-e244bc9465e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.680142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb0db-7cc0-4aa6-b3fc-ed7daa724ef9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.680142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb0db-7cc0-4aa6-b3fc-ed7daa724ef9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.680142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb0db-7cc0-4aa6-b3fc-ed7daa724ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.692595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-daebb0db-7cc0-4aa6-b3fc-ed7daa724ef9 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.693823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-daebb0db-7cc0-4aa6-b3fc-ed7daa724ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.732014 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 779/1550] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:42.733308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1954d-c8b6-4eba-a3c2-135e52c3f387 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.733623 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1954d-c8b6-4eba-a3c2-135e52c3f387 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.733900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1954d-c8b6-4eba-a3c2-135e52c3f387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.752973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-55d1954d-c8b6-4eba-a3c2-135e52c3f387 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.754213 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-55d1954d-c8b6-4eba-a3c2-135e52c3f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.757647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 772/1551] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:42.758868 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e33ba4-c3a6-4862-8018-5807bb2c908b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.759145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e33ba4-c3a6-4862-8018-5807bb2c908b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.759421 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e33ba4-c3a6-4862-8018-5807bb2c908b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.769630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 780/1552] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:42.770584 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1954d-c8b6-4eba-a3c2-135e52c3f387 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:42.781502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1954d-c8b6-4eba-a3c2-135e52c3f387 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:42.782105 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-91e33ba4-c3a6-4862-8018-5807bb2c908b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.783345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-91e33ba4-c3a6-4862-8018-5807bb2c908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.786676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308f6b3-dc15-43b9-948a-9c0f6e490193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:42.787349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308f6b3-dc15-43b9-948a-9c0f6e490193 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.787627 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308f6b3-dc15-43b9-948a-9c0f6e490193 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.788025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308f6b3-dc15-43b9-948a-9c0f6e490193 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.788710 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308f6b3-dc15-43b9-948a-9c0f6e490193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:42.789760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: WARNING py.warnings [None req-7308f6b3-dc15-43b9-948a-9c0f6e490193 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:59:42.789760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: warnings.warn(msg) May 31 20:59:42.789760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: May 31 20:59:42.790940 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308f6b3-dc15-43b9-948a-9c0f6e490193 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:42.791893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 773/1553] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:42.793105 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5480e-3190-445c-aa77-721266a7c9c8 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.793419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5480e-3190-445c-aa77-721266a7c9c8 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.793778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5480e-3190-445c-aa77-721266a7c9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.815307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ffc5480e-3190-445c-aa77-721266a7c9c8 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.816442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ffc5480e-3190-445c-aa77-721266a7c9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.824537 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 774/1554] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:42.825847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c69b85-123d-478b-b4f3-252576a1f771 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.826135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c69b85-123d-478b-b4f3-252576a1f771 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.826426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c69b85-123d-478b-b4f3-252576a1f771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.844642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-68c69b85-123d-478b-b4f3-252576a1f771 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.845880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-68c69b85-123d-478b-b4f3-252576a1f771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.854150 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 775/1555] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:42.854945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c69b85-123d-478b-b4f3-252576a1f771 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:42.864942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c69b85-123d-478b-b4f3-252576a1f771 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:42.869455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c051f62-e37b-4686-a0b3-b4a5f13c6c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:42.870099 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051f62-e37b-4686-a0b3-b4a5f13c6c25 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.870382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051f62-e37b-4686-a0b3-b4a5f13c6c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.870661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051f62-e37b-4686-a0b3-b4a5f13c6c25 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.871460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c051f62-e37b-4686-a0b3-b4a5f13c6c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:42.872501 dv-cinder-839793-16-smb devstack@keystone.service[87216]: WARNING py.warnings [None req-2c051f62-e37b-4686-a0b3-b4a5f13c6c25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:59:42.872501 dv-cinder-839793-16-smb devstack@keystone.service[87216]: warnings.warn(msg) May 31 20:59:42.872501 dv-cinder-839793-16-smb devstack@keystone.service[87216]: May 31 20:59:42.873978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c051f62-e37b-4686-a0b3-b4a5f13c6c25 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:42.885900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 781/1556] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:42.885900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308f6b3-dc15-43b9-948a-9c0f6e490193 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:42.940982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 776/1557] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/users => generated 291 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:42.942145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d9b65-2210-4273-b18d-67f8eb13902e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.942554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d9b65-2210-4273-b18d-67f8eb13902e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.942705 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d9b65-2210-4273-b18d-67f8eb13902e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.945356 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308f6b3-dc15-43b9-948a-9c0f6e490193 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:42.950125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301d007-9e43-4944-b6bb-53dfe44cf652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:42.950793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301d007-9e43-4944-b6bb-53dfe44cf652 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.951147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301d007-9e43-4944-b6bb-53dfe44cf652 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.951376 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301d007-9e43-4944-b6bb-53dfe44cf652 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.952132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301d007-9e43-4944-b6bb-53dfe44cf652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:59:42.952441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301d007-9e43-4944-b6bb-53dfe44cf652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:42.954177 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301d007-9e43-4944-b6bb-53dfe44cf652 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:42.961566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-401d9b65-2210-4273-b18d-67f8eb13902e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.962846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-401d9b65-2210-4273-b18d-67f8eb13902e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:42.966714 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 782/1558] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 20:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:59:42.967541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301d007-9e43-4944-b6bb-53dfe44cf652 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:42.977658 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 777/1559] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:42.979167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df0e03-189d-4e12-828a-357481e38eef None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.979337 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301d007-9e43-4944-b6bb-53dfe44cf652 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:42.979555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df0e03-189d-4e12-828a-357481e38eef None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.980004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df0e03-189d-4e12-828a-357481e38eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.985242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b79d8-16f1-482d-b267-a43211db2092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:42.985966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b79d8-16f1-482d-b267-a43211db2092 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:42.986253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b79d8-16f1-482d-b267-a43211db2092 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:42.986529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b79d8-16f1-482d-b267-a43211db2092 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:42.987260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b79d8-16f1-482d-b267-a43211db2092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:59:42.987573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b79d8-16f1-482d-b267-a43211db2092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:42.989218 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b79d8-16f1-482d-b267-a43211db2092 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:42.998280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-71df0e03-189d-4e12-828a-357481e38eef None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:42.999734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-71df0e03-189d-4e12-828a-357481e38eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:43.002057 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 783/1560] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 20:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:59:43.007933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 778/1561] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:43.008893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df0e03-189d-4e12-828a-357481e38eef None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.010501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e72134-8ba8-4891-9a00-e94503c5aec3 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.010794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e72134-8ba8-4891-9a00-e94503c5aec3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.011073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e72134-8ba8-4891-9a00-e94503c5aec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.018805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df0e03-189d-4e12-828a-357481e38eef None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.023861 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6353aa-b045-472a-abf4-8cdae7b80d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.024047 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:43.024511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6353aa-b045-472a-abf4-8cdae7b80d5f admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.024796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6353aa-b045-472a-abf4-8cdae7b80d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.025075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6353aa-b045-472a-abf4-8cdae7b80d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.025828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6353aa-b045-472a-abf4-8cdae7b80d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:59:43.026136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6353aa-b045-472a-abf4-8cdae7b80d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.027727 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6353aa-b045-472a-abf4-8cdae7b80d5f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.031016 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-73e72134-8ba8-4891-9a00-e94503c5aec3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:43.032236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-73e72134-8ba8-4891-9a00-e94503c5aec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:43.040584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 779/1562] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 20:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:59:43.041837 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6353aa-b045-472a-abf4-8cdae7b80d5f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.042895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 784/1563] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:43.043650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e72134-8ba8-4891-9a00-e94503c5aec3 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.054406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6353aa-b045-472a-abf4-8cdae7b80d5f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.054961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e72134-8ba8-4891-9a00-e94503c5aec3 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.059273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94029fd6-2e20-4767-9f0b-5fbcbca0f9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.059775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac4e22-7074-4862-a56c-35529bbbb555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.059940 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94029fd6-2e20-4767-9f0b-5fbcbca0f9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.065788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94029fd6-2e20-4767-9f0b-5fbcbca0f9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.065933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac4e22-7074-4862-a56c-35529bbbb555 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.066075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94029fd6-2e20-4767-9f0b-5fbcbca0f9d2 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.066174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac4e22-7074-4862-a56c-35529bbbb555 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.066174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac4e22-7074-4862-a56c-35529bbbb555 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.066357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94029fd6-2e20-4767-9f0b-5fbcbca0f9d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.066446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac4e22-7074-4862-a56c-35529bbbb555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.066556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94029fd6-2e20-4767-9f0b-5fbcbca0f9d2 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.066643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac4e22-7074-4862-a56c-35529bbbb555 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.074420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 785/1564] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:43.075231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac4e22-7074-4862-a56c-35529bbbb555 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.085749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac4e22-7074-4862-a56c-35529bbbb555 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.091359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeedc4f-34fa-4e11-a214-14d81145bad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.094465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeedc4f-34fa-4e11-a214-14d81145bad5 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.094465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeedc4f-34fa-4e11-a214-14d81145bad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.094465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeedc4f-34fa-4e11-a214-14d81145bad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.094465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeedc4f-34fa-4e11-a214-14d81145bad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.095396 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeedc4f-34fa-4e11-a214-14d81145bad5 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.144692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 780/1565] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:43 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:43.145856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94029fd6-2e20-4767-9f0b-5fbcbca0f9d2 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.155779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94029fd6-2e20-4767-9f0b-5fbcbca0f9d2 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.161606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761717c6-36e2-425f-9b5e-5d046d263253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.163294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761717c6-36e2-425f-9b5e-5d046d263253 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.163294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761717c6-36e2-425f-9b5e-5d046d263253 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.163294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761717c6-36e2-425f-9b5e-5d046d263253 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.163619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761717c6-36e2-425f-9b5e-5d046d263253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:59:43.163928 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761717c6-36e2-425f-9b5e-5d046d263253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.165553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761717c6-36e2-425f-9b5e-5d046d263253 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.177807 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 781/1566] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 20:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:59:43.178919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761717c6-36e2-425f-9b5e-5d046d263253 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.188625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761717c6-36e2-425f-9b5e-5d046d263253 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.191250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 786/1567] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:43 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:43.192052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeedc4f-34fa-4e11-a214-14d81145bad5 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.196020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b2ef5-076b-40b6-b813-45b0d58b910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.196775 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b2ef5-076b-40b6-b813-45b0d58b910a admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.197067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b2ef5-076b-40b6-b813-45b0d58b910a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.197346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b2ef5-076b-40b6-b813-45b0d58b910a admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.198058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b2ef5-076b-40b6-b813-45b0d58b910a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.199975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b2ef5-076b-40b6-b813-45b0d58b910a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.215223 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:43.256250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeedc4f-34fa-4e11-a214-14d81145bad5 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.260861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79086c-c57b-4442-b430-6744630c16ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.261556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79086c-c57b-4442-b430-6744630c16ce admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.261846 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79086c-c57b-4442-b430-6744630c16ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.262124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79086c-c57b-4442-b430-6744630c16ce admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.262843 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79086c-c57b-4442-b430-6744630c16ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:59:43.263151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79086c-c57b-4442-b430-6744630c16ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.264780 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79086c-c57b-4442-b430-6744630c16ce admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.277066 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 787/1568] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 20:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:59:43.278160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79086c-c57b-4442-b430-6744630c16ce admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.288049 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79086c-c57b-4442-b430-6744630c16ce admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.290804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 782/1569] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:43 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:43.291886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b2ef5-076b-40b6-b813-45b0d58b910a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.293104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be746832-8166-4684-a4c1-ade43b95913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.293782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be746832-8166-4684-a4c1-ade43b95913f admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.294078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be746832-8166-4684-a4c1-ade43b95913f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.294333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be746832-8166-4684-a4c1-ade43b95913f admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.295005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be746832-8166-4684-a4c1-ade43b95913f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.296924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be746832-8166-4684-a4c1-ade43b95913f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.360894 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b2ef5-076b-40b6-b813-45b0d58b910a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.365315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf445d67-d89f-48dc-8658-778069d9541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.365994 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf445d67-d89f-48dc-8658-778069d9541b admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.366272 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf445d67-d89f-48dc-8658-778069d9541b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.366543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf445d67-d89f-48dc-8658-778069d9541b admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.367298 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf445d67-d89f-48dc-8658-778069d9541b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:59:43.367618 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf445d67-d89f-48dc-8658-778069d9541b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.369215 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf445d67-d89f-48dc-8658-778069d9541b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.376942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 788/1570] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:43 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:43.377839 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be746832-8166-4684-a4c1-ade43b95913f admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.389577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 783/1571] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 20:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:59:43.389577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf445d67-d89f-48dc-8658-778069d9541b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.396914 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf445d67-d89f-48dc-8658-778069d9541b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.453119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be746832-8166-4684-a4c1-ade43b95913f admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.458266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02d6e1-4317-4339-ad31-0b8782089ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.458575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e1ff5-2b96-49b6-a45e-1227bae1fd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.458982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02d6e1-4317-4339-ad31-0b8782089ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.459252 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e1ff5-2b96-49b6-a45e-1227bae1fd06 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.459363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02d6e1-4317-4339-ad31-0b8782089ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.459524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02d6e1-4317-4339-ad31-0b8782089ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.459623 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e1ff5-2b96-49b6-a45e-1227bae1fd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.459801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e1ff5-2b96-49b6-a45e-1227bae1fd06 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.460249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02d6e1-4317-4339-ad31-0b8782089ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.460535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e1ff5-2b96-49b6-a45e-1227bae1fd06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.461983 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02d6e1-4317-4339-ad31-0b8782089ac4 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.462210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e1ff5-2b96-49b6-a45e-1227bae1fd06 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.473049 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 784/1572] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:43.473598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 789/1573] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:43.476951 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02d6e1-4317-4339-ad31-0b8782089ac4 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.477093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e1ff5-2b96-49b6-a45e-1227bae1fd06 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.487245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02d6e1-4317-4339-ad31-0b8782089ac4 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.487613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e1ff5-2b96-49b6-a45e-1227bae1fd06 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.491869 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4270b-83e5-4ccf-9a76-3390abf5880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.492314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3fd14-8d51-43e3-9329-e1edfeb702b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.492637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4270b-83e5-4ccf-9a76-3390abf5880c admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.492845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4270b-83e5-4ccf-9a76-3390abf5880c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.493159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3fd14-8d51-43e3-9329-e1edfeb702b2 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.493301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4270b-83e5-4ccf-9a76-3390abf5880c admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.493475 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3fd14-8d51-43e3-9329-e1edfeb702b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.493761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3fd14-8d51-43e3-9329-e1edfeb702b2 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.494009 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4270b-83e5-4ccf-9a76-3390abf5880c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.494448 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3fd14-8d51-43e3-9329-e1edfeb702b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.495941 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4270b-83e5-4ccf-9a76-3390abf5880c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.496381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3fd14-8d51-43e3-9329-e1edfeb702b2 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.603160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 790/1574] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:43 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:43.603160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3fd14-8d51-43e3-9329-e1edfeb702b2 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.610772 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3fd14-8d51-43e3-9329-e1edfeb702b2 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.611343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 785/1575] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:43 2022] POST /identity/v3/projects => generated 389 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:43.612101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4270b-83e5-4ccf-9a76-3390abf5880c admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.627563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:43.675248 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e90154-59c5-44ff-9c38-b906082f0192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.676503 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e90154-59c5-44ff-9c38-b906082f0192 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.676789 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e90154-59c5-44ff-9c38-b906082f0192 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.677061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e90154-59c5-44ff-9c38-b906082f0192 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.677790 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e90154-59c5-44ff-9c38-b906082f0192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.679874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e90154-59c5-44ff-9c38-b906082f0192 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.689734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4270b-83e5-4ccf-9a76-3390abf5880c admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.695591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c9e88-fb58-43b8-83b3-ab3c7a5538c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.696543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c9e88-fb58-43b8-83b3-ab3c7a5538c3 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.696934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c9e88-fb58-43b8-83b3-ab3c7a5538c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.697214 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c9e88-fb58-43b8-83b3-ab3c7a5538c3 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.697981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c9e88-fb58-43b8-83b3-ab3c7a5538c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.700001 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c9e88-fb58-43b8-83b3-ab3c7a5538c3 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.708870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:43.790147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 791/1576] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:43 2022] POST /identity/v3/projects => generated 391 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:43.790975 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e90154-59c5-44ff-9c38-b906082f0192 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.811580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 786/1577] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:43 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:43.813613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c9e88-fb58-43b8-83b3-ab3c7a5538c3 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.828946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c9e88-fb58-43b8-83b3-ab3c7a5538c3 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.860522 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e90154-59c5-44ff-9c38-b906082f0192 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:43.865937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f188559-b516-4f39-841f-dc95fda06c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.866554 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188559-b516-4f39-841f-dc95fda06c1f admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.866848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188559-b516-4f39-841f-dc95fda06c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.867160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188559-b516-4f39-841f-dc95fda06c1f admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.867847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f188559-b516-4f39-841f-dc95fda06c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.869814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f188559-b516-4f39-841f-dc95fda06c1f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.891967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b8bf5-4fc0-4d1d-972d-5f41d2e3c4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:43.892634 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8bf5-4fc0-4d1d-972d-5f41d2e3c4df admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:43.892917 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8bf5-4fc0-4d1d-972d-5f41d2e3c4df admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:43.893193 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8bf5-4fc0-4d1d-972d-5f41d2e3c4df admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:43.893921 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b8bf5-4fc0-4d1d-972d-5f41d2e3c4df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:43.895897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b8bf5-4fc0-4d1d-972d-5f41d2e3c4df admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:43.968796 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 792/1578] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:43 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:43.969655 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f188559-b516-4f39-841f-dc95fda06c1f admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.973779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 787/1579] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:43 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:43.973779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b8bf5-4fc0-4d1d-972d-5f41d2e3c4df admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:43.983262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f188559-b516-4f39-841f-dc95fda06c1f admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.040893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b8bf5-4fc0-4d1d-972d-5f41d2e3c4df admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.042898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ed866-2ff9-434d-93f2-0f77618b2c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.043568 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ed866-2ff9-434d-93f2-0f77618b2c0f admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.043879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ed866-2ff9-434d-93f2-0f77618b2c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.044151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ed866-2ff9-434d-93f2-0f77618b2c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.044898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ed866-2ff9-434d-93f2-0f77618b2c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.045859 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73431e-e9f7-4a2b-841f-e59c248d793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.046600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ed866-2ff9-434d-93f2-0f77618b2c0f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.046886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73431e-e9f7-4a2b-841f-e59c248d793d admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.047241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73431e-e9f7-4a2b-841f-e59c248d793d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.047588 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73431e-e9f7-4a2b-841f-e59c248d793d admin admin] PATH_INFO: `/v3/projects/b46a24aab1c04e61bf44c517afc6fa32/users/95722c86dd3a4a909a351ad07f8be77d/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.057310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 793/1580] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:44.058171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ed866-2ff9-434d-93f2-0f77618b2c0f admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.064521 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73431e-e9f7-4a2b-841f-e59c248d793d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46a24aab1c04e61bf44c517afc6fa32, user_id=95722c86dd3a4a909a351ad07f8be77d, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.067268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73431e-e9f7-4a2b-841f-e59c248d793d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.068252 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ed866-2ff9-434d-93f2-0f77618b2c0f admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.073050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0c78f-a559-46bc-a40f-1702c3e965c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.073752 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0c78f-a559-46bc-a40f-1702c3e965c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.074038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0c78f-a559-46bc-a40f-1702c3e965c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.074312 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0c78f-a559-46bc-a40f-1702c3e965c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.075040 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0c78f-a559-46bc-a40f-1702c3e965c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.076730 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0c78f-a559-46bc-a40f-1702c3e965c8 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.087777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 794/1581] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:44.088609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0c78f-a559-46bc-a40f-1702c3e965c8 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.098669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0c78f-a559-46bc-a40f-1702c3e965c8 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.103189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c1937-2dba-4387-8755-345552c3f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.103817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c1937-2dba-4387-8755-345552c3f9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.104131 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c1937-2dba-4387-8755-345552c3f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.104374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c1937-2dba-4387-8755-345552c3f9b7 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.105043 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c1937-2dba-4387-8755-345552c3f9b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.107006 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c1937-2dba-4387-8755-345552c3f9b7 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.146376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 788/1582] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:43 2022] PUT /identity/v3/projects/b46a24aab1c04e61bf44c517afc6fa32/users/95722c86dd3a4a909a351ad07f8be77d/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:44.147109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73431e-e9f7-4a2b-841f-e59c248d793d admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.170018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:44.176658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 795/1583] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:44 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:44.181840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c1937-2dba-4387-8755-345552c3f9b7 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.187737 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c1937-2dba-4387-8755-345552c3f9b7 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.212152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73431e-e9f7-4a2b-841f-e59c248d793d admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.217045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c008fad-8c54-48fb-be8c-a3dbe1b0734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.217858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c008fad-8c54-48fb-be8c-a3dbe1b0734f admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.218108 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c008fad-8c54-48fb-be8c-a3dbe1b0734f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.218388 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c008fad-8c54-48fb-be8c-a3dbe1b0734f admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.219084 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c008fad-8c54-48fb-be8c-a3dbe1b0734f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.221027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c008fad-8c54-48fb-be8c-a3dbe1b0734f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.229738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:44.245882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ac6b2-0820-40c9-9557-408500c3a4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.246558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac6b2-0820-40c9-9557-408500c3a4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.246843 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac6b2-0820-40c9-9557-408500c3a4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.247119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac6b2-0820-40c9-9557-408500c3a4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.247843 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ac6b2-0820-40c9-9557-408500c3a4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.249890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ac6b2-0820-40c9-9557-408500c3a4d0 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.260552 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 796/1584] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:44.261570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ac6b2-0820-40c9-9557-408500c3a4d0 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.271189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ac6b2-0820-40c9-9557-408500c3a4d0 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.278375 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d344f01-b5b8-48f2-8221-f3d52a1daa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.278375 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d344f01-b5b8-48f2-8221-f3d52a1daa2c admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.278375 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d344f01-b5b8-48f2-8221-f3d52a1daa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.278375 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d344f01-b5b8-48f2-8221-f3d52a1daa2c admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.278776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d344f01-b5b8-48f2-8221-f3d52a1daa2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.279484 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d344f01-b5b8-48f2-8221-f3d52a1daa2c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.290158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 797/1585] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:44.291027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d344f01-b5b8-48f2-8221-f3d52a1daa2c admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.301207 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d344f01-b5b8-48f2-8221-f3d52a1daa2c admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.305960 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4263530-6364-4733-abd9-8712bbfa4d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.306827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4263530-6364-4733-abd9-8712bbfa4d04 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.306928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4263530-6364-4733-abd9-8712bbfa4d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.307151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4263530-6364-4733-abd9-8712bbfa4d04 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.307839 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4263530-6364-4733-abd9-8712bbfa4d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.309802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4263530-6364-4733-abd9-8712bbfa4d04 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.318486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 789/1586] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:44 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:44.319444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c008fad-8c54-48fb-be8c-a3dbe1b0734f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.329804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c008fad-8c54-48fb-be8c-a3dbe1b0734f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.334883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b62b7c-62b1-4c3f-9b75-465b09c5ed83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.335754 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62b7c-62b1-4c3f-9b75-465b09c5ed83 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.336038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62b7c-62b1-4c3f-9b75-465b09c5ed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.336315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62b7c-62b1-4c3f-9b75-465b09c5ed83 admin admin] PATH_INFO: `/v3/projects/12ace054f8e54ea094ad92c72a996f51/users/f6d3c10d75ff4162b1307b01bf637bc6/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.352050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b62b7c-62b1-4c3f-9b75-465b09c5ed83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ace054f8e54ea094ad92c72a996f51, user_id=f6d3c10d75ff4162b1307b01bf637bc6, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.354780 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b62b7c-62b1-4c3f-9b75-465b09c5ed83 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.472986 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 798/1587] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:44 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:44.474540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4263530-6364-4733-abd9-8712bbfa4d04 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.485006 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4263530-6364-4733-abd9-8712bbfa4d04 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.489723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09653407-61b6-4c7f-bc06-cacbefa3d803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.490527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09653407-61b6-4c7f-bc06-cacbefa3d803 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.490817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09653407-61b6-4c7f-bc06-cacbefa3d803 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.491104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09653407-61b6-4c7f-bc06-cacbefa3d803 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.491834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09653407-61b6-4c7f-bc06-cacbefa3d803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.493470 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09653407-61b6-4c7f-bc06-cacbefa3d803 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.504660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 799/1588] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:44.506178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917c2a-010c-4a82-aa28-a4367cbb996a None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.506469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917c2a-010c-4a82-aa28-a4367cbb996a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.506750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917c2a-010c-4a82-aa28-a4367cbb996a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.523766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 790/1589] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:44 2022] PUT /identity/v3/projects/12ace054f8e54ea094ad92c72a996f51/users/f6d3c10d75ff4162b1307b01bf637bc6/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:44.525020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b62b7c-62b1-4c3f-9b75-465b09c5ed83 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.540018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-94917c2a-010c-4a82-aa28-a4367cbb996a None None] MFA Rules not processed for user `95722c86dd3a4a909a351ad07f8be77d`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:44.541240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-94917c2a-010c-4a82-aa28-a4367cbb996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:44.599604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b62b7c-62b1-4c3f-9b75-465b09c5ed83 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.604108 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034857f-e04f-44e3-9c77-d0c1f46b0199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.604773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034857f-e04f-44e3-9c77-d0c1f46b0199 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.605054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034857f-e04f-44e3-9c77-d0c1f46b0199 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.605337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034857f-e04f-44e3-9c77-d0c1f46b0199 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.606207 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034857f-e04f-44e3-9c77-d0c1f46b0199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.607689 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034857f-e04f-44e3-9c77-d0c1f46b0199 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.611975 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 800/1590] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:44.613354 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94917c2a-010c-4a82-aa28-a4367cbb996a None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.619438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 791/1591] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:44.620511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034857f-e04f-44e3-9c77-d0c1f46b0199 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.626527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94917c2a-010c-4a82-aa28-a4367cbb996a None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.631346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034857f-e04f-44e3-9c77-d0c1f46b0199 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.631945 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d61e9-c534-485d-8c71-edf3eb686d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.632761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d61e9-c534-485d-8c71-edf3eb686d64 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.633039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d61e9-c534-485d-8c71-edf3eb686d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.633339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d61e9-c534-485d-8c71-edf3eb686d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.634148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d61e9-c534-485d-8c71-edf3eb686d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.635790 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d61e9-c534-485d-8c71-edf3eb686d64 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.636073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477d83c-cb07-473d-be63-de26734b656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.636725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d83c-cb07-473d-be63-de26734b656e admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.637015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d83c-cb07-473d-be63-de26734b656e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.637297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d83c-cb07-473d-be63-de26734b656e admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.638087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477d83c-cb07-473d-be63-de26734b656e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.639683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477d83c-cb07-473d-be63-de26734b656e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.648981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 801/1592] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:44.649920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d61e9-c534-485d-8c71-edf3eb686d64 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.650420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 792/1593] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:44.651237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477d83c-cb07-473d-be63-de26734b656e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.662595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477d83c-cb07-473d-be63-de26734b656e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.664888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d61e9-c534-485d-8c71-edf3eb686d64 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.667236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50f0fd-f72b-475b-a4d7-1515da923bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.667897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50f0fd-f72b-475b-a4d7-1515da923bbc admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.668183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50f0fd-f72b-475b-a4d7-1515da923bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.668493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50f0fd-f72b-475b-a4d7-1515da923bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.669218 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50f0fd-f72b-475b-a4d7-1515da923bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.669468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51ba29-23ea-4230-8b12-dec258e7b0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.670121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51ba29-23ea-4230-8b12-dec258e7b0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.670402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51ba29-23ea-4230-8b12-dec258e7b0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.670675 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51ba29-23ea-4230-8b12-dec258e7b0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.670875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50f0fd-f72b-475b-a4d7-1515da923bbc admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.671386 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51ba29-23ea-4230-8b12-dec258e7b0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.672967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51ba29-23ea-4230-8b12-dec258e7b0d5 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.681586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 793/1594] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:44.682462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50f0fd-f72b-475b-a4d7-1515da923bbc admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.683438 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 802/1595] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:44.684716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6575e17-7be7-4db4-be4c-a902d7b0ce7d None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.685004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6575e17-7be7-4db4-be4c-a902d7b0ce7d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.685288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6575e17-7be7-4db4-be4c-a902d7b0ce7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.695733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50f0fd-f72b-475b-a4d7-1515da923bbc admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.700501 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7985f57-1238-44be-a1e3-07759384bffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.701421 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7985f57-1238-44be-a1e3-07759384bffc admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.701714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7985f57-1238-44be-a1e3-07759384bffc admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.701993 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7985f57-1238-44be-a1e3-07759384bffc admin admin] PATH_INFO: `/v3/projects/669c34fed8824e66b193fdc4a4a411fe/users/b12577078ae44225a324bf1b76d5d1d6/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.703468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b6575e17-7be7-4db4-be4c-a902d7b0ce7d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:44.704673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b6575e17-7be7-4db4-be4c-a902d7b0ce7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:44.712800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 803/1596] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:44.713610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6575e17-7be7-4db4-be4c-a902d7b0ce7d None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.719146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7985f57-1238-44be-a1e3-07759384bffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=669c34fed8824e66b193fdc4a4a411fe, user_id=b12577078ae44225a324bf1b76d5d1d6, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.721938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7985f57-1238-44be-a1e3-07759384bffc admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.724097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6575e17-7be7-4db4-be4c-a902d7b0ce7d None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.728783 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e2793-e331-4e6e-9d82-dec096c53ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.729489 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e2793-e331-4e6e-9d82-dec096c53ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.729797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e2793-e331-4e6e-9d82-dec096c53ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.730071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e2793-e331-4e6e-9d82-dec096c53ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.730765 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e2793-e331-4e6e-9d82-dec096c53ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.732698 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e2793-e331-4e6e-9d82-dec096c53ad4 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.747185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:44.849118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 794/1597] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:44 2022] PUT /identity/v3/projects/669c34fed8824e66b193fdc4a4a411fe/users/b12577078ae44225a324bf1b76d5d1d6/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:44.850148 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7985f57-1238-44be-a1e3-07759384bffc admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.903514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 804/1598] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:44 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:44.904661 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e2793-e331-4e6e-9d82-dec096c53ad4 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:44.917716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7985f57-1238-44be-a1e3-07759384bffc admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.943498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:44.971766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e2793-e331-4e6e-9d82-dec096c53ad4 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:44.976923 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742a032-4b23-4a1b-bb2b-d41ed8140a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.977788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742a032-4b23-4a1b-bb2b-d41ed8140a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.978076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742a032-4b23-4a1b-bb2b-d41ed8140a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.978433 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742a032-4b23-4a1b-bb2b-d41ed8140a46 admin admin] PATH_INFO: `/v3/projects/754999c4bc534bba908edc1249b29a73/users/3c5b1c6778f74c0d8db93e3a29935480/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.983809 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb712-1b3f-4e42-8ccd-c78052c91fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:44.984756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb712-1b3f-4e42-8ccd-c78052c91fad admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:44.985488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb712-1b3f-4e42-8ccd-c78052c91fad admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:44.986015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb712-1b3f-4e42-8ccd-c78052c91fad admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:44.987801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb712-1b3f-4e42-8ccd-c78052c91fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:44.989607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb712-1b3f-4e42-8ccd-c78052c91fad admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:44.994930 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742a032-4b23-4a1b-bb2b-d41ed8140a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=754999c4bc534bba908edc1249b29a73, user_id=3c5b1c6778f74c0d8db93e3a29935480, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:45.001411 dv-cinder-839793-16-smb devstack@keystone.service[87215]: WARNING py.warnings [None req-c742a032-4b23-4a1b-bb2b-d41ed8140a46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:59:45.001411 dv-cinder-839793-16-smb devstack@keystone.service[87215]: warnings.warn(msg) May 31 20:59:45.001411 dv-cinder-839793-16-smb devstack@keystone.service[87215]: May 31 20:59:45.001411 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742a032-4b23-4a1b-bb2b-d41ed8140a46 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:45.001817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 795/1599] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:45.001817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb712-1b3f-4e42-8ccd-c78052c91fad admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:45.011743 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb712-1b3f-4e42-8ccd-c78052c91fad admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:45.016586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6a78b-2e30-4b3f-a641-6e29471a707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:45.017600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6a78b-2e30-4b3f-a641-6e29471a707d admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.017885 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6a78b-2e30-4b3f-a641-6e29471a707d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.018163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6a78b-2e30-4b3f-a641-6e29471a707d admin admin] PATH_INFO: `/v3/projects/fab43db62b7b402f8665fd191f3d4f5e/users/c9b5be694ffc4b329af316dc2b23fd18/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.033785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6a78b-2e30-4b3f-a641-6e29471a707d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab43db62b7b402f8665fd191f3d4f5e, user_id=c9b5be694ffc4b329af316dc2b23fd18, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:45.036474 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6a78b-2e30-4b3f-a641-6e29471a707d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:45.118117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 805/1600] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:44 2022] PUT /identity/v3/projects/754999c4bc534bba908edc1249b29a73/users/3c5b1c6778f74c0d8db93e3a29935480/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:45.119128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742a032-4b23-4a1b-bb2b-d41ed8140a46 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:45.131032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 796/1601] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:45 2022] PUT /identity/v3/projects/fab43db62b7b402f8665fd191f3d4f5e/users/c9b5be694ffc4b329af316dc2b23fd18/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:45.135996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6a78b-2e30-4b3f-a641-6e29471a707d admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:45.189099 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742a032-4b23-4a1b-bb2b-d41ed8140a46 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:45.202808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6a78b-2e30-4b3f-a641-6e29471a707d admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:45.208116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c393a-45d2-458a-a048-b9f496b08b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:45.208820 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c393a-45d2-458a-a048-b9f496b08b9b admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.209101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c393a-45d2-458a-a048-b9f496b08b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.209416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c393a-45d2-458a-a048-b9f496b08b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.210138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c393a-45d2-458a-a048-b9f496b08b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:45.211756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c393a-45d2-458a-a048-b9f496b08b9b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:45.226460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 797/1602] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:45.226460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c393a-45d2-458a-a048-b9f496b08b9b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:45.254495 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf0fbb-cc2e-4017-96a8-bbb545738d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:45.255092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf0fbb-cc2e-4017-96a8-bbb545738d30 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.255378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf0fbb-cc2e-4017-96a8-bbb545738d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.255673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf0fbb-cc2e-4017-96a8-bbb545738d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.256402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf0fbb-cc2e-4017-96a8-bbb545738d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:45.258089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf0fbb-cc2e-4017-96a8-bbb545738d30 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:45.268626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 806/1603] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:45.270605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fef94-de9b-4062-a43f-d7b39f0fd5ca None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.270893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fef94-de9b-4062-a43f-d7b39f0fd5ca None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.271172 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fef94-de9b-4062-a43f-d7b39f0fd5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.285577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c393a-45d2-458a-a048-b9f496b08b9b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:45.289578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc6ecf-c498-4b31-b32c-f776183aa23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:45.290226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc6ecf-c498-4b31-b32c-f776183aa23a service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.290508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc6ecf-c498-4b31-b32c-f776183aa23a service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.291398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc6ecf-c498-4b31-b32c-f776183aa23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.298679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-791fef94-de9b-4062-a43f-d7b39f0fd5ca None None] MFA Rules not processed for user `b12577078ae44225a324bf1b76d5d1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:45.299902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-791fef94-de9b-4062-a43f-d7b39f0fd5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:45.303280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc6ecf-c498-4b31-b32c-f776183aa23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:45.304729 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc6ecf-c498-4b31-b32c-f776183aa23a service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:45.314568 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:45.315095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 798/1604] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:45.315909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc6ecf-c498-4b31-b32c-f776183aa23a service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:45.326067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc6ecf-c498-4b31-b32c-f776183aa23a service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:45.332406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f38435-b9e1-4f9e-beb0-192d3aa43290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:45.333281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38435-b9e1-4f9e-beb0-192d3aa43290 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.333664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38435-b9e1-4f9e-beb0-192d3aa43290 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.333955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38435-b9e1-4f9e-beb0-192d3aa43290 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.334835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f38435-b9e1-4f9e-beb0-192d3aa43290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:45.336905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f38435-b9e1-4f9e-beb0-192d3aa43290 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:45.373307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 807/1605] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:45.374546 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fef94-de9b-4062-a43f-d7b39f0fd5ca None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:45.384380 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fef94-de9b-4062-a43f-d7b39f0fd5ca None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:45.388855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6493d-ef92-49e8-866e-5079409fdc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:45.389766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6493d-ef92-49e8-866e-5079409fdc14 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.390047 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6493d-ef92-49e8-866e-5079409fdc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.390313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6493d-ef92-49e8-866e-5079409fdc14 admin admin] PATH_INFO: `/v3/projects/19bf95e9af5a40bbb60619c44250de5b/users/e0d9dcb062ad4376866a98edebede7b1/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.405462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6493d-ef92-49e8-866e-5079409fdc14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bf95e9af5a40bbb60619c44250de5b, user_id=e0d9dcb062ad4376866a98edebede7b1, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:45.408094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6493d-ef92-49e8-866e-5079409fdc14 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:45.449845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 799/1606] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:45 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:45.451154 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c67b0-6bab-4f04-aefa-4b4dcda417d4 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.451446 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c67b0-6bab-4f04-aefa-4b4dcda417d4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.451726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c67b0-6bab-4f04-aefa-4b4dcda417d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.470523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b00c67b0-6bab-4f04-aefa-4b4dcda417d4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:45.471728 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b00c67b0-6bab-4f04-aefa-4b4dcda417d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:45.480143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 800/1607] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:45.481540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e03279-a118-4c9f-847e-856e5d02644c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.481827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e03279-a118-4c9f-847e-856e5d02644c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.482106 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e03279-a118-4c9f-847e-856e5d02644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.500602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-54e03279-a118-4c9f-847e-856e5d02644c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:45.501738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-54e03279-a118-4c9f-847e-856e5d02644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:45.510568 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 801/1608] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:45.511293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e03279-a118-4c9f-847e-856e5d02644c None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:45.517922 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:45.524250 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e03279-a118-4c9f-847e-856e5d02644c None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:45.530151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 808/1609] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:45 2022] PUT /identity/v3/projects/19bf95e9af5a40bbb60619c44250de5b/users/e0d9dcb062ad4376866a98edebede7b1/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:45.531156 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6493d-ef92-49e8-866e-5079409fdc14 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:45.590460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028d00a-5ff3-4a89-afd4-a5cbecdc0b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:45.591342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028d00a-5ff3-4a89-afd4-a5cbecdc0b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.591621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028d00a-5ff3-4a89-afd4-a5cbecdc0b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.591895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028d00a-5ff3-4a89-afd4-a5cbecdc0b7c admin admin] PATH_INFO: `/v3/projects/4a57f1a005cd4e2883e42e1c81cbf5e6/users/0567620b615f4a8ab2bc5c69ba85cc93/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.595829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6493d-ef92-49e8-866e-5079409fdc14 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:45.600665 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6287e-a999-4f75-a1be-a091321608e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:45.601598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6287e-a999-4f75-a1be-a091321608e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.601886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6287e-a999-4f75-a1be-a091321608e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.602166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6287e-a999-4f75-a1be-a091321608e7 admin admin] PATH_INFO: `/v3/projects/551d8b2868394c0ab1ea93b4a8728b70/users/b50590f1e051490cb6927ca0d33567f2/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.607919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028d00a-5ff3-4a89-afd4-a5cbecdc0b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a57f1a005cd4e2883e42e1c81cbf5e6, user_id=0567620b615f4a8ab2bc5c69ba85cc93, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:45.610766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028d00a-5ff3-4a89-afd4-a5cbecdc0b7c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:45.618096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6287e-a999-4f75-a1be-a091321608e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=551d8b2868394c0ab1ea93b4a8728b70, user_id=b50590f1e051490cb6927ca0d33567f2, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:45.620792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6287e-a999-4f75-a1be-a091321608e7 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:45.722056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 802/1610] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:45 2022] PUT /identity/v3/projects/4a57f1a005cd4e2883e42e1c81cbf5e6/users/0567620b615f4a8ab2bc5c69ba85cc93/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:45.722056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028d00a-5ff3-4a89-afd4-a5cbecdc0b7c admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:45.771935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 809/1611] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:45 2022] PUT /identity/v3/projects/551d8b2868394c0ab1ea93b4a8728b70/users/b50590f1e051490cb6927ca0d33567f2/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:45.771935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6287e-a999-4f75-a1be-a091321608e7 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:45.787871 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028d00a-5ff3-4a89-afd4-a5cbecdc0b7c admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:45.843899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6287e-a999-4f75-a1be-a091321608e7 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:45.848509 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab824fa3-dc8c-4e68-af28-c81555d6747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:45.848684 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e41f1-5cbe-4414-a23e-e5f8100c2f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:45.849193 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab824fa3-dc8c-4e68-af28-c81555d6747e admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.849311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e41f1-5cbe-4414-a23e-e5f8100c2f4b admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.849496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab824fa3-dc8c-4e68-af28-c81555d6747e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.849648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e41f1-5cbe-4414-a23e-e5f8100c2f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.849763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e41f1-5cbe-4414-a23e-e5f8100c2f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.849864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab824fa3-dc8c-4e68-af28-c81555d6747e admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.850469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e41f1-5cbe-4414-a23e-e5f8100c2f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:45.850599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab824fa3-dc8c-4e68-af28-c81555d6747e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:45.852076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e41f1-5cbe-4414-a23e-e5f8100c2f4b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:45.852601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab824fa3-dc8c-4e68-af28-c81555d6747e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:45.862159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 810/1612] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:45.863007 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e41f1-5cbe-4414-a23e-e5f8100c2f4b admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:45.874545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:45.923353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e41f1-5cbe-4414-a23e-e5f8100c2f4b admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:45.927698 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54817b8e-7f41-4b3b-bd21-6f4fefa64a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:45.928353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54817b8e-7f41-4b3b-bd21-6f4fefa64a4c service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.928635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54817b8e-7f41-4b3b-bd21-6f4fefa64a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.928915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54817b8e-7f41-4b3b-bd21-6f4fefa64a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.938657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54817b8e-7f41-4b3b-bd21-6f4fefa64a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:45.940114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54817b8e-7f41-4b3b-bd21-6f4fefa64a4c service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:45.958257 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 803/1613] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:45 2022] POST /identity/v3/projects => generated 373 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:45.958499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 811/1614] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:45.962367 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab824fa3-dc8c-4e68-af28-c81555d6747e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:45.963030 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34502687-34bb-441d-8690-6d48f80f1f29 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:45.963431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34502687-34bb-441d-8690-6d48f80f1f29 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:45.963595 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34502687-34bb-441d-8690-6d48f80f1f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:45.982376 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-34502687-34bb-441d-8690-6d48f80f1f29 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:45.983610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-34502687-34bb-441d-8690-6d48f80f1f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:45.991457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:46.052182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab824fa3-dc8c-4e68-af28-c81555d6747e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:46.056732 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98523b-b206-439c-8cdb-ca405661da9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:46.061062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 812/1615] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:46.063389 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98523b-b206-439c-8cdb-ca405661da9c service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.063734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98523b-b206-439c-8cdb-ca405661da9c service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.064023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98523b-b206-439c-8cdb-ca405661da9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.064315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b3575-c98d-459b-94b2-a90f9a0cae46 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.064770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b3575-c98d-459b-94b2-a90f9a0cae46 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.065053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b3575-c98d-459b-94b2-a90f9a0cae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.079683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98523b-b206-439c-8cdb-ca405661da9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:46.086928 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98523b-b206-439c-8cdb-ca405661da9c service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:46.088248 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-cb1b3575-c98d-459b-94b2-a90f9a0cae46 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:46.089488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-cb1b3575-c98d-459b-94b2-a90f9a0cae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:46.091208 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 804/1616] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:46.094892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa4da4-3c81-4a8b-9fd9-878fe614e01a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.095187 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa4da4-3c81-4a8b-9fd9-878fe614e01a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.095469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa4da4-3c81-4a8b-9fd9-878fe614e01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.098586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 813/1617] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:46.099601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b3575-c98d-459b-94b2-a90f9a0cae46 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:46.124400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-9baa4da4-3c81-4a8b-9fd9-878fe614e01a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:46.126345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-9baa4da4-3c81-4a8b-9fd9-878fe614e01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:46.129203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b3575-c98d-459b-94b2-a90f9a0cae46 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:46.135767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358371e9-88e6-498f-b991-e1ea9b7df76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:46.139428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 805/1618] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:46.150642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358371e9-88e6-498f-b991-e1ea9b7df76b admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.150642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358371e9-88e6-498f-b991-e1ea9b7df76b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.150642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358371e9-88e6-498f-b991-e1ea9b7df76b admin admin] PATH_INFO: `/v3/projects/1774c0b6ac1940609fd7dbd88de06cac/users/d62c18ed5a9c429793c28360a7ec3b20/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.151178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa4da4-3c81-4a8b-9fd9-878fe614e01a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:46.151178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa4da4-3c81-4a8b-9fd9-878fe614e01a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:46.155836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac10a4-d904-4c1b-9fc3-c92bf0415bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:46.156768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358371e9-88e6-498f-b991-e1ea9b7df76b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1774c0b6ac1940609fd7dbd88de06cac, user_id=d62c18ed5a9c429793c28360a7ec3b20, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:46.156893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac10a4-d904-4c1b-9fc3-c92bf0415bfe admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.157499 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac10a4-d904-4c1b-9fc3-c92bf0415bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.157973 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac10a4-d904-4c1b-9fc3-c92bf0415bfe admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.158953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac10a4-d904-4c1b-9fc3-c92bf0415bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:46.160050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358371e9-88e6-498f-b991-e1ea9b7df76b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:46.160838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac10a4-d904-4c1b-9fc3-c92bf0415bfe admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:46.258728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 814/1619] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:46 2022] PUT /identity/v3/projects/1774c0b6ac1940609fd7dbd88de06cac/users/d62c18ed5a9c429793c28360a7ec3b20/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:46.260074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358371e9-88e6-498f-b991-e1ea9b7df76b admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:46.268402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 806/1620] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:46 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:46.270588 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac10a4-d904-4c1b-9fc3-c92bf0415bfe admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:46.290890 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac10a4-d904-4c1b-9fc3-c92bf0415bfe admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:46.356053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358371e9-88e6-498f-b991-e1ea9b7df76b admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:46.365462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546ff91-d472-477c-96d2-f7cc2bd255ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:46.366858 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546ff91-d472-477c-96d2-f7cc2bd255ff service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.367432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546ff91-d472-477c-96d2-f7cc2bd255ff service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.369279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546ff91-d472-477c-96d2-f7cc2bd255ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.387865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdda85b-d751-49df-afb8-28c70d5cfd24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:46.388893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdda85b-d751-49df-afb8-28c70d5cfd24 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.389407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdda85b-d751-49df-afb8-28c70d5cfd24 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.389887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdda85b-d751-49df-afb8-28c70d5cfd24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.454833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:46.499041 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdda85b-d751-49df-afb8-28c70d5cfd24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:46.501498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdda85b-d751-49df-afb8-28c70d5cfd24 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:46.515073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 807/1621] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:46.518021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdda85b-d751-49df-afb8-28c70d5cfd24 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:46.523775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546ff91-d472-477c-96d2-f7cc2bd255ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:46.527090 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546ff91-d472-477c-96d2-f7cc2bd255ff service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:46.528958 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdda85b-d751-49df-afb8-28c70d5cfd24 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:46.534306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab42ac2-4680-48a6-a142-c449aa8b68b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:46.535569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab42ac2-4680-48a6-a142-c449aa8b68b3 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.536270 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab42ac2-4680-48a6-a142-c449aa8b68b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.536413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab42ac2-4680-48a6-a142-c449aa8b68b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.547863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab42ac2-4680-48a6-a142-c449aa8b68b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:46.548952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 815/1622] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:46.549534 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab42ac2-4680-48a6-a142-c449aa8b68b3 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:46.552088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546ff91-d472-477c-96d2-f7cc2bd255ff service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:46.562407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 808/1623] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:46.563279 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab42ac2-4680-48a6-a142-c449aa8b68b3 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:46.571198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546ff91-d472-477c-96d2-f7cc2bd255ff service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:46.575454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab42ac2-4680-48a6-a142-c449aa8b68b3 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:46.581081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3de279-3e0f-4b59-a686-87edd44e4c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:46.585363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3de279-3e0f-4b59-a686-87edd44e4c2f admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.585363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3de279-3e0f-4b59-a686-87edd44e4c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.585809 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b2bdc-ecdb-4932-8571-0a330a20501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:46.585948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3de279-3e0f-4b59-a686-87edd44e4c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.585948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3de279-3e0f-4b59-a686-87edd44e4c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:46.586222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b2bdc-ecdb-4932-8571-0a330a20501e admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.586222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b2bdc-ecdb-4932-8571-0a330a20501e admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.586222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b2bdc-ecdb-4932-8571-0a330a20501e admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.586466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3de279-3e0f-4b59-a686-87edd44e4c2f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:46.587450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b2bdc-ecdb-4932-8571-0a330a20501e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:46.591483 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b2bdc-ecdb-4932-8571-0a330a20501e admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:46.600832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 809/1624] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:46.602556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3de279-3e0f-4b59-a686-87edd44e4c2f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:46.614121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 816/1625] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:46.614882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3de279-3e0f-4b59-a686-87edd44e4c2f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:46.619353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b2bdc-ecdb-4932-8571-0a330a20501e admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:46.621163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429f69e-b83d-4d3d-b81e-a209d545b64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:46.622574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429f69e-b83d-4d3d-b81e-a209d545b64a admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.623096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429f69e-b83d-4d3d-b81e-a209d545b64a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.623888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429f69e-b83d-4d3d-b81e-a209d545b64a admin admin] PATH_INFO: `/v3/projects/b42fd70b20ed4a6097ecbdc25ec512bf/users/bcfa854dfff0432fad786f544b7a8923/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.639736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b2bdc-ecdb-4932-8571-0a330a20501e admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:46.643136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429f69e-b83d-4d3d-b81e-a209d545b64a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42fd70b20ed4a6097ecbdc25ec512bf, user_id=bcfa854dfff0432fad786f544b7a8923, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:46.646698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429f69e-b83d-4d3d-b81e-a209d545b64a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:46.650083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38671221-7119-40a1-b05e-c493c4c73ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:46.651969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38671221-7119-40a1-b05e-c493c4c73ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.653239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38671221-7119-40a1-b05e-c493c4c73ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.654039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38671221-7119-40a1-b05e-c493c4c73ad6 admin admin] PATH_INFO: `/v3/projects/1774c0b6ac1940609fd7dbd88de06cac/users/d62c18ed5a9c429793c28360a7ec3b20/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.658608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38671221-7119-40a1-b05e-c493c4c73ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1774c0b6ac1940609fd7dbd88de06cac, user_id=d62c18ed5a9c429793c28360a7ec3b20, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:46.665140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38671221-7119-40a1-b05e-c493c4c73ad6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:46.688540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 817/1626] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:46 2022] PUT /identity/v3/projects/1774c0b6ac1940609fd7dbd88de06cac/users/d62c18ed5a9c429793c28360a7ec3b20/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:46.700535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78672ee-d6c7-4f33-81f1-58c463c29afe None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.701073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78672ee-d6c7-4f33-81f1-58c463c29afe None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.701683 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78672ee-d6c7-4f33-81f1-58c463c29afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.728140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:46.737186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 810/1627] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:46 2022] PUT /identity/v3/projects/b42fd70b20ed4a6097ecbdc25ec512bf/users/bcfa854dfff0432fad786f544b7a8923/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:46.741539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429f69e-b83d-4d3d-b81e-a209d545b64a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:46.764978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a78672ee-d6c7-4f33-81f1-58c463c29afe None None] MFA Rules not processed for user `d62c18ed5a9c429793c28360a7ec3b20`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:46.766244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a78672ee-d6c7-4f33-81f1-58c463c29afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:46.860915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 818/1628] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:46.878161 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78672ee-d6c7-4f33-81f1-58c463c29afe None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:46.884210 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429f69e-b83d-4d3d-b81e-a209d545b64a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:46.889776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec150fa2-4e1f-4345-8053-f5027391ad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:46.890476 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec150fa2-4e1f-4345-8053-f5027391ad01 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.890771 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec150fa2-4e1f-4345-8053-f5027391ad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.891044 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec150fa2-4e1f-4345-8053-f5027391ad01 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.891788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec150fa2-4e1f-4345-8053-f5027391ad01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:46.893448 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec150fa2-4e1f-4345-8053-f5027391ad01 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:46.907992 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 811/1629] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:46.909027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec150fa2-4e1f-4345-8053-f5027391ad01 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:46.920437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec150fa2-4e1f-4345-8053-f5027391ad01 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:46.925869 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e63dd-f78c-4066-a687-eda766873266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:46.926764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e63dd-f78c-4066-a687-eda766873266 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.927097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e63dd-f78c-4066-a687-eda766873266 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.927386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e63dd-f78c-4066-a687-eda766873266 admin admin] PATH_INFO: `/v3/projects/b42fd70b20ed4a6097ecbdc25ec512bf/users/bcfa854dfff0432fad786f544b7a8923/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.929897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e63dd-f78c-4066-a687-eda766873266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42fd70b20ed4a6097ecbdc25ec512bf, user_id=bcfa854dfff0432fad786f544b7a8923, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:46.932786 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e63dd-f78c-4066-a687-eda766873266 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:46.954395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 812/1630] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:46 2022] PUT /identity/v3/projects/b42fd70b20ed4a6097ecbdc25ec512bf/users/bcfa854dfff0432fad786f544b7a8923/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:46.956036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509b95a-4f7f-4e7d-9695-7088813ab965 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:46.956286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509b95a-4f7f-4e7d-9695-7088813ab965 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:46.957114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509b95a-4f7f-4e7d-9695-7088813ab965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:46.961265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78672ee-d6c7-4f33-81f1-58c463c29afe None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:46.989110 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a509b95a-4f7f-4e7d-9695-7088813ab965 None None] MFA Rules not processed for user `bcfa854dfff0432fad786f544b7a8923`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:46.991273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a509b95a-4f7f-4e7d-9695-7088813ab965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:47.023506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:47.033417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf85f86-a640-468b-91da-a9adfcb47338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:47.034116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85f86-a640-468b-91da-a9adfcb47338 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:47.034402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85f86-a640-468b-91da-a9adfcb47338 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:47.034708 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf85f86-a640-468b-91da-a9adfcb47338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:47.107158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 813/1631] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:47.135073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf85f86-a640-468b-91da-a9adfcb47338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:47.136117 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509b95a-4f7f-4e7d-9695-7088813ab965 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:47.137000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf85f86-a640-468b-91da-a9adfcb47338 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:47.152366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 819/1632] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 20:59:47.159014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509b95a-4f7f-4e7d-9695-7088813ab965 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:47.166957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6650d-6ce9-4c5a-ad8b-02317868d918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:47.168201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6650d-6ce9-4c5a-ad8b-02317868d918 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:47.169682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6650d-6ce9-4c5a-ad8b-02317868d918 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:47.171074 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6650d-6ce9-4c5a-ad8b-02317868d918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:47.192178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6650d-6ce9-4c5a-ad8b-02317868d918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:47.192687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6650d-6ce9-4c5a-ad8b-02317868d918 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:47.205610 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 814/1633] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:47.482680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf85f86-a640-468b-91da-a9adfcb47338 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:47.500795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf85f86-a640-468b-91da-a9adfcb47338 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:47.507647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e79cf-b774-4e8d-92f7-c3b213b50e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:47.508941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e79cf-b774-4e8d-92f7-c3b213b50e9d service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:47.510109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e79cf-b774-4e8d-92f7-c3b213b50e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:47.510799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e79cf-b774-4e8d-92f7-c3b213b50e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:47.634670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e79cf-b774-4e8d-92f7-c3b213b50e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:47.636241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e79cf-b774-4e8d-92f7-c3b213b50e9d service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:47.661484 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63275e-486e-410d-bc44-ff86e4ad578a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:47.662438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63275e-486e-410d-bc44-ff86e4ad578a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:47.662899 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63275e-486e-410d-bc44-ff86e4ad578a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:47.663242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 820/1634] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:47.718357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-0a63275e-486e-410d-bc44-ff86e4ad578a None None] MFA Rules not processed for user `f6d3c10d75ff4162b1307b01bf637bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:47.722661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0a63275e-486e-410d-bc44-ff86e4ad578a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:47.795115 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:47.851506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 815/1635] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:47.852712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e79cf-b774-4e8d-92f7-c3b213b50e9d service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:47.969264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e79cf-b774-4e8d-92f7-c3b213b50e9d service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:47.979234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4cdbd-27a4-4894-aef8-ebef83182cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:47.979234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4cdbd-27a4-4894-aef8-ebef83182cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:47.979234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4cdbd-27a4-4894-aef8-ebef83182cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:47.979234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4cdbd-27a4-4894-aef8-ebef83182cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:47.979671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4cdbd-27a4-4894-aef8-ebef83182cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:47.979671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4cdbd-27a4-4894-aef8-ebef83182cf7 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:48.101066 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 821/1636] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:47 2022] POST /identity/v3/projects => generated 405 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:48.101280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63275e-486e-410d-bc44-ff86e4ad578a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:48.118188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63275e-486e-410d-bc44-ff86e4ad578a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:48.206152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e75cf7-c894-4029-9ae4-e3e900fc2851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:48.207426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e75cf7-c894-4029-9ae4-e3e900fc2851 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:48.207717 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e75cf7-c894-4029-9ae4-e3e900fc2851 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:48.208035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e75cf7-c894-4029-9ae4-e3e900fc2851 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:48.208759 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e75cf7-c894-4029-9ae4-e3e900fc2851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:48.223070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e75cf7-c894-4029-9ae4-e3e900fc2851 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:48.584352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 816/1637] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:48 2022] POST /identity/v3/users => generated 309 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:59:48.616712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4cdbd-27a4-4894-aef8-ebef83182cf7 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:48.616712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4cdbd-27a4-4894-aef8-ebef83182cf7 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:48.616712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847c2f-ac82-450c-a2c2-8be2afaad642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:48.616712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847c2f-ac82-450c-a2c2-8be2afaad642 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:48.618757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847c2f-ac82-450c-a2c2-8be2afaad642 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:48.618757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847c2f-ac82-450c-a2c2-8be2afaad642 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:48.618757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2847c2f-ac82-450c-a2c2-8be2afaad642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:48.618757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2847c2f-ac82-450c-a2c2-8be2afaad642 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:48.618757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 822/1638] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:48.620361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e75cf7-c894-4029-9ae4-e3e900fc2851 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:48.620361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e75cf7-c894-4029-9ae4-e3e900fc2851 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:48.620361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bf72f-228c-4b48-ae3a-9a14ffffabf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:48.620361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bf72f-228c-4b48-ae3a-9a14ffffabf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:48.621814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bf72f-228c-4b48-ae3a-9a14ffffabf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:48.621814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bf72f-228c-4b48-ae3a-9a14ffffabf7 admin admin] PATH_INFO: `/v3/projects/23f3ae9b0b03494f9ea76a206ef461e1/users/c909444bdc8e448db0606eeb64e9c859/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:48.621814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bf72f-228c-4b48-ae3a-9a14ffffabf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f3ae9b0b03494f9ea76a206ef461e1, user_id=c909444bdc8e448db0606eeb64e9c859, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:48.621814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bf72f-228c-4b48-ae3a-9a14ffffabf7 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:48.707538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 817/1639] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:48 2022] PUT /identity/v3/projects/23f3ae9b0b03494f9ea76a206ef461e1/users/c909444bdc8e448db0606eeb64e9c859/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:48.712615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847c2f-ac82-450c-a2c2-8be2afaad642 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:48.724569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847c2f-ac82-450c-a2c2-8be2afaad642 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:48.728509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:48.778021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bf72f-228c-4b48-ae3a-9a14ffffabf7 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:48.837831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f99e40-14ca-4c4b-b4ca-dd12b9164090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:48.838950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99e40-14ca-4c4b-b4ca-dd12b9164090 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:48.839372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99e40-14ca-4c4b-b4ca-dd12b9164090 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:48.839789 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99e40-14ca-4c4b-b4ca-dd12b9164090 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:48.840747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f99e40-14ca-4c4b-b4ca-dd12b9164090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:48.844721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f99e40-14ca-4c4b-b4ca-dd12b9164090 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:48.882083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 823/1640] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:48.887084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f99e40-14ca-4c4b-b4ca-dd12b9164090 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:48.916127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f99e40-14ca-4c4b-b4ca-dd12b9164090 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:48.930748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df66b03-892d-414c-96dd-c054f408c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:48.933171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df66b03-892d-414c-96dd-c054f408c0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:48.934206 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df66b03-892d-414c-96dd-c054f408c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:48.937590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df66b03-892d-414c-96dd-c054f408c0e4 admin admin] PATH_INFO: `/v3/projects/23f3ae9b0b03494f9ea76a206ef461e1/users/c909444bdc8e448db0606eeb64e9c859/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:48.942351 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bf72f-228c-4b48-ae3a-9a14ffffabf7 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:48.943839 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df66b03-892d-414c-96dd-c054f408c0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f3ae9b0b03494f9ea76a206ef461e1, user_id=c909444bdc8e448db0606eeb64e9c859, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:48.951393 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df66b03-892d-414c-96dd-c054f408c0e4 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:48.956629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098b050-2db4-4482-855a-32a0d56b985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:48.960531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098b050-2db4-4482-855a-32a0d56b985e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:48.960531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098b050-2db4-4482-855a-32a0d56b985e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:48.960531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098b050-2db4-4482-855a-32a0d56b985e admin admin] PATH_INFO: `/v3/users/b12577078ae44225a324bf1b76d5d1d6` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:48.964248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098b050-2db4-4482-855a-32a0d56b985e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12577078ae44225a324bf1b76d5d1d6)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:48.967216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098b050-2db4-4482-855a-32a0d56b985e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:48.989309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 824/1641] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:48 2022] PUT /identity/v3/projects/23f3ae9b0b03494f9ea76a206ef461e1/users/c909444bdc8e448db0606eeb64e9c859/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:59:49.294696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa909b3-6f25-4378-ac0a-773217d31b75 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:49.295198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa909b3-6f25-4378-ac0a-773217d31b75 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:49.295589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa909b3-6f25-4378-ac0a-773217d31b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:49.303120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a098b050-2db4-4482-855a-32a0d56b985e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12577078ae44225a324bf1b76d5d1d6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:49.311223 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:49.345755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-5fa909b3-6f25-4378-ac0a-773217d31b75 None None] MFA Rules not processed for user `b50590f1e051490cb6927ca0d33567f2`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:49.350446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5fa909b3-6f25-4378-ac0a-773217d31b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:49.377539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a098b050-2db4-4482-855a-32a0d56b985e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12577078ae44225a324bf1b76d5d1d6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:49.378597 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a098b050-2db4-4482-855a-32a0d56b985e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12577078ae44225a324bf1b76d5d1d6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:49.387870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a098b050-2db4-4482-855a-32a0d56b985e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12577078ae44225a324bf1b76d5d1d6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:49.388872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a098b050-2db4-4482-855a-32a0d56b985e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12577078ae44225a324bf1b76d5d1d6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:49.413844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 818/1642] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 20:59:48 2022] DELETE /identity/v3/users/b12577078ae44225a324bf1b76d5d1d6 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:49.419719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b6d5a-0204-4dbc-aa7a-82bda6efc9ec None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:49.420017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b6d5a-0204-4dbc-aa7a-82bda6efc9ec None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:49.420300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b6d5a-0204-4dbc-aa7a-82bda6efc9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:49.439129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e19b6d5a-0204-4dbc-aa7a-82bda6efc9ec None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:49.440470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e19b6d5a-0204-4dbc-aa7a-82bda6efc9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:49.495262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 825/1643] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:49.496783 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce763c26-c92d-47ba-bd6b-18f69eca3921 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:49.497079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce763c26-c92d-47ba-bd6b-18f69eca3921 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:49.497363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce763c26-c92d-47ba-bd6b-18f69eca3921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:49.540871 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-ce763c26-c92d-47ba-bd6b-18f69eca3921 None None] MFA Rules not processed for user `b50590f1e051490cb6927ca0d33567f2`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:49.543184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ce763c26-c92d-47ba-bd6b-18f69eca3921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:49.573441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 819/1644] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:49.614508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b6d5a-0204-4dbc-aa7a-82bda6efc9ec None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:49.621477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e19b6d5a-0204-4dbc-aa7a-82bda6efc9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:49.635599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 826/1645] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:49.672750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd4a9-d908-4cc3-bd0e-26260d07066b None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:49.673044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd4a9-d908-4cc3-bd0e-26260d07066b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:49.673323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd4a9-d908-4cc3-bd0e-26260d07066b None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:49.674879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 827/1646] 10.222.0.39 () {54 vars in 961 bytes} [Tue May 31 20:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:59:49.690787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778985f9-80a6-47b5-96f8-784adf8a134a None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:49.691293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778985f9-80a6-47b5-96f8-784adf8a134a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:49.691392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778985f9-80a6-47b5-96f8-784adf8a134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:49.729232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-778985f9-80a6-47b5-96f8-784adf8a134a None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:49.731107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-778985f9-80a6-47b5-96f8-784adf8a134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:49.753586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b6d5a-0204-4dbc-aa7a-82bda6efc9ec None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:49.765017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da11e7e-555a-49ae-b6a4-38ecfdaeaeda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:49.768050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da11e7e-555a-49ae-b6a4-38ecfdaeaeda service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:49.770765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da11e7e-555a-49ae-b6a4-38ecfdaeaeda service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:49.771246 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da11e7e-555a-49ae-b6a4-38ecfdaeaeda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:49.814268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da11e7e-555a-49ae-b6a4-38ecfdaeaeda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:49.820307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da11e7e-555a-49ae-b6a4-38ecfdaeaeda service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:49.843659 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 820/1647] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:49.886519 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 828/1648] 10.222.0.39 () {58 vars in 1058 bytes} [Tue May 31 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:59:49.895568 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da11e7e-555a-49ae-b6a4-38ecfdaeaeda service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:49.938244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da11e7e-555a-49ae-b6a4-38ecfdaeaeda service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:49.959211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b52cb-95d7-46e9-8792-c3fc2c27d44a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:49.962926 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b52cb-95d7-46e9-8792-c3fc2c27d44a service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:49.964282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b52cb-95d7-46e9-8792-c3fc2c27d44a service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:49.964736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b52cb-95d7-46e9-8792-c3fc2c27d44a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:49.987642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b52cb-95d7-46e9-8792-c3fc2c27d44a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:49.991019 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b52cb-95d7-46e9-8792-c3fc2c27d44a service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:50.009031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:50.037267 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 821/1649] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:50.448768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e344f9-bc55-492f-9d39-851487a108c0 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:50.449044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e344f9-bc55-492f-9d39-851487a108c0 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:50.449327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e344f9-bc55-492f-9d39-851487a108c0 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:50.451017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 829/1650] 10.222.0.39 () {54 vars in 912 bytes} [Tue May 31 20:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:59:50.460005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fd94-53ad-4500-b067-0c86d53bbac3 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:50.460321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fd94-53ad-4500-b067-0c86d53bbac3 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:50.460600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fd94-53ad-4500-b067-0c86d53bbac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:50.486096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d6e1fd94-53ad-4500-b067-0c86d53bbac3 None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:50.487485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d6e1fd94-53ad-4500-b067-0c86d53bbac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:50.508651 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 822/1651] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:50.524672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e344f9-bc55-492f-9d39-851487a108c0 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:50.527376 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-80e344f9-bc55-492f-9d39-851487a108c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:50.611516 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e344f9-bc55-492f-9d39-851487a108c0 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:50.618307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f3ab7-0f10-4e74-bcdc-2fc4b02ef857 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a22cd803304a19a58bfbe17addb11f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:50.619249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3ab7-0f10-4e74-bcdc-2fc4b02ef857 service glance] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:50.619635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3ab7-0f10-4e74-bcdc-2fc4b02ef857 service glance] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:50.620011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3ab7-0f10-4e74-bcdc-2fc4b02ef857 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:50.635954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f3ab7-0f10-4e74-bcdc-2fc4b02ef857 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:50.640223 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f3ab7-0f10-4e74-bcdc-2fc4b02ef857 service glance] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:50.656426 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 830/1652] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:51.573830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb3740-4c7b-4fbe-8146-15bc86d76852 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:51.574736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb3740-4c7b-4fbe-8146-15bc86d76852 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:51.575045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb3740-4c7b-4fbe-8146-15bc86d76852 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:51.577795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 823/1653] 10.222.0.39 () {54 vars in 912 bytes} [Tue May 31 20:59:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:59:51.588823 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6efc2-90c4-4415-adb7-2c0ff82cdd8e None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:51.589431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6efc2-90c4-4415-adb7-2c0ff82cdd8e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:51.589431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6efc2-90c4-4415-adb7-2c0ff82cdd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:51.611918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-10b6efc2-90c4-4415-adb7-2c0ff82cdd8e None None] MFA Rules not processed for user `16a77c08d2844e7cb81ac1370c527cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:51.613590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-10b6efc2-90c4-4415-adb7-2c0ff82cdd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:51.623532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 831/1654] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 20:59:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:59:51.646159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb3740-4c7b-4fbe-8146-15bc86d76852 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:51.662942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb3740-4c7b-4fbe-8146-15bc86d76852 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:51.667080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430e75c-5259-431b-a5fb-65972fe02cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:51.667835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430e75c-5259-431b-a5fb-65972fe02cfa service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:51.668200 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430e75c-5259-431b-a5fb-65972fe02cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:51.668556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430e75c-5259-431b-a5fb-65972fe02cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:51.695199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430e75c-5259-431b-a5fb-65972fe02cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:51.702784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6efc2-90c4-4415-adb7-2c0ff82cdd8e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:51.702784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-10b6efc2-90c4-4415-adb7-2c0ff82cdd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:51.709762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430e75c-5259-431b-a5fb-65972fe02cfa service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:51.728114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 824/1655] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:51.729434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6efc2-90c4-4415-adb7-2c0ff82cdd8e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:51.741989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:51.743079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:51.743382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:51.743663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a admin admin] PATH_INFO: `/v3/projects/669c34fed8824e66b193fdc4a4a411fe` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:51.745031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=669c34fed8824e66b193fdc4a4a411fe)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:51.748773 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:51.957015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669c34fed8824e66b193fdc4a4a411fe', 'request_id': 'req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:52.060745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669c34fed8824e66b193fdc4a4a411fe', 'request_id': 'req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:52.093689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669c34fed8824e66b193fdc4a4a411fe', 'request_id': 'req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:52.118865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a admin admin] The token cache is being invalidate because project 669c34fed8824e66b193fdc4a4a411fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 20:59:52.119167 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:52.123239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-21a2b65f-d1ac-48f5-b9e4-c1937c8ffe8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:52.124635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 832/1656] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 20:59:51 2022] DELETE /identity/v3/projects/669c34fed8824e66b193fdc4a4a411fe => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:59:52.129409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430e75c-5259-431b-a5fb-65972fe02cfa service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:52.160462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430e75c-5259-431b-a5fb-65972fe02cfa service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:52.227979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:52.293001 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da6c22-bd07-4b73-bcd1-b0df824febd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:52.294405 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da6c22-bd07-4b73-bcd1-b0df824febd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:52.294890 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da6c22-bd07-4b73-bcd1-b0df824febd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:52.295481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da6c22-bd07-4b73-bcd1-b0df824febd5 admin admin] PATH_INFO: `/v3/users/bcfa854dfff0432fad786f544b7a8923` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:52.297205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da6c22-bd07-4b73-bcd1-b0df824febd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcfa854dfff0432fad786f544b7a8923)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:52.299969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da6c22-bd07-4b73-bcd1-b0df824febd5 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:52.606439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-59da6c22-bd07-4b73-bcd1-b0df824febd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcfa854dfff0432fad786f544b7a8923'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:52.691749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-59da6c22-bd07-4b73-bcd1-b0df824febd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcfa854dfff0432fad786f544b7a8923'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:52.693480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-59da6c22-bd07-4b73-bcd1-b0df824febd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcfa854dfff0432fad786f544b7a8923'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:52.714496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-59da6c22-bd07-4b73-bcd1-b0df824febd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcfa854dfff0432fad786f544b7a8923'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:52.722453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-59da6c22-bd07-4b73-bcd1-b0df824febd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcfa854dfff0432fad786f544b7a8923'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:52.795176 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 825/1657] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 20:59:52 2022] DELETE /identity/v3/users/bcfa854dfff0432fad786f544b7a8923 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:53.020086 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc230d8-c528-4769-98e1-5e6c385e92f6 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:53.020927 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc230d8-c528-4769-98e1-5e6c385e92f6 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:53.021346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc230d8-c528-4769-98e1-5e6c385e92f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:53.096875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-8dc230d8-c528-4769-98e1-5e6c385e92f6 None None] MFA Rules not processed for user `c909444bdc8e448db0606eeb64e9c859`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:53.098695 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8dc230d8-c528-4769-98e1-5e6c385e92f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:53.167361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:53.283145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 833/1658] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:53 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:53.751086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a5203-f67e-4ce6-87d6-3862be1de99a None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:53.751575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a5203-f67e-4ce6-87d6-3862be1de99a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:53.751685 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a5203-f67e-4ce6-87d6-3862be1de99a None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:53.753029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 826/1659] 10.222.0.39 () {54 vars in 960 bytes} [Tue May 31 20:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:59:53.771974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c0fc5-61ac-46aa-b621-bcaa8f5264b1 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:53.772288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c0fc5-61ac-46aa-b621-bcaa8f5264b1 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:53.772572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c0fc5-61ac-46aa-b621-bcaa8f5264b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:53.805680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-415c0fc5-61ac-46aa-b621-bcaa8f5264b1 None None] MFA Rules not processed for user `619d0b5afa094289808516486a5e3c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:53.806825 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-415c0fc5-61ac-46aa-b621-bcaa8f5264b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:54.031992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 834/1660] 10.222.0.39 () {58 vars in 1057 bytes} [Tue May 31 20:59:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:54.032914 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a5203-f67e-4ce6-87d6-3862be1de99a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:54.062363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a5203-f67e-4ce6-87d6-3862be1de99a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:54.075477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb33243-980f-464b-b0df-4507906a229d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619d0b5afa094289808516486a5e3c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:54.076336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33243-980f-464b-b0df-4507906a229d service placement] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:54.076765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33243-980f-464b-b0df-4507906a229d service placement] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:54.077213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33243-980f-464b-b0df-4507906a229d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:54.085597 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0bb33243-980f-464b-b0df-4507906a229d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:54.124343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb33243-980f-464b-b0df-4507906a229d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:54.129101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb33243-980f-464b-b0df-4507906a229d service placement] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:54.162307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 827/1661] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:54.201761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858c14d-36de-4b29-af61-3272ef86689e None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:54.202057 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858c14d-36de-4b29-af61-3272ef86689e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:54.202340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858c14d-36de-4b29-af61-3272ef86689e None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:54.204066 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 835/1662] 10.222.0.39 () {54 vars in 961 bytes} [Tue May 31 20:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:59:54.210134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6679f-4f03-4786-b2ac-6424d5868656 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:54.210429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6679f-4f03-4786-b2ac-6424d5868656 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:54.210714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6679f-4f03-4786-b2ac-6424d5868656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:54.251538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-fac6679f-4f03-4786-b2ac-6424d5868656 None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:54.252698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fac6679f-4f03-4786-b2ac-6424d5868656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:54.447523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 828/1663] 10.222.0.39 () {58 vars in 1058 bytes} [Tue May 31 20:59:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:54.452912 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538c9bf-9e93-4a9c-aac4-85f03e9b57c8 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:54.453206 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538c9bf-9e93-4a9c-aac4-85f03e9b57c8 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:54.453518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538c9bf-9e93-4a9c-aac4-85f03e9b57c8 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:54.454904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 836/1664] 10.222.0.39 () {54 vars in 912 bytes} [Tue May 31 20:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:59:54.461666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dca31-d01d-4aed-b84a-6e27aafde537 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:54.462811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dca31-d01d-4aed-b84a-6e27aafde537 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:54.463717 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dca31-d01d-4aed-b84a-6e27aafde537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:54.537748 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-850dca31-d01d-4aed-b84a-6e27aafde537 None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:54.539864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-850dca31-d01d-4aed-b84a-6e27aafde537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:54.570548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 829/1665] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 20:59:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:54.703526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538c9bf-9e93-4a9c-aac4-85f03e9b57c8 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:54.706614 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0538c9bf-9e93-4a9c-aac4-85f03e9b57c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:54.899010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538c9bf-9e93-4a9c-aac4-85f03e9b57c8 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:54.918934 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1203558-4eea-4bab-9b58-14064ae5b6d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:54.935930 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203558-4eea-4bab-9b58-14064ae5b6d1 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:54.936297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203558-4eea-4bab-9b58-14064ae5b6d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:54.941335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1203558-4eea-4bab-9b58-14064ae5b6d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:54.990846 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1203558-4eea-4bab-9b58-14064ae5b6d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:54.999792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1203558-4eea-4bab-9b58-14064ae5b6d1 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:55.035017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 837/1666] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:55.626538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dca31-d01d-4aed-b84a-6e27aafde537 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:55.628071 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-850dca31-d01d-4aed-b84a-6e27aafde537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:55.740762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:55.787885 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dca31-d01d-4aed-b84a-6e27aafde537 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:55.800776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:55.802125 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:55.802552 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:55.803299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb admin admin] PATH_INFO: `/v3/projects/b42fd70b20ed4a6097ecbdc25ec512bf` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:55.806056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b42fd70b20ed4a6097ecbdc25ec512bf)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:55.808867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: WARNING py.warnings [None req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:59:55.808867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: warnings.warn(msg) May 31 20:59:55.808867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: May 31 20:59:55.818580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:56.003097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42fd70b20ed4a6097ecbdc25ec512bf', 'request_id': 'req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:56.114911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42fd70b20ed4a6097ecbdc25ec512bf', 'request_id': 'req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:56.133521 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42fd70b20ed4a6097ecbdc25ec512bf', 'request_id': 'req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:56.212008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb admin admin] The token cache is being invalidate because project b42fd70b20ed4a6097ecbdc25ec512bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 20:59:56.212008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:56.212608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-12eb9db4-fa6c-4145-a36d-83404e8ac5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:56.219573 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 830/1667] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 20:59:55 2022] DELETE /identity/v3/projects/b42fd70b20ed4a6097ecbdc25ec512bf => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:56.221176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0215755-2f8b-4d5d-b552-e8f29869bb8c None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:56.221669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0215755-2f8b-4d5d-b552-e8f29869bb8c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:56.223953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0215755-2f8b-4d5d-b552-e8f29869bb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:56.261238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-c0215755-2f8b-4d5d-b552-e8f29869bb8c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:56.262520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c0215755-2f8b-4d5d-b552-e8f29869bb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:56.413635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 838/1668] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:56.419023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8442c-574b-4331-930c-8644b076b90b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:56.419324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8442c-574b-4331-930c-8644b076b90b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:56.419612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8442c-574b-4331-930c-8644b076b90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:56.455990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-23b8442c-574b-4331-930c-8644b076b90b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:56.459595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-23b8442c-574b-4331-930c-8644b076b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:56.485968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 831/1669] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:56.486377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0215755-2f8b-4d5d-b552-e8f29869bb8c None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:56.491252 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:56.498871 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0215755-2f8b-4d5d-b552-e8f29869bb8c None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:56.529908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c0337-f8fe-40fc-be81-d969943d6d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:56.530597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c0337-f8fe-40fc-be81-d969943d6d8a admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:56.530885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c0337-f8fe-40fc-be81-d969943d6d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:56.531209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c0337-f8fe-40fc-be81-d969943d6d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:56.532205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c0337-f8fe-40fc-be81-d969943d6d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:59:56.532668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c0337-f8fe-40fc-be81-d969943d6d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:56.535163 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c0337-f8fe-40fc-be81-d969943d6d8a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:56.567232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 839/1670] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 20:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:59:56.579913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8442c-574b-4331-930c-8644b076b90b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:56.594347 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8442c-574b-4331-930c-8644b076b90b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:56.606463 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc87c7a-9465-49e6-819a-e044cf72cbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:56.607315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc87c7a-9465-49e6-819a-e044cf72cbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:56.607677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc87c7a-9465-49e6-819a-e044cf72cbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:56.608029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc87c7a-9465-49e6-819a-e044cf72cbb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:56.609028 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc87c7a-9465-49e6-819a-e044cf72cbb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:56.611541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc87c7a-9465-49e6-819a-e044cf72cbb9 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:56.802200 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 832/1671] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:56 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:56.806560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c0337-f8fe-40fc-be81-d969943d6d8a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:56.823840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c0337-f8fe-40fc-be81-d969943d6d8a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:56.932392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b911151-de70-4d6a-b995-10c67923ab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:56.933340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b911151-de70-4d6a-b995-10c67923ab93 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:56.933645 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b911151-de70-4d6a-b995-10c67923ab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:56.934098 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b911151-de70-4d6a-b995-10c67923ab93 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:56.934940 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b911151-de70-4d6a-b995-10c67923ab93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:56.937049 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b911151-de70-4d6a-b995-10c67923ab93 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:56.981559 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ecd4-1a3a-41eb-874a-8363cc35474d None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:56.982287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ecd4-1a3a-41eb-874a-8363cc35474d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:56.982767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ecd4-1a3a-41eb-874a-8363cc35474d None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:56.984407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 833/1672] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 20:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:59:57.072087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72597d08-4d0b-4f0b-9fa9-a4e594be0c31 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:57.073108 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72597d08-4d0b-4f0b-9fa9-a4e594be0c31 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:57.073727 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72597d08-4d0b-4f0b-9fa9-a4e594be0c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:57.075874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 840/1673] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:56 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:57.080296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b911151-de70-4d6a-b995-10c67923ab93 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:57.105991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b911151-de70-4d6a-b995-10c67923ab93 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:57.120620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d4e8b-de33-44e6-b0a8-d18a143ee83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:57.121654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d4e8b-de33-44e6-b0a8-d18a143ee83a admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:57.122208 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-72597d08-4d0b-4f0b-9fa9-a4e594be0c31 None None] MFA Rules not processed for user `619d0b5afa094289808516486a5e3c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:57.122655 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d4e8b-de33-44e6-b0a8-d18a143ee83a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:57.124917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d4e8b-de33-44e6-b0a8-d18a143ee83a admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:57.125977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d4e8b-de33-44e6-b0a8-d18a143ee83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:57.126947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-72597d08-4d0b-4f0b-9fa9-a4e594be0c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:57.134138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d4e8b-de33-44e6-b0a8-d18a143ee83a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:57.168683 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 841/1674] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 20:59:57.176142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d4e8b-de33-44e6-b0a8-d18a143ee83a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:57.198590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d4e8b-de33-44e6-b0a8-d18a143ee83a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:57.219107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7909a72-9ccd-46d9-86c5-e0f681f3eaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:57.220106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7909a72-9ccd-46d9-86c5-e0f681f3eaee admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:57.220567 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7909a72-9ccd-46d9-86c5-e0f681f3eaee admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:57.221015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7909a72-9ccd-46d9-86c5-e0f681f3eaee admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:57.221990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7909a72-9ccd-46d9-86c5-e0f681f3eaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:57.224300 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7909a72-9ccd-46d9-86c5-e0f681f3eaee admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:57.252172 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 842/1675] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:57.257337 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7909a72-9ccd-46d9-86c5-e0f681f3eaee admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:57.258213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 834/1676] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 20:59:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 31 20:59:57.278075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7909a72-9ccd-46d9-86c5-e0f681f3eaee admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:57.291122 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbb600-aa17-46c6-af5e-8a7cb156855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:57.292036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbb600-aa17-46c6-af5e-8a7cb156855f admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:57.292319 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbb600-aa17-46c6-af5e-8a7cb156855f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:57.292593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbb600-aa17-46c6-af5e-8a7cb156855f admin admin] PATH_INFO: `/v3/projects/34d6c7b6bbad43e78d69a1070004a82f/users/a4a6f10d52604be388018801a6f36740/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:57.334697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72597d08-4d0b-4f0b-9fa9-a4e594be0c31 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:57.336010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-72597d08-4d0b-4f0b-9fa9-a4e594be0c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:57.338891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbb600-aa17-46c6-af5e-8a7cb156855f admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d6c7b6bbad43e78d69a1070004a82f, user_id=a4a6f10d52604be388018801a6f36740, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:57.341698 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbb600-aa17-46c6-af5e-8a7cb156855f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:57.360911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72597d08-4d0b-4f0b-9fa9-a4e594be0c31 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:57.376831 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f9445-f226-4f65-b671-86ed14db736f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619d0b5afa094289808516486a5e3c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:57.377550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9445-f226-4f65-b671-86ed14db736f service placement] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:57.377875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9445-f226-4f65-b671-86ed14db736f service placement] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:57.378203 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9445-f226-4f65-b671-86ed14db736f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:57.411100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f9445-f226-4f65-b671-86ed14db736f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:57.412731 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f9445-f226-4f65-b671-86ed14db736f service placement] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:57.452100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 835/1677] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 20:59:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 20:59:57.454229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 843/1678] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:57 2022] PUT /identity/v3/projects/34d6c7b6bbad43e78d69a1070004a82f/users/a4a6f10d52604be388018801a6f36740/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:57.465795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeca3ec-dc9a-4330-8f2d-ceba642fabd5 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:57.466373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeca3ec-dc9a-4330-8f2d-ceba642fabd5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:57.473459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeca3ec-dc9a-4330-8f2d-ceba642fabd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:57.506708 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-abeca3ec-dc9a-4330-8f2d-ceba642fabd5 None None] MFA Rules not processed for user `a4a6f10d52604be388018801a6f36740`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:57.508118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-abeca3ec-dc9a-4330-8f2d-ceba642fabd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:57.512860 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:57.630890 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 836/1679] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:59:57.636409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbb600-aa17-46c6-af5e-8a7cb156855f admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:57.745353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbb600-aa17-46c6-af5e-8a7cb156855f admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:57.760539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4e3a5-eff6-4d90-beb3-3a89cde9d60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:57.764750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4e3a5-eff6-4d90-beb3-3a89cde9d60b admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:57.764750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4e3a5-eff6-4d90-beb3-3a89cde9d60b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:57.764750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4e3a5-eff6-4d90-beb3-3a89cde9d60b admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:57.764750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4e3a5-eff6-4d90-beb3-3a89cde9d60b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:57.766743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4e3a5-eff6-4d90-beb3-3a89cde9d60b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:57.921459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 844/1680] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:57 2022] POST /identity/v3/projects => generated 387 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:57.925657 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeca3ec-dc9a-4330-8f2d-ceba642fabd5 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:57.945145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeca3ec-dc9a-4330-8f2d-ceba642fabd5 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:58.200744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1d7ca-eb2f-4fc7-9da7-79a05159c9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:58.203224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d7ca-eb2f-4fc7-9da7-79a05159c9af admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:58.203702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d7ca-eb2f-4fc7-9da7-79a05159c9af admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:58.204116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d7ca-eb2f-4fc7-9da7-79a05159c9af admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:58.207799 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1d7ca-eb2f-4fc7-9da7-79a05159c9af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:58.214103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1d7ca-eb2f-4fc7-9da7-79a05159c9af admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:58.376930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 837/1681] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:57 2022] POST /identity/v3/users => generated 294 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:58.381117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4e3a5-eff6-4d90-beb3-3a89cde9d60b admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:58.409889 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4e3a5-eff6-4d90-beb3-3a89cde9d60b admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:58.422042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48f7ed-5fd5-43e1-a1a2-ec3df70d655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:58.423249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f7ed-5fd5-43e1-a1a2-ec3df70d655b admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:58.424748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f7ed-5fd5-43e1-a1a2-ec3df70d655b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:58.433530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f7ed-5fd5-43e1-a1a2-ec3df70d655b admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:58.435364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48f7ed-5fd5-43e1-a1a2-ec3df70d655b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:58.437612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48f7ed-5fd5-43e1-a1a2-ec3df70d655b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:58.459651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 845/1682] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:58.464517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1d7ca-eb2f-4fc7-9da7-79a05159c9af admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:58.484114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1d7ca-eb2f-4fc7-9da7-79a05159c9af admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:58.498736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b265f-e0f6-4b2a-b632-c9937dd4b38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:58.502528 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b265f-e0f6-4b2a-b632-c9937dd4b38d admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:58.503046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b265f-e0f6-4b2a-b632-c9937dd4b38d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:58.505277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b265f-e0f6-4b2a-b632-c9937dd4b38d admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:58.509454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b265f-e0f6-4b2a-b632-c9937dd4b38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:58.517706 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b265f-e0f6-4b2a-b632-c9937dd4b38d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:58.560615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 838/1683] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:58.562273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48f7ed-5fd5-43e1-a1a2-ec3df70d655b admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:58.579981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48f7ed-5fd5-43e1-a1a2-ec3df70d655b admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:58.599899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bc0da-6e8c-4d93-ae5c-722b9efdc094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:58.600952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bc0da-6e8c-4d93-ae5c-722b9efdc094 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:58.601279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bc0da-6e8c-4d93-ae5c-722b9efdc094 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:58.601964 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bc0da-6e8c-4d93-ae5c-722b9efdc094 admin admin] PATH_INFO: `/v3/projects/c38233e504a640a3bccbf7e9d3d86e44/users/7fcd83c128e74896a98997ebf3628ec4/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:58.605410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:58.629412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9bc0da-6e8c-4d93-ae5c-722b9efdc094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38233e504a640a3bccbf7e9d3d86e44, user_id=7fcd83c128e74896a98997ebf3628ec4, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:58.634834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9bc0da-6e8c-4d93-ae5c-722b9efdc094 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:58.816816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 846/1684] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:58 2022] PUT /identity/v3/projects/c38233e504a640a3bccbf7e9d3d86e44/users/7fcd83c128e74896a98997ebf3628ec4/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:58.828835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b7e3f-3fee-4cc7-921c-8aa002aa75f2 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:58.829244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b7e3f-3fee-4cc7-921c-8aa002aa75f2 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:58.830039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b7e3f-3fee-4cc7-921c-8aa002aa75f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:58.930639 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-990b7e3f-3fee-4cc7-921c-8aa002aa75f2 None None] MFA Rules not processed for user `7fcd83c128e74896a98997ebf3628ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:58.937842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-990b7e3f-3fee-4cc7-921c-8aa002aa75f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:59.076407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 839/1685] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 20:59:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:59.082944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bc0da-6e8c-4d93-ae5c-722b9efdc094 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:59.251747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bc0da-6e8c-4d93-ae5c-722b9efdc094 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:59.281095 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89aa09-9778-4d22-9564-f6735405af51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:59.281891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89aa09-9778-4d22-9564-f6735405af51 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:59.282173 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89aa09-9778-4d22-9564-f6735405af51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:59.282444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89aa09-9778-4d22-9564-f6735405af51 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:59.283157 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89aa09-9778-4d22-9564-f6735405af51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:59.286850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89aa09-9778-4d22-9564-f6735405af51 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:59.380791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c0834-cba8-4d8b-bc7c-4663fe19f24f None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:59.381087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c0834-cba8-4d8b-bc7c-4663fe19f24f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:59.381367 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c0834-cba8-4d8b-bc7c-4663fe19f24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:59.424523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b99c0834-cba8-4d8b-bc7c-4663fe19f24f None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:59.428604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b99c0834-cba8-4d8b-bc7c-4663fe19f24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:59.457663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 847/1686] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 20:59:59 2022] POST /identity/v3/projects => generated 387 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:59.461776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89aa09-9778-4d22-9564-f6735405af51 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:59.572072 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:59.679350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89aa09-9778-4d22-9564-f6735405af51 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:59.695881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7060532-1e23-4bea-bb33-7801d09b41bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:59.697521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7060532-1e23-4bea-bb33-7801d09b41bd admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:59.698105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7060532-1e23-4bea-bb33-7801d09b41bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:59.698888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7060532-1e23-4bea-bb33-7801d09b41bd admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:59.702922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7060532-1e23-4bea-bb33-7801d09b41bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:59.707411 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7060532-1e23-4bea-bb33-7801d09b41bd admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:59.716403 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 840/1687] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:59.860287 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 848/1688] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 20:59:59 2022] POST /identity/v3/users => generated 300 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:59.864382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c0834-cba8-4d8b-bc7c-4663fe19f24f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:59.881365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c0834-cba8-4d8b-bc7c-4663fe19f24f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:59.891289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55266c51-555d-4777-8d59-29d19019b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:59.892097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55266c51-555d-4777-8d59-29d19019b4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:59.892456 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55266c51-555d-4777-8d59-29d19019b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:59.892798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55266c51-555d-4777-8d59-29d19019b4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:59.894713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55266c51-555d-4777-8d59-29d19019b4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:59.902793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55266c51-555d-4777-8d59-29d19019b4e4 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:59.922274 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 841/1689] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 20:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:59.925837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7060532-1e23-4bea-bb33-7801d09b41bd admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:59.943423 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7060532-1e23-4bea-bb33-7801d09b41bd admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:59.962129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f950669-98a4-48c1-a95a-54427cec46d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:59.963105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f950669-98a4-48c1-a95a-54427cec46d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:59.963303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f950669-98a4-48c1-a95a-54427cec46d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:59.963581 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f950669-98a4-48c1-a95a-54427cec46d7 admin admin] PATH_INFO: `/v3/projects/bd66d8ba8e1f4ad7898b812c165e2eff/users/21bb97ead8ca45c59dad85d630f2c983/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:59.995098 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f950669-98a4-48c1-a95a-54427cec46d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd66d8ba8e1f4ad7898b812c165e2eff, user_id=21bb97ead8ca45c59dad85d630f2c983, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:59.998851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f950669-98a4-48c1-a95a-54427cec46d7 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:00.074081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 849/1690] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 20:59:59 2022] PUT /identity/v3/projects/bd66d8ba8e1f4ad7898b812c165e2eff/users/21bb97ead8ca45c59dad85d630f2c983/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:00.077882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55266c51-555d-4777-8d59-29d19019b4e4 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:00.100242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55266c51-555d-4777-8d59-29d19019b4e4 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:00.238620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b0b92-c286-4a44-8410-d0c00f1bc105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:00.239623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b0b92-c286-4a44-8410-d0c00f1bc105 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:00.240100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b0b92-c286-4a44-8410-d0c00f1bc105 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:00.240597 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b0b92-c286-4a44-8410-d0c00f1bc105 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:00.242039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b0b92-c286-4a44-8410-d0c00f1bc105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:00.244724 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b0b92-c286-4a44-8410-d0c00f1bc105 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:00.263517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f950669-98a4-48c1-a95a-54427cec46d7 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:00.267606 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0f950669-98a4-48c1-a95a-54427cec46d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:00.270932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 842/1691] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:00.270932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b0b92-c286-4a44-8410-d0c00f1bc105 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:00.274946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-212b0b92-c286-4a44-8410-d0c00f1bc105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:00.304018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b0b92-c286-4a44-8410-d0c00f1bc105 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:00.319538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99c57d-7866-4c9e-86d0-7df1c2cded5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:00.332256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99c57d-7866-4c9e-86d0-7df1c2cded5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:00.332256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99c57d-7866-4c9e-86d0-7df1c2cded5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:00.332256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99c57d-7866-4c9e-86d0-7df1c2cded5e admin admin] PATH_INFO: `/v3/users/95722c86dd3a4a909a351ad07f8be77d` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:00.332256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99c57d-7866-4c9e-86d0-7df1c2cded5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=95722c86dd3a4a909a351ad07f8be77d)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:00.332256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99c57d-7866-4c9e-86d0-7df1c2cded5e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:00.374257 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:00.446804 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f950669-98a4-48c1-a95a-54427cec46d7 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:00.462465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf8811-aa17-4d8a-b9f4-96bd3caa6063 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:00.463140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf8811-aa17-4d8a-b9f4-96bd3caa6063 service swift] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:00.463622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf8811-aa17-4d8a-b9f4-96bd3caa6063 service swift] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:00.464044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf8811-aa17-4d8a-b9f4-96bd3caa6063 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:00.597442 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf8811-aa17-4d8a-b9f4-96bd3caa6063 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:00.598995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf8811-aa17-4d8a-b9f4-96bd3caa6063 service swift] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:00.632447 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 850/1692] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:00:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:00:00.635033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf8811-aa17-4d8a-b9f4-96bd3caa6063 service swift] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:00.638968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0a99c57d-7866-4c9e-86d0-7df1c2cded5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95722c86dd3a4a909a351ad07f8be77d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:00.657206 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf8811-aa17-4d8a-b9f4-96bd3caa6063 service swift] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:00.663507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2754ad-d06d-4c3a-af21-d9c67122c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:00.680477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2754ad-d06d-4c3a-af21-d9c67122c044 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:00.680477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2754ad-d06d-4c3a-af21-d9c67122c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:00.680477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2754ad-d06d-4c3a-af21-d9c67122c044 admin admin] PATH_INFO: `/v3/projects/bd66d8ba8e1f4ad7898b812c165e2eff/users/21bb97ead8ca45c59dad85d630f2c983/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:00.680477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2754ad-d06d-4c3a-af21-d9c67122c044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd66d8ba8e1f4ad7898b812c165e2eff, user_id=21bb97ead8ca45c59dad85d630f2c983, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:00.680477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2754ad-d06d-4c3a-af21-d9c67122c044 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:00.685809 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 851/1693] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:00 2022] PUT /identity/v3/projects/bd66d8ba8e1f4ad7898b812c165e2eff/users/21bb97ead8ca45c59dad85d630f2c983/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:00.698616 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e8717-26af-4810-8d79-bd930d97cc96 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:00.699112 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e8717-26af-4810-8d79-bd930d97cc96 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:00.699567 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e8717-26af-4810-8d79-bd930d97cc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:00.729982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0a99c57d-7866-4c9e-86d0-7df1c2cded5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95722c86dd3a4a909a351ad07f8be77d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:00.731113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0a99c57d-7866-4c9e-86d0-7df1c2cded5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95722c86dd3a4a909a351ad07f8be77d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:00.743175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0a99c57d-7866-4c9e-86d0-7df1c2cded5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95722c86dd3a4a909a351ad07f8be77d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:00.746391 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0a99c57d-7866-4c9e-86d0-7df1c2cded5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95722c86dd3a4a909a351ad07f8be77d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:00.796895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 843/1694] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:00 2022] DELETE /identity/v3/users/95722c86dd3a4a909a351ad07f8be77d => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:00.798853 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2259fd-4083-437e-aa1e-df54c978a711 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:00.802256 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-902e8717-26af-4810-8d79-bd930d97cc96 None None] MFA Rules not processed for user `21bb97ead8ca45c59dad85d630f2c983`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:00.805122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2259fd-4083-437e-aa1e-df54c978a711 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:00.805732 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2259fd-4083-437e-aa1e-df54c978a711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:00.808938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-902e8717-26af-4810-8d79-bd930d97cc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:00.860234 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-cf2259fd-4083-437e-aa1e-df54c978a711 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:00.865935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cf2259fd-4083-437e-aa1e-df54c978a711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:00.892699 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:01.051046 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 852/1695] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:01.060964 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 844/1696] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:01.065340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e8717-26af-4810-8d79-bd930d97cc96 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:01.067484 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-902e8717-26af-4810-8d79-bd930d97cc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:01.115262 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2259fd-4083-437e-aa1e-df54c978a711 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:01.115262 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cf2259fd-4083-437e-aa1e-df54c978a711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:01.272932 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:01.287925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e8717-26af-4810-8d79-bd930d97cc96 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:01.301301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150c9c5-a4ce-4f6f-a4de-aacb86ddde77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:01.303340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c9c5-a4ce-4f6f-a4de-aacb86ddde77 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:01.309494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c9c5-a4ce-4f6f-a4de-aacb86ddde77 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:01.309906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c9c5-a4ce-4f6f-a4de-aacb86ddde77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:01.344727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150c9c5-a4ce-4f6f-a4de-aacb86ddde77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:01.346976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150c9c5-a4ce-4f6f-a4de-aacb86ddde77 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:01.362691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2259fd-4083-437e-aa1e-df54c978a711 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:01.381443 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 853/1697] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:01.387396 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b439810-8ba0-4370-b345-dc3b41e121f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:01.388846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b439810-8ba0-4370-b345-dc3b41e121f6 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:01.389342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b439810-8ba0-4370-b345-dc3b41e121f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:01.390468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b439810-8ba0-4370-b345-dc3b41e121f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:01.426596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b439810-8ba0-4370-b345-dc3b41e121f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:01.438722 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b439810-8ba0-4370-b345-dc3b41e121f6 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:01.471967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 845/1698] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:00:02.151300 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaf07d-5347-4c6d-8f54-320746d08a6d None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:02.151908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaf07d-5347-4c6d-8f54-320746d08a6d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:02.152068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaf07d-5347-4c6d-8f54-320746d08a6d None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:02.153784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 854/1699] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 21:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:00:02.354657 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd74d4-0c2f-4446-917c-48f642b578ef None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:02.355516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd74d4-0c2f-4446-917c-48f642b578ef None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:02.355516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd74d4-0c2f-4446-917c-48f642b578ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:02.399426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c7fd74d4-0c2f-4446-917c-48f642b578ef None None] MFA Rules not processed for user `619d0b5afa094289808516486a5e3c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:02.401428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c7fd74d4-0c2f-4446-917c-48f642b578ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:02.639601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 846/1700] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 21:00:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:02.774158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaf07d-5347-4c6d-8f54-320746d08a6d None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:02.787698 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-46aaf07d-5347-4c6d-8f54-320746d08a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:02.837408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaf07d-5347-4c6d-8f54-320746d08a6d None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:02.855824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396a015-cf7a-4797-bcbd-3c51dcdeb31b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619d0b5afa094289808516486a5e3c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:02.857171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396a015-cf7a-4797-bcbd-3c51dcdeb31b service placement] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:02.857171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396a015-cf7a-4797-bcbd-3c51dcdeb31b service placement] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:02.857171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396a015-cf7a-4797-bcbd-3c51dcdeb31b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:02.901813 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396a015-cf7a-4797-bcbd-3c51dcdeb31b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:02.903524 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396a015-cf7a-4797-bcbd-3c51dcdeb31b service placement] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:02.938111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 855/1701] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:03.022742 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd74d4-0c2f-4446-917c-48f642b578ef None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:03.024440 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c7fd74d4-0c2f-4446-917c-48f642b578ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:03.071060 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd74d4-0c2f-4446-917c-48f642b578ef None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:03.101179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:03.102453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:03.104966 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:03.105253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] PATH_INFO: `/v3/users/f6d3c10d75ff4162b1307b01bf637bc6` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:03.107976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d3c10d75ff4162b1307b01bf637bc6)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:03.113427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:03.414894 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d3c10d75ff4162b1307b01bf637bc6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:03.424805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:03.506293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378b1a6-c8cf-4aad-bb3a-349bb175567c None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:03.507176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378b1a6-c8cf-4aad-bb3a-349bb175567c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:03.507634 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378b1a6-c8cf-4aad-bb3a-349bb175567c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:03.538240 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d3c10d75ff4162b1307b01bf637bc6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:03.543872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d3c10d75ff4162b1307b01bf637bc6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:03.556984 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d3c10d75ff4162b1307b01bf637bc6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:03.569172 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d3c10d75ff4162b1307b01bf637bc6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:03.644584 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-c378b1a6-c8cf-4aad-bb3a-349bb175567c None None] MFA Rules not processed for user `3c5b1c6778f74c0d8db93e3a29935480`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:03.652458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c378b1a6-c8cf-4aad-bb3a-349bb175567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:03.683536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 847/1702] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:03 2022] DELETE /identity/v3/users/f6d3c10d75ff4162b1307b01bf637bc6 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:03.980807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 856/1703] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:03.994269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:03.994269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:04.033892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378b1a6-c8cf-4aad-bb3a-349bb175567c None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:04.036663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c378b1a6-c8cf-4aad-bb3a-349bb175567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:04.065868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378b1a6-c8cf-4aad-bb3a-349bb175567c None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:04.265335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ffe3b-cc7d-4d78-b366-0d50a45c1000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:04.265998 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ffe3b-cc7d-4d78-b366-0d50a45c1000 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:04.266523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ffe3b-cc7d-4d78-b366-0d50a45c1000 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:04.266854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ffe3b-cc7d-4d78-b366-0d50a45c1000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:04.270973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-121ffe3b-cc7d-4d78-b366-0d50a45c1000 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:04.276836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcc4fc-91ec-4208-a75b-79c11ca096cb admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:04.298423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb9800-136a-404d-a986-90ce97de3ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:04.303904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb9800-136a-404d-a986-90ce97de3ae7 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:04.303904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb9800-136a-404d-a986-90ce97de3ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:04.303904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb9800-136a-404d-a986-90ce97de3ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:04.443085 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ffe3b-cc7d-4d78-b366-0d50a45c1000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:04.444571 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ffe3b-cc7d-4d78-b366-0d50a45c1000 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:04.467465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb9800-136a-404d-a986-90ce97de3ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:04.469230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb9800-136a-404d-a986-90ce97de3ae7 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:04.471114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 857/1704] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:04.486771 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 848/1705] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:05.271001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ffe3b-cc7d-4d78-b366-0d50a45c1000 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:05.272747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-121ffe3b-cc7d-4d78-b366-0d50a45c1000 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:05.325103 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:05.484475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb9800-136a-404d-a986-90ce97de3ae7 service nova] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:05.485953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-33eb9800-136a-404d-a986-90ce97de3ae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:05.509840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ffe3b-cc7d-4d78-b366-0d50a45c1000 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:05.519789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb9800-136a-404d-a986-90ce97de3ae7 service nova] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:05.530136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:05.537992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:05.539200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:05.539976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe515-95a8-46b6-aad2-7611e7565876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:05.540440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] PATH_INFO: `/v3/projects/12ace054f8e54ea094ad92c72a996f51` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:05.542221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe515-95a8-46b6-aad2-7611e7565876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:05.543195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ace054f8e54ea094ad92c72a996f51)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:05.543676 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe515-95a8-46b6-aad2-7611e7565876 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:05.546146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe515-95a8-46b6-aad2-7611e7565876 admin admin] PATH_INFO: `/v3/projects/b46a24aab1c04e61bf44c517afc6fa32` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:05.553145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:05.553293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe515-95a8-46b6-aad2-7611e7565876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46a24aab1c04e61bf44c517afc6fa32)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:05.556230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe515-95a8-46b6-aad2-7611e7565876 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:05.856503 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ace054f8e54ea094ad92c72a996f51', 'request_id': 'req-75e411cc-d74d-4213-afb3-2109c1392caa'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:05.899202 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-56fbe515-95a8-46b6-aad2-7611e7565876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46a24aab1c04e61bf44c517afc6fa32', 'request_id': 'req-56fbe515-95a8-46b6-aad2-7611e7565876'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:06.046360 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ace054f8e54ea094ad92c72a996f51', 'request_id': 'req-75e411cc-d74d-4213-afb3-2109c1392caa'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:06.054348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ace054f8e54ea094ad92c72a996f51', 'request_id': 'req-75e411cc-d74d-4213-afb3-2109c1392caa'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:06.092555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] The token cache is being invalidate because project 12ace054f8e54ea094ad92c72a996f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:06.095839 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:06.097794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:06.101850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 858/1706] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:05 2022] DELETE /identity/v3/projects/12ace054f8e54ea094ad92c72a996f51 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:06.107373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:06.109539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:06.147870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-56fbe515-95a8-46b6-aad2-7611e7565876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46a24aab1c04e61bf44c517afc6fa32', 'request_id': 'req-56fbe515-95a8-46b6-aad2-7611e7565876'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:06.151505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:06.161789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-56fbe515-95a8-46b6-aad2-7611e7565876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46a24aab1c04e61bf44c517afc6fa32', 'request_id': 'req-56fbe515-95a8-46b6-aad2-7611e7565876'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:06.196627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-56fbe515-95a8-46b6-aad2-7611e7565876 admin admin] The token cache is being invalidate because project b46a24aab1c04e61bf44c517afc6fa32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:06.196927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-56fbe515-95a8-46b6-aad2-7611e7565876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:06.201479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-56fbe515-95a8-46b6-aad2-7611e7565876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:06.211784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 849/1707] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:05 2022] DELETE /identity/v3/projects/b46a24aab1c04e61bf44c517afc6fa32 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:06.230008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e76c8-91ac-4530-8b88-2f2cf4a95f4e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:06.231025 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e76c8-91ac-4530-8b88-2f2cf4a95f4e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:06.231319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e76c8-91ac-4530-8b88-2f2cf4a95f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:06.354589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-261e76c8-91ac-4530-8b88-2f2cf4a95f4e None None] MFA Rules not processed for user `16a77c08d2844e7cb81ac1370c527cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:06.354589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-261e76c8-91ac-4530-8b88-2f2cf4a95f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:06.455920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e411cc-d74d-4213-afb3-2109c1392caa admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:06.535929 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 850/1708] 10.222.0.32 () {58 vars in 1015 bytes} [Tue May 31 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:06.536829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e76c8-91ac-4530-8b88-2f2cf4a95f4e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:06.539242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-261e76c8-91ac-4530-8b88-2f2cf4a95f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:06.756786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:06.785308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:06.789252 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:06.792100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:06.792621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] PATH_INFO: `/v3/users/c909444bdc8e448db0606eeb64e9c859` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:06.808743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c909444bdc8e448db0606eeb64e9c859)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:06.809783 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e76c8-91ac-4530-8b88-2f2cf4a95f4e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:06.810225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: WARNING py.warnings [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 21:00:06.810225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: warnings.warn(msg) May 31 21:00:06.810225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: May 31 21:00:06.811452 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:06.825952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dc11f-04a1-440a-bd65-29c96cf429d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:06.837323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc11f-04a1-440a-bd65-29c96cf429d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:06.837649 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc11f-04a1-440a-bd65-29c96cf429d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:06.847951 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc11f-04a1-440a-bd65-29c96cf429d8 admin admin] PATH_INFO: `/v3/users/d62c18ed5a9c429793c28360a7ec3b20` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:06.849726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dc11f-04a1-440a-bd65-29c96cf429d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d62c18ed5a9c429793c28360a7ec3b20)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:06.852410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dc11f-04a1-440a-bd65-29c96cf429d8 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:07.139709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c909444bdc8e448db0606eeb64e9c859'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:07.235284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8f3dc11f-04a1-440a-bd65-29c96cf429d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd62c18ed5a9c429793c28360a7ec3b20'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:07.256388 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c909444bdc8e448db0606eeb64e9c859'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:07.285781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c909444bdc8e448db0606eeb64e9c859'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:07.288581 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c909444bdc8e448db0606eeb64e9c859'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:07.289651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c909444bdc8e448db0606eeb64e9c859'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:07.343935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8f3dc11f-04a1-440a-bd65-29c96cf429d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd62c18ed5a9c429793c28360a7ec3b20'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:07.345600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8f3dc11f-04a1-440a-bd65-29c96cf429d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd62c18ed5a9c429793c28360a7ec3b20'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:07.368827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8f3dc11f-04a1-440a-bd65-29c96cf429d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd62c18ed5a9c429793c28360a7ec3b20'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:07.382070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8f3dc11f-04a1-440a-bd65-29c96cf429d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd62c18ed5a9c429793c28360a7ec3b20'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:07.417924 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 851/1709] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:06 2022] DELETE /identity/v3/users/d62c18ed5a9c429793c28360a7ec3b20 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:07.420051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838693d-ad16-4c30-8208-66f4932926aa None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:07.420579 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838693d-ad16-4c30-8208-66f4932926aa None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:07.442162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 859/1710] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:06 2022] DELETE /identity/v3/users/c909444bdc8e448db0606eeb64e9c859 => generated 0 bytes in 1332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:07.442460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838693d-ad16-4c30-8208-66f4932926aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:07.444750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:07.445346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:07.535271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d838693d-ad16-4c30-8208-66f4932926aa None None] MFA Rules not processed for user `c9b5be694ffc4b329af316dc2b23fd18`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:07.537190 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d838693d-ad16-4c30-8208-66f4932926aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:07.652479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 852/1711] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:07.674563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838693d-ad16-4c30-8208-66f4932926aa None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:07.677883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d838693d-ad16-4c30-8208-66f4932926aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:07.752938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:07.764002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee4711-b593-4dad-a5e8-d9dbfbaaad1c admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:07.796204 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205749-a8b9-4436-8f70-2659ceae370f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:07.797415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205749-a8b9-4436-8f70-2659ceae370f service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:07.797964 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205749-a8b9-4436-8f70-2659ceae370f service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:07.798399 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205749-a8b9-4436-8f70-2659ceae370f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:07.807163 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5c205749-a8b9-4436-8f70-2659ceae370f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:07.861663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205749-a8b9-4436-8f70-2659ceae370f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:07.869990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205749-a8b9-4436-8f70-2659ceae370f service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:07.899079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 860/1712] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:07.931535 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838693d-ad16-4c30-8208-66f4932926aa None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:07.951927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f61eb1-eab2-49ca-af58-051469936363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:07.952936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f61eb1-eab2-49ca-af58-051469936363 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:07.953130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f61eb1-eab2-49ca-af58-051469936363 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:07.953558 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f61eb1-eab2-49ca-af58-051469936363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:07.975937 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f61eb1-eab2-49ca-af58-051469936363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:07.981164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f61eb1-eab2-49ca-af58-051469936363 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:07.991660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 853/1713] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:09.086146 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205749-a8b9-4436-8f70-2659ceae370f service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:09.088141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5c205749-a8b9-4436-8f70-2659ceae370f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:09.369586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205749-a8b9-4436-8f70-2659ceae370f service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:09.400943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdb199-0a72-4111-bb03-d4b3be26a574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:09.402706 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdb199-0a72-4111-bb03-d4b3be26a574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:09.403321 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdb199-0a72-4111-bb03-d4b3be26a574 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:09.403917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdb199-0a72-4111-bb03-d4b3be26a574 admin admin] PATH_INFO: `/v3/projects/23f3ae9b0b03494f9ea76a206ef461e1` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:09.406249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdb199-0a72-4111-bb03-d4b3be26a574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f3ae9b0b03494f9ea76a206ef461e1)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:09.408405 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdb199-0a72-4111-bb03-d4b3be26a574 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:09.520916 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:09.618295 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7bcdb199-0a72-4111-bb03-d4b3be26a574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f3ae9b0b03494f9ea76a206ef461e1', 'request_id': 'req-7bcdb199-0a72-4111-bb03-d4b3be26a574'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:09.706763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7bcdb199-0a72-4111-bb03-d4b3be26a574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f3ae9b0b03494f9ea76a206ef461e1', 'request_id': 'req-7bcdb199-0a72-4111-bb03-d4b3be26a574'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:09.717271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7bcdb199-0a72-4111-bb03-d4b3be26a574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f3ae9b0b03494f9ea76a206ef461e1', 'request_id': 'req-7bcdb199-0a72-4111-bb03-d4b3be26a574'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:09.755210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7bcdb199-0a72-4111-bb03-d4b3be26a574 admin admin] The token cache is being invalidate because project 23f3ae9b0b03494f9ea76a206ef461e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:09.755210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7bcdb199-0a72-4111-bb03-d4b3be26a574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:09.758784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7bcdb199-0a72-4111-bb03-d4b3be26a574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:09.778588 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3561eb-b0c4-4ebf-9b52-bbbbd17cbe97 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:09.779564 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3561eb-b0c4-4ebf-9b52-bbbbd17cbe97 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:09.780225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 861/1714] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:09 2022] DELETE /identity/v3/projects/23f3ae9b0b03494f9ea76a206ef461e1 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:09.780338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3561eb-b0c4-4ebf-9b52-bbbbd17cbe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:09.825656 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7c3561eb-b0c4-4ebf-9b52-bbbbd17cbe97 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:09.827227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7c3561eb-b0c4-4ebf-9b52-bbbbd17cbe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:09.907048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 854/1715] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:09.914913 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6679a8-8cff-4796-8cc3-e99efc9a7c53 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:09.915820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6679a8-8cff-4796-8cc3-e99efc9a7c53 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:09.920603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6679a8-8cff-4796-8cc3-e99efc9a7c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:09.966898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-df6679a8-8cff-4796-8cc3-e99efc9a7c53 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:09.974258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-df6679a8-8cff-4796-8cc3-e99efc9a7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:10.005398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3561eb-b0c4-4ebf-9b52-bbbbd17cbe97 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:10.024628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 862/1716] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:10.025030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3561eb-b0c4-4ebf-9b52-bbbbd17cbe97 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:10.044527 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2f912-b399-47b2-8308-105c95e3c163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:10.045493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f912-b399-47b2-8308-105c95e3c163 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:10.045931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f912-b399-47b2-8308-105c95e3c163 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:10.046601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f912-b399-47b2-8308-105c95e3c163 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:10.047554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2f912-b399-47b2-8308-105c95e3c163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:00:10.048546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2f912-b399-47b2-8308-105c95e3c163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:10.050964 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2f912-b399-47b2-8308-105c95e3c163 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:10.094069 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 855/1717] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:00:10.094721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6679a8-8cff-4796-8cc3-e99efc9a7c53 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:10.120200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6679a8-8cff-4796-8cc3-e99efc9a7c53 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:10.125530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1f52e-8aba-490c-9cc0-9f4f1b02a054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:10.126207 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1f52e-8aba-490c-9cc0-9f4f1b02a054 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:10.126493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1f52e-8aba-490c-9cc0-9f4f1b02a054 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:10.126774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1f52e-8aba-490c-9cc0-9f4f1b02a054 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:10.127481 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1f52e-8aba-490c-9cc0-9f4f1b02a054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:10.130339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1f52e-8aba-490c-9cc0-9f4f1b02a054 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:10.203402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6e7d2-8a22-4153-b344-ef1bb1ce2000 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:10.203402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6e7d2-8a22-4153-b344-ef1bb1ce2000 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:10.206723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6e7d2-8a22-4153-b344-ef1bb1ce2000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:10.278650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-40c6e7d2-8a22-4153-b344-ef1bb1ce2000 None None] MFA Rules not processed for user `0567620b615f4a8ab2bc5c69ba85cc93`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:10.280353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-40c6e7d2-8a22-4153-b344-ef1bb1ce2000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:10.290051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:10.372897 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 863/1718] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:10 2022] POST /identity/v3/projects => generated 365 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:10.378311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1f52e-8aba-490c-9cc0-9f4f1b02a054 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:10.565422 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 856/1719] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:10.569057 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc9a4b-d5d4-42da-9873-b74384b2038b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:10.569362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc9a4b-d5d4-42da-9873-b74384b2038b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:10.569672 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc9a4b-d5d4-42da-9873-b74384b2038b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:10.589981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-89cc9a4b-d5d4-42da-9873-b74384b2038b None None] MFA Rules not processed for user `0567620b615f4a8ab2bc5c69ba85cc93`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:10.591224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-89cc9a4b-d5d4-42da-9873-b74384b2038b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:10.629175 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1f52e-8aba-490c-9cc0-9f4f1b02a054 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:10.657257 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca02d3-9459-48bf-80d0-2d6b24502b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:10.658318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca02d3-9459-48bf-80d0-2d6b24502b5e admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:10.658840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca02d3-9459-48bf-80d0-2d6b24502b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:10.659860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca02d3-9459-48bf-80d0-2d6b24502b5e admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:10.671614 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca02d3-9459-48bf-80d0-2d6b24502b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:10.679141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca02d3-9459-48bf-80d0-2d6b24502b5e admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:10.693944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 857/1720] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:10.701865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc9a4b-d5d4-42da-9873-b74384b2038b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:10.703798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-89cc9a4b-d5d4-42da-9873-b74384b2038b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:10.863631 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc9a4b-d5d4-42da-9873-b74384b2038b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:10.875721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7051-7949-4cc2-9fcb-b05acc0f4c8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:10.876843 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7051-7949-4cc2-9fcb-b05acc0f4c8a service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:10.877279 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7051-7949-4cc2-9fcb-b05acc0f4c8a service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:10.877792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7051-7949-4cc2-9fcb-b05acc0f4c8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:10.897242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 864/1721] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:10 2022] POST /identity/v3/users => generated 283 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:10.902471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca02d3-9459-48bf-80d0-2d6b24502b5e admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:10.929521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca02d3-9459-48bf-80d0-2d6b24502b5e admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:10.932408 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa7051-7949-4cc2-9fcb-b05acc0f4c8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:10.935816 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa7051-7949-4cc2-9fcb-b05acc0f4c8a service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:10.948339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa108621-4014-41f9-b880-3f8d504643d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:10.949144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa108621-4014-41f9-b880-3f8d504643d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:10.949507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa108621-4014-41f9-b880-3f8d504643d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:10.949789 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa108621-4014-41f9-b880-3f8d504643d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:10.950527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa108621-4014-41f9-b880-3f8d504643d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:10.961463 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa108621-4014-41f9-b880-3f8d504643d8 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:10.969447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 858/1722] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:00:10.980123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 865/1723] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:10.983609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7051-7949-4cc2-9fcb-b05acc0f4c8a service nova] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:11.005202 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7051-7949-4cc2-9fcb-b05acc0f4c8a service nova] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:11.040672 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dd7c1-6632-4149-8830-d876e9ef02c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:11.041712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dd7c1-6632-4149-8830-d876e9ef02c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:11.041926 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dd7c1-6632-4149-8830-d876e9ef02c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:11.042233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dd7c1-6632-4149-8830-d876e9ef02c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:11.042978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dd7c1-6632-4149-8830-d876e9ef02c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:11.051912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dd7c1-6632-4149-8830-d876e9ef02c5 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:11.088483 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 859/1724] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:11.089744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa108621-4014-41f9-b880-3f8d504643d8 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:11.109863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa108621-4014-41f9-b880-3f8d504643d8 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:11.133631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493be1fb-f706-4ca0-acd7-8606b361b422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:11.138586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493be1fb-f706-4ca0-acd7-8606b361b422 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:11.138586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493be1fb-f706-4ca0-acd7-8606b361b422 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:11.138586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493be1fb-f706-4ca0-acd7-8606b361b422 admin admin] PATH_INFO: `/v3/projects/92c02cb6d5c14035b7ea0c821875276b/users/50d06583c051478388794a169e0a4b92/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:11.218478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493be1fb-f706-4ca0-acd7-8606b361b422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c02cb6d5c14035b7ea0c821875276b, user_id=50d06583c051478388794a169e0a4b92, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:11.223577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a319a9-ec13-42a9-852c-b289657b7b0a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:11.223825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a319a9-ec13-42a9-852c-b289657b7b0a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:11.224107 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a319a9-ec13-42a9-852c-b289657b7b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:11.248668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493be1fb-f706-4ca0-acd7-8606b361b422 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:11.304872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b7a319a9-ec13-42a9-852c-b289657b7b0a None None] MFA Rules not processed for user `e0d9dcb062ad4376866a98edebede7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:11.304872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b7a319a9-ec13-42a9-852c-b289657b7b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:11.347630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 866/1725] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:11 2022] PUT /identity/v3/projects/92c02cb6d5c14035b7ea0c821875276b/users/50d06583c051478388794a169e0a4b92/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:11.349307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f9582-d8bc-4c31-8c91-dd7b899a470f None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:11.349951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f9582-d8bc-4c31-8c91-dd7b899a470f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:11.350395 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f9582-d8bc-4c31-8c91-dd7b899a470f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:11.373824 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:11.427728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b41f9582-d8bc-4c31-8c91-dd7b899a470f None None] MFA Rules not processed for user `50d06583c051478388794a169e0a4b92`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:11.429281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b41f9582-d8bc-4c31-8c91-dd7b899a470f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:11.528048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 860/1726] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:11.596353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 867/1727] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:11.602060 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a319a9-ec13-42a9-852c-b289657b7b0a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:11.633117 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a319a9-ec13-42a9-852c-b289657b7b0a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:11.692246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:DELETE=7,keystone:SELECT=87,keystone:INSERT=6 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:11.730591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f9582-d8bc-4c31-8c91-dd7b899a470f None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:11.733475 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b41f9582-d8bc-4c31-8c91-dd7b899a470f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:11.824546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a2c9f-a8f7-4cb9-a47b-2d2a8e75d9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:11.825632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a2c9f-a8f7-4cb9-a47b-2d2a8e75d9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:11.829417 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a2c9f-a8f7-4cb9-a47b-2d2a8e75d9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:11.830061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a2c9f-a8f7-4cb9-a47b-2d2a8e75d9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:11.831067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a2c9f-a8f7-4cb9-a47b-2d2a8e75d9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:11.837496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a2c9f-a8f7-4cb9-a47b-2d2a8e75d9d7 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:11.890478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f9582-d8bc-4c31-8c91-dd7b899a470f None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:11.901413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266c11a-cf29-4f1c-b3a2-a05d6c785109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:11.902604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266c11a-cf29-4f1c-b3a2-a05d6c785109 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:11.903054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266c11a-cf29-4f1c-b3a2-a05d6c785109 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:11.903615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266c11a-cf29-4f1c-b3a2-a05d6c785109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:11.906705 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a266c11a-cf29-4f1c-b3a2-a05d6c785109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:11.981174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 861/1728] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:11 2022] POST /identity/v3/projects => generated 365 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:11.981174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a2c9f-a8f7-4cb9-a47b-2d2a8e75d9d7 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:11.986615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-718a2c9f-a8f7-4cb9-a47b-2d2a8e75d9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:12.089635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266c11a-cf29-4f1c-b3a2-a05d6c785109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:12.091180 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266c11a-cf29-4f1c-b3a2-a05d6c785109 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:12.117523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 868/1729] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:12.120199 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266c11a-cf29-4f1c-b3a2-a05d6c785109 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:12.154990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266c11a-cf29-4f1c-b3a2-a05d6c785109 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:12.214520 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a2c9f-a8f7-4cb9-a47b-2d2a8e75d9d7 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:12.256671 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8528f1-ffe9-4875-af8c-36e33e11d6d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:12.263379 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8528f1-ffe9-4875-af8c-36e33e11d6d2 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:12.264219 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8528f1-ffe9-4875-af8c-36e33e11d6d2 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:12.267117 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8528f1-ffe9-4875-af8c-36e33e11d6d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:12.396604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:12.428735 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a39d1-de1f-4997-93c2-e011c7583b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:12.434239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a39d1-de1f-4997-93c2-e011c7583b22 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:12.436917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a39d1-de1f-4997-93c2-e011c7583b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:12.438823 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a39d1-de1f-4997-93c2-e011c7583b22 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:12.443346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a39d1-de1f-4997-93c2-e011c7583b22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:12.458089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a39d1-de1f-4997-93c2-e011c7583b22 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:12.475579 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8528f1-ffe9-4875-af8c-36e33e11d6d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:12.480995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8528f1-ffe9-4875-af8c-36e33e11d6d2 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:12.522519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 862/1730] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:12.523447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8528f1-ffe9-4875-af8c-36e33e11d6d2 service nova] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:12.531592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0c8528f1-ffe9-4875-af8c-36e33e11d6d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:12.596181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 869/1731] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:12 2022] POST /identity/v3/users => generated 289 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:12.600011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8528f1-ffe9-4875-af8c-36e33e11d6d2 service nova] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:12.600494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a39d1-de1f-4997-93c2-e011c7583b22 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:12.625195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88f72d-f71d-4980-8fba-f04b3d309dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:12.629869 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88f72d-f71d-4980-8fba-f04b3d309dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:12.631119 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88f72d-f71d-4980-8fba-f04b3d309dab admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:12.631408 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88f72d-f71d-4980-8fba-f04b3d309dab admin admin] PATH_INFO: `/v3/projects/1774c0b6ac1940609fd7dbd88de06cac` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:12.636465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88f72d-f71d-4980-8fba-f04b3d309dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1774c0b6ac1940609fd7dbd88de06cac)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:12.639984 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a39d1-de1f-4997-93c2-e011c7583b22 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:12.641582 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88f72d-f71d-4980-8fba-f04b3d309dab admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:12.681979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a0c8f-dc00-4325-b7b2-89df4f790f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:12.687237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a0c8f-dc00-4325-b7b2-89df4f790f6d admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:12.687551 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a0c8f-dc00-4325-b7b2-89df4f790f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:12.689675 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a0c8f-dc00-4325-b7b2-89df4f790f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:12.692273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a0c8f-dc00-4325-b7b2-89df4f790f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:12.704591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a0c8f-dc00-4325-b7b2-89df4f790f6d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:12.729950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 870/1732] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:12.735366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a0c8f-dc00-4325-b7b2-89df4f790f6d admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:12.769852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a0c8f-dc00-4325-b7b2-89df4f790f6d admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:12.788023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf442d30-ec01-454d-b26b-fe985c0ad6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:12.788955 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf442d30-ec01-454d-b26b-fe985c0ad6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:12.789245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf442d30-ec01-454d-b26b-fe985c0ad6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:12.789601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf442d30-ec01-454d-b26b-fe985c0ad6c2 admin admin] PATH_INFO: `/v3/projects/4d669dd250824629a7c30c207034935e/users/c6779495a7ec42d0b20bfe69eef22388/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:12.793899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:12.840079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf442d30-ec01-454d-b26b-fe985c0ad6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d669dd250824629a7c30c207034935e, user_id=c6779495a7ec42d0b20bfe69eef22388, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:12.851374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf442d30-ec01-454d-b26b-fe985c0ad6c2 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:12.876572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1d88f72d-f71d-4980-8fba-f04b3d309dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1774c0b6ac1940609fd7dbd88de06cac', 'request_id': 'req-1d88f72d-f71d-4980-8fba-f04b3d309dab'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:12.953591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1d88f72d-f71d-4980-8fba-f04b3d309dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1774c0b6ac1940609fd7dbd88de06cac', 'request_id': 'req-1d88f72d-f71d-4980-8fba-f04b3d309dab'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:12.972478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1d88f72d-f71d-4980-8fba-f04b3d309dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1774c0b6ac1940609fd7dbd88de06cac', 'request_id': 'req-1d88f72d-f71d-4980-8fba-f04b3d309dab'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:13.006857 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 871/1733] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:12 2022] PUT /identity/v3/projects/4d669dd250824629a7c30c207034935e/users/c6779495a7ec42d0b20bfe69eef22388/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:13.010806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf442d30-ec01-454d-b26b-fe985c0ad6c2 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:13.016365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1d88f72d-f71d-4980-8fba-f04b3d309dab admin admin] The token cache is being invalidate because project 1774c0b6ac1940609fd7dbd88de06cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:13.016974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1d88f72d-f71d-4980-8fba-f04b3d309dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:13.017736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1d88f72d-f71d-4980-8fba-f04b3d309dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:13.038164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 863/1734] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:12 2022] DELETE /identity/v3/projects/1774c0b6ac1940609fd7dbd88de06cac => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:13.044399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a9450-703d-4775-9384-59ba8f854355 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:13.044718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a9450-703d-4775-9384-59ba8f854355 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:13.045001 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a9450-703d-4775-9384-59ba8f854355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:13.144142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-904a9450-703d-4775-9384-59ba8f854355 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:13.145850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-904a9450-703d-4775-9384-59ba8f854355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:13.240175 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf442d30-ec01-454d-b26b-fe985c0ad6c2 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:13.254840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1387a7-fb08-4ed9-939f-713d28f8acbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:13.255961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1387a7-fb08-4ed9-939f-713d28f8acbe admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:13.256472 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1387a7-fb08-4ed9-939f-713d28f8acbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:13.256970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1387a7-fb08-4ed9-939f-713d28f8acbe admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:13.258059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1387a7-fb08-4ed9-939f-713d28f8acbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:13.260153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1387a7-fb08-4ed9-939f-713d28f8acbe admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:13.291528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 872/1735] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:13.293114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1387a7-fb08-4ed9-939f-713d28f8acbe admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:13.296853 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2e1387a7-fb08-4ed9-939f-713d28f8acbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:13.335800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1387a7-fb08-4ed9-939f-713d28f8acbe admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:13.351707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b036d-3a98-4521-ae49-0075c7ba7ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:13.353628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 864/1736] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:13.354011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b036d-3a98-4521-ae49-0075c7ba7ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:13.354508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b036d-3a98-4521-ae49-0075c7ba7ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:13.355277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c0574-8778-4543-822c-f5a331f5c528 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:13.355570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c0574-8778-4543-822c-f5a331f5c528 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:13.355894 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c0574-8778-4543-822c-f5a331f5c528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:13.356766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b036d-3a98-4521-ae49-0075c7ba7ab6 admin admin] PATH_INFO: `/v3/projects/4d669dd250824629a7c30c207034935e/users/c6779495a7ec42d0b20bfe69eef22388/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:13.364622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b036d-3a98-4521-ae49-0075c7ba7ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d669dd250824629a7c30c207034935e, user_id=c6779495a7ec42d0b20bfe69eef22388, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:13.373749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b036d-3a98-4521-ae49-0075c7ba7ab6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:13.390835 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 873/1737] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:13 2022] PUT /identity/v3/projects/4d669dd250824629a7c30c207034935e/users/c6779495a7ec42d0b20bfe69eef22388/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:13.403157 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02eba-ef9c-4d2a-9672-f5ca39f41883 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:13.403436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02eba-ef9c-4d2a-9672-f5ca39f41883 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:13.403719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02eba-ef9c-4d2a-9672-f5ca39f41883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:13.404925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-1f8c0574-8778-4543-822c-f5a331f5c528 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:13.406683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1f8c0574-8778-4543-822c-f5a331f5c528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:13.468129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-42b02eba-ef9c-4d2a-9672-f5ca39f41883 None None] MFA Rules not processed for user `c6779495a7ec42d0b20bfe69eef22388`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:13.470064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-42b02eba-ef9c-4d2a-9672-f5ca39f41883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:13.597056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 865/1738] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:13.598934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fde2c-9c95-4366-b691-c8d9ffc2eeb9 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:13.599799 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fde2c-9c95-4366-b691-c8d9ffc2eeb9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:13.600693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fde2c-9c95-4366-b691-c8d9ffc2eeb9 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:13.604700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 866/1739] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 21:00:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:00:13.606334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fde2c-9c95-4366-b691-c8d9ffc2eeb9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:13.624975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:13.641602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fde2c-9c95-4366-b691-c8d9ffc2eeb9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:13.653642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc25ad-fe35-4b90-ae9c-8e8c52c17568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:13.654662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc25ad-fe35-4b90-ae9c-8e8c52c17568 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:13.655111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc25ad-fe35-4b90-ae9c-8e8c52c17568 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:13.657647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc25ad-fe35-4b90-ae9c-8e8c52c17568 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:13.657769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 874/1740] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:13.657858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc25ad-fe35-4b90-ae9c-8e8c52c17568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:00:13.657858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc25ad-fe35-4b90-ae9c-8e8c52c17568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:13.659741 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc25ad-fe35-4b90-ae9c-8e8c52c17568 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:13.670720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b02eba-ef9c-4d2a-9672-f5ca39f41883 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:13.677277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-42b02eba-ef9c-4d2a-9672-f5ca39f41883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:13.700635 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 867/1741] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:00:13.705346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc25ad-fe35-4b90-ae9c-8e8c52c17568 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:13.733227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc25ad-fe35-4b90-ae9c-8e8c52c17568 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:13.748570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450da2a-402b-4c94-8d58-3a2caaeeca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:13.749770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450da2a-402b-4c94-8d58-3a2caaeeca0f admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:13.750179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450da2a-402b-4c94-8d58-3a2caaeeca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:13.750539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450da2a-402b-4c94-8d58-3a2caaeeca0f admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:13.751366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450da2a-402b-4c94-8d58-3a2caaeeca0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:13.754064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450da2a-402b-4c94-8d58-3a2caaeeca0f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:13.829462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:13.860132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b02eba-ef9c-4d2a-9672-f5ca39f41883 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:13.865272 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d7277-85ab-4cfc-94d1-c8d550b16dfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:13.866522 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d7277-85ab-4cfc-94d1-c8d550b16dfa service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:13.867091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d7277-85ab-4cfc-94d1-c8d550b16dfa service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:13.867571 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d7277-85ab-4cfc-94d1-c8d550b16dfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:13.880084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d7277-85ab-4cfc-94d1-c8d550b16dfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:13.882205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d7277-85ab-4cfc-94d1-c8d550b16dfa service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:13.894172 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 875/1742] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:13.895931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65f036-280d-4b87-bfcd-4b0f6cb70c17 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:13.896453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65f036-280d-4b87-bfcd-4b0f6cb70c17 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:13.896938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65f036-280d-4b87-bfcd-4b0f6cb70c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:13.914126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 868/1743] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:13 2022] POST /identity/v3/projects => generated 355 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:13.915653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450da2a-402b-4c94-8d58-3a2caaeeca0f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:13.965328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-7e65f036-280d-4b87-bfcd-4b0f6cb70c17 None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:13.973021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7e65f036-280d-4b87-bfcd-4b0f6cb70c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:14.099714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450da2a-402b-4c94-8d58-3a2caaeeca0f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:14.111272 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e804ae-2cf5-4466-9c80-fed217509d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:14.112004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e804ae-2cf5-4466-9c80-fed217509d04 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:14.112326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e804ae-2cf5-4466-9c80-fed217509d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:14.112687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e804ae-2cf5-4466-9c80-fed217509d04 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:14.113777 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e804ae-2cf5-4466-9c80-fed217509d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:14.117543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e804ae-2cf5-4466-9c80-fed217509d04 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:14.162531 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 876/1744] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:14.163896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79f667-d59d-40cb-93af-ea9aa70593e1 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:14.164158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79f667-d59d-40cb-93af-ea9aa70593e1 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:14.164651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79f667-d59d-40cb-93af-ea9aa70593e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:14.185685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-dd79f667-d59d-40cb-93af-ea9aa70593e1 None None] MFA Rules not processed for user `3c5b1c6778f74c0d8db93e3a29935480`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:14.187018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-dd79f667-d59d-40cb-93af-ea9aa70593e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:14.254104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 877/1745] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:14.277360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 869/1746] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:13 2022] POST /identity/v3/users => generated 278 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:14.282402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79f667-d59d-40cb-93af-ea9aa70593e1 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:14.295880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79f667-d59d-40cb-93af-ea9aa70593e1 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:14.310113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2432c7-a557-4a21-a1d6-cefe6187bf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:14.311138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2432c7-a557-4a21-a1d6-cefe6187bf03 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:14.312437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2432c7-a557-4a21-a1d6-cefe6187bf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:14.312915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2432c7-a557-4a21-a1d6-cefe6187bf03 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:14.317527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2432c7-a557-4a21-a1d6-cefe6187bf03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:14.319608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2432c7-a557-4a21-a1d6-cefe6187bf03 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:14.348879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 878/1747] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:14.352052 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e804ae-2cf5-4466-9c80-fed217509d04 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:14.363782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e804ae-2cf5-4466-9c80-fed217509d04 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:14.386846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a09d01-e248-4580-a607-4ae09408e688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:14.387938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a09d01-e248-4580-a607-4ae09408e688 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:14.390612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a09d01-e248-4580-a607-4ae09408e688 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:14.391163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a09d01-e248-4580-a607-4ae09408e688 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:14.392228 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a09d01-e248-4580-a607-4ae09408e688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:14.400775 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a09d01-e248-4580-a607-4ae09408e688 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:14.449780 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2432c7-a557-4a21-a1d6-cefe6187bf03 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:14.450026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 870/1748] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:14.468225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2432c7-a557-4a21-a1d6-cefe6187bf03 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:14.486197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c226af7-8c5c-4194-a3f9-75b7c519d0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:14.488924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c226af7-8c5c-4194-a3f9-75b7c519d0d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:14.498969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c226af7-8c5c-4194-a3f9-75b7c519d0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:14.499299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c226af7-8c5c-4194-a3f9-75b7c519d0d9 admin admin] PATH_INFO: `/v3/projects/2503ed15de784654907a1e69e056c809/users/69b83dd027bf4b59b2c91efa989fa9f5/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:14.580494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c226af7-8c5c-4194-a3f9-75b7c519d0d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2503ed15de784654907a1e69e056c809, user_id=69b83dd027bf4b59b2c91efa989fa9f5, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:14.584926 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c226af7-8c5c-4194-a3f9-75b7c519d0d9 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:14.733559 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 879/1749] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:14 2022] PUT /identity/v3/projects/2503ed15de784654907a1e69e056c809/users/69b83dd027bf4b59b2c91efa989fa9f5/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:14.736718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066714cb-2645-4f51-ac0c-86fbb6138574 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:14.737905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066714cb-2645-4f51-ac0c-86fbb6138574 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:14.739085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066714cb-2645-4f51-ac0c-86fbb6138574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:14.808238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-066714cb-2645-4f51-ac0c-86fbb6138574 None None] MFA Rules not processed for user `69b83dd027bf4b59b2c91efa989fa9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:14.809783 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-066714cb-2645-4f51-ac0c-86fbb6138574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:15.000048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c226af7-8c5c-4194-a3f9-75b7c519d0d9 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:15.002278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 871/1750] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:15.224428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:15.271880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c226af7-8c5c-4194-a3f9-75b7c519d0d9 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:15.281042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a0ebc-df7a-45e5-85e1-29b8c0bcee6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:15.319125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a0ebc-df7a-45e5-85e1-29b8c0bcee6a admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:15.320064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a0ebc-df7a-45e5-85e1-29b8c0bcee6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:15.320355 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a0ebc-df7a-45e5-85e1-29b8c0bcee6a admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:15.321076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a0ebc-df7a-45e5-85e1-29b8c0bcee6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:15.340070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a0ebc-df7a-45e5-85e1-29b8c0bcee6a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:15.518026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 880/1751] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:14 2022] POST /identity/v3/projects => generated 355 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:15.525642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066714cb-2645-4f51-ac0c-86fbb6138574 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:15.550620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a0ebc-df7a-45e5-85e1-29b8c0bcee6a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:15.559874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066714cb-2645-4f51-ac0c-86fbb6138574 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:15.685668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:15.790419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e5600-05c3-4f95-8b3a-fd6482b83440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:15.791042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e5600-05c3-4f95-8b3a-fd6482b83440 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:15.791331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e5600-05c3-4f95-8b3a-fd6482b83440 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:15.791613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e5600-05c3-4f95-8b3a-fd6482b83440 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:15.793213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e5600-05c3-4f95-8b3a-fd6482b83440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:15.804786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a0ebc-df7a-45e5-85e1-29b8c0bcee6a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:15.806854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e5600-05c3-4f95-8b3a-fd6482b83440 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:15.841812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:15.846298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:15.846298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:15.846551 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] PATH_INFO: `/v3/users/50d06583c051478388794a169e0a4b92` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:15.854953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d06583c051478388794a169e0a4b92)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:15.874094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:15.946688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 872/1752] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:15 2022] POST /identity/v3/users => generated 284 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:15.946688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e5600-05c3-4f95-8b3a-fd6482b83440 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:15.958509 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6d3e5600-05c3-4f95-8b3a-fd6482b83440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:16.157158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d06583c051478388794a169e0a4b92'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:16.166944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e5600-05c3-4f95-8b3a-fd6482b83440 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:16.176638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199f9dc-922a-4630-bcd8-8e0b80f12a13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:16.180760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f9dc-922a-4630-bcd8-8e0b80f12a13 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:16.181621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f9dc-922a-4630-bcd8-8e0b80f12a13 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:16.182257 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f9dc-922a-4630-bcd8-8e0b80f12a13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:16.195686 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199f9dc-922a-4630-bcd8-8e0b80f12a13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:16.199419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199f9dc-922a-4630-bcd8-8e0b80f12a13 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:16.239556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 873/1753] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:16.241309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1013fc9-1532-4444-93cb-960204e85500 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:16.241682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1013fc9-1532-4444-93cb-960204e85500 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:16.242059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1013fc9-1532-4444-93cb-960204e85500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:16.271388 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d06583c051478388794a169e0a4b92'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:16.281208 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d06583c051478388794a169e0a4b92'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:16.283754 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d06583c051478388794a169e0a4b92'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:16.291105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d06583c051478388794a169e0a4b92'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:16.313110 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-f1013fc9-1532-4444-93cb-960204e85500 None None] MFA Rules not processed for user `16a77c08d2844e7cb81ac1370c527cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:16.320500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f1013fc9-1532-4444-93cb-960204e85500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:16.368308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 881/1754] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:15 2022] DELETE /identity/v3/users/50d06583c051478388794a169e0a4b92 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:16.374328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:16.385693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:16.532545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:16.572309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eef97-5792-448d-ae9e-d5fa6febfc70 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:16.572309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51920cd6-b09e-406a-af1b-9e2b03f43dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:16.576262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51920cd6-b09e-406a-af1b-9e2b03f43dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:16.584682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51920cd6-b09e-406a-af1b-9e2b03f43dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:16.586242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51920cd6-b09e-406a-af1b-9e2b03f43dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:16.588404 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 874/1755] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:16.589869 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b794-bc16-4989-8d4b-01ce453ffa7e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:16.590661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b794-bc16-4989-8d4b-01ce453ffa7e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:16.590986 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b794-bc16-4989-8d4b-01ce453ffa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:16.602637 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51920cd6-b09e-406a-af1b-9e2b03f43dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:16.607758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51920cd6-b09e-406a-af1b-9e2b03f43dd1 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:16.664410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 882/1756] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:16.665528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51920cd6-b09e-406a-af1b-9e2b03f43dd1 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:16.668767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7094b794-bc16-4989-8d4b-01ce453ffa7e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:16.670054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7094b794-bc16-4989-8d4b-01ce453ffa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:16.681975 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-51920cd6-b09e-406a-af1b-9e2b03f43dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:16.717161 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 875/1757] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:16.718251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094b794-bc16-4989-8d4b-01ce453ffa7e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:16.748919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094b794-bc16-4989-8d4b-01ce453ffa7e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:16.768728 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdff50-cd0f-4232-8477-e3274bcec75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:16.769738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdff50-cd0f-4232-8477-e3274bcec75c admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:16.770009 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdff50-cd0f-4232-8477-e3274bcec75c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:16.770290 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdff50-cd0f-4232-8477-e3274bcec75c admin admin] PATH_INFO: `/v3/projects/f55c2e4d235d489094779f04eb5a5f90/users/68b4a34152654dc5a0f5c735a19bade0/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:16.810320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdff50-cd0f-4232-8477-e3274bcec75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55c2e4d235d489094779f04eb5a5f90, user_id=68b4a34152654dc5a0f5c735a19bade0, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:16.827578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdff50-cd0f-4232-8477-e3274bcec75c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:16.869855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51920cd6-b09e-406a-af1b-9e2b03f43dd1 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:16.878685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912f785-a163-4bc5-a13a-cb2001365a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:16.880170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912f785-a163-4bc5-a13a-cb2001365a0c service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:16.880980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912f785-a163-4bc5-a13a-cb2001365a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:16.881503 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912f785-a163-4bc5-a13a-cb2001365a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:16.892296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912f785-a163-4bc5-a13a-cb2001365a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:16.894370 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912f785-a163-4bc5-a13a-cb2001365a0c service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:16.904484 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 883/1758] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:16.905983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912f785-a163-4bc5-a13a-cb2001365a0c service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:16.924072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912f785-a163-4bc5-a13a-cb2001365a0c service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:16.928853 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd528657-f14b-4a16-bf67-02fecd81b31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:16.929773 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528657-f14b-4a16-bf67-02fecd81b31e service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:16.930270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528657-f14b-4a16-bf67-02fecd81b31e service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:16.930797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528657-f14b-4a16-bf67-02fecd81b31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:16.944688 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd528657-f14b-4a16-bf67-02fecd81b31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:16.957154 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd528657-f14b-4a16-bf67-02fecd81b31e service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:16.974597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 884/1759] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:16.980762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 876/1760] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:16 2022] PUT /identity/v3/projects/f55c2e4d235d489094779f04eb5a5f90/users/68b4a34152654dc5a0f5c735a19bade0/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:16.985459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd528657-f14b-4a16-bf67-02fecd81b31e service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:16.999576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd528657-f14b-4a16-bf67-02fecd81b31e service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:17.136482 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf278f-969e-4466-88f9-a18f8a807e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:17.138886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf278f-969e-4466-88f9-a18f8a807e50 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:17.139636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf278f-969e-4466-88f9-a18f8a807e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:17.140399 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf278f-969e-4466-88f9-a18f8a807e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:17.143218 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf278f-969e-4466-88f9-a18f8a807e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:17.145418 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf278f-969e-4466-88f9-a18f8a807e50 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:17.183397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 885/1761] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:17.186304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdff50-cd0f-4232-8477-e3274bcec75c admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:17.205368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdff50-cd0f-4232-8477-e3274bcec75c admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:17.217856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289213a-d40c-47ce-9af2-186c221f071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:17.219941 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289213a-d40c-47ce-9af2-186c221f071d admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:17.220468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289213a-d40c-47ce-9af2-186c221f071d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:17.221032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289213a-d40c-47ce-9af2-186c221f071d admin admin] PATH_INFO: `/v3/projects/f55c2e4d235d489094779f04eb5a5f90/users/68b4a34152654dc5a0f5c735a19bade0/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:17.227861 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289213a-d40c-47ce-9af2-186c221f071d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55c2e4d235d489094779f04eb5a5f90, user_id=68b4a34152654dc5a0f5c735a19bade0, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:17.237610 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289213a-d40c-47ce-9af2-186c221f071d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:17.291661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 877/1762] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:17 2022] PUT /identity/v3/projects/f55c2e4d235d489094779f04eb5a5f90/users/68b4a34152654dc5a0f5c735a19bade0/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:17.314726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ab88f-f090-46c9-b5db-9c87242c16f5 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:17.315336 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ab88f-f090-46c9-b5db-9c87242c16f5 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:17.315568 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ab88f-f090-46c9-b5db-9c87242c16f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:17.377126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-294ab88f-f090-46c9-b5db-9c87242c16f5 None None] MFA Rules not processed for user `68b4a34152654dc5a0f5c735a19bade0`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:17.382318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-294ab88f-f090-46c9-b5db-9c87242c16f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:17.418440 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05430369-7250-472e-ac09-a78901e3cbab None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:17.418865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05430369-7250-472e-ac09-a78901e3cbab None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:17.419254 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05430369-7250-472e-ac09-a78901e3cbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:17.469219 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-05430369-7250-472e-ac09-a78901e3cbab None None] MFA Rules not processed for user `0567620b615f4a8ab2bc5c69ba85cc93`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:17.479600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-05430369-7250-472e-ac09-a78901e3cbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:17.535927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:17.657867 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 886/1763] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:17.684815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ab88f-f090-46c9-b5db-9c87242c16f5 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:17.684815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-294ab88f-f090-46c9-b5db-9c87242c16f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:17.685334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 878/1764] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:17.891267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ab88f-f090-46c9-b5db-9c87242c16f5 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:17.900771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c2e31-0210-4b6b-bedf-8e2c4db18753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:17.905067 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c2e31-0210-4b6b-bedf-8e2c4db18753 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:17.905067 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c2e31-0210-4b6b-bedf-8e2c4db18753 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:17.905067 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c2e31-0210-4b6b-bedf-8e2c4db18753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:17.930701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c2e31-0210-4b6b-bedf-8e2c4db18753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:17.932250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c2e31-0210-4b6b-bedf-8e2c4db18753 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:17.956645 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 887/1765] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:17 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:00:18.320174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05430369-7250-472e-ac09-a78901e3cbab None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:18.337825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05430369-7250-472e-ac09-a78901e3cbab None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:18.349969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a62b35-7934-446a-849c-5974f4445a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:18.351314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a62b35-7934-446a-849c-5974f4445a64 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:18.357472 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a62b35-7934-446a-849c-5974f4445a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:18.358125 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a62b35-7934-446a-849c-5974f4445a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:18.360774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-05a62b35-7934-446a-849c-5974f4445a64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:18.371741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:18.379907 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c2e31-0210-4b6b-bedf-8e2c4db18753 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:18.381419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-183c2e31-0210-4b6b-bedf-8e2c4db18753 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:18.550364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a62b35-7934-446a-849c-5974f4445a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:18.556479 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c2e31-0210-4b6b-bedf-8e2c4db18753 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:18.561970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:18.563585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:18.564094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:18.564691 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] PATH_INFO: `/v3/projects/92c02cb6d5c14035b7ea0c821875276b` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:18.566785 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c02cb6d5c14035b7ea0c821875276b)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:18.569313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:18.580200 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a62b35-7934-446a-849c-5974f4445a64 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:18.631675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 879/1766] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:18 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:18.822442 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c02cb6d5c14035b7ea0c821875276b', 'request_id': 'req-845798a4-542a-406b-ac94-3aee3c9422ae'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:18.934232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c02cb6d5c14035b7ea0c821875276b', 'request_id': 'req-845798a4-542a-406b-ac94-3aee3c9422ae'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:18.979790 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c02cb6d5c14035b7ea0c821875276b', 'request_id': 'req-845798a4-542a-406b-ac94-3aee3c9422ae'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:19.024462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] The token cache is being invalidate because project 92c02cb6d5c14035b7ea0c821875276b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:19.026074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:19.027069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:19.032539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 888/1767] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:18 2022] DELETE /identity/v3/projects/92c02cb6d5c14035b7ea0c821875276b => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:19.034236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a62b35-7934-446a-849c-5974f4445a64 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:19.057548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a62b35-7934-446a-849c-5974f4445a64 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:19.266228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:19.272668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:19.284837 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b53b3-e96f-4787-bc5b-6a0230a70c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:19.286901 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b53b3-e96f-4787-bc5b-6a0230a70c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:19.287334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b53b3-e96f-4787-bc5b-6a0230a70c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:19.287627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b53b3-e96f-4787-bc5b-6a0230a70c6d admin admin] PATH_INFO: `/v3/users/c6779495a7ec42d0b20bfe69eef22388` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:19.289368 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b53b3-e96f-4787-bc5b-6a0230a70c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6779495a7ec42d0b20bfe69eef22388)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:19.291690 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b53b3-e96f-4787-bc5b-6a0230a70c6d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:19.360688 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:19.419620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845798a4-542a-406b-ac94-3aee3c9422ae admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:19.430080 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:19.431093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:19.431379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:19.434808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] PATH_INFO: `/v3/users/a4a6f10d52604be388018801a6f36740` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:19.435671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a6f10d52604be388018801a6f36740)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:19.439792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:19.543653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-811b53b3-e96f-4787-bc5b-6a0230a70c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6779495a7ec42d0b20bfe69eef22388'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:19.630870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-811b53b3-e96f-4787-bc5b-6a0230a70c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6779495a7ec42d0b20bfe69eef22388'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:19.632389 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-811b53b3-e96f-4787-bc5b-6a0230a70c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6779495a7ec42d0b20bfe69eef22388'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:19.644650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:19.648163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-811b53b3-e96f-4787-bc5b-6a0230a70c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6779495a7ec42d0b20bfe69eef22388'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:19.649024 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-811b53b3-e96f-4787-bc5b-6a0230a70c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6779495a7ec42d0b20bfe69eef22388'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:19.708674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 880/1768] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:19 2022] DELETE /identity/v3/users/c6779495a7ec42d0b20bfe69eef22388 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:19.763340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a6f10d52604be388018801a6f36740'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:19.891331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a6f10d52604be388018801a6f36740'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:19.902450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a6f10d52604be388018801a6f36740'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:19.904690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a6f10d52604be388018801a6f36740'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:19.906775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a6f10d52604be388018801a6f36740'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:19.976343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 889/1769] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:19 2022] DELETE /identity/v3/users/a4a6f10d52604be388018801a6f36740 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:19.980862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087f96-3363-4c31-9282-647c8d10f0d8 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:19.981157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087f96-3363-4c31-9282-647c8d10f0d8 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:19.981493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087f96-3363-4c31-9282-647c8d10f0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:20.008096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-22087f96-3363-4c31-9282-647c8d10f0d8 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:20.008096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-22087f96-3363-4c31-9282-647c8d10f0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:20.105290 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 881/1770] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:20.119810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:20.121529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:20.134041 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910e986-c122-4313-9f83-721620c25096 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:20.134395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910e986-c122-4313-9f83-721620c25096 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:20.134682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910e986-c122-4313-9f83-721620c25096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:20.182914 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-8910e986-c122-4313-9f83-721620c25096 None None] MFA Rules not processed for user `c9b5be694ffc4b329af316dc2b23fd18`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:20.184847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8910e986-c122-4313-9f83-721620c25096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:20.258726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c71e0e-401e-4b92-b1ee-deb190935f03 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:20.296334 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6c7ad-fb7a-441c-9666-9e612634d11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:20.297139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6c7ad-fb7a-441c-9666-9e612634d11a service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:20.322369 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6c7ad-fb7a-441c-9666-9e612634d11a service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:20.322465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6c7ad-fb7a-441c-9666-9e612634d11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:20.366043 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6c7ad-fb7a-441c-9666-9e612634d11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:20.366043 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6c7ad-fb7a-441c-9666-9e612634d11a service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:20.375034 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 882/1771] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:20.403998 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 890/1772] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:20.718573 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910e986-c122-4313-9f83-721620c25096 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:20.720209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8910e986-c122-4313-9f83-721620c25096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:20.759637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910e986-c122-4313-9f83-721620c25096 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:20.772903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e02d55-bb86-46aa-8385-776fcdcd88d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:20.773811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02d55-bb86-46aa-8385-776fcdcd88d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:20.774090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02d55-bb86-46aa-8385-776fcdcd88d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:20.774937 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02d55-bb86-46aa-8385-776fcdcd88d3 admin admin] PATH_INFO: `/v3/projects/4d669dd250824629a7c30c207034935e` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:20.778239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e02d55-bb86-46aa-8385-776fcdcd88d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d669dd250824629a7c30c207034935e)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:20.780370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e02d55-bb86-46aa-8385-776fcdcd88d3 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:20.953248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b5e02d55-bb86-46aa-8385-776fcdcd88d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d669dd250824629a7c30c207034935e', 'request_id': 'req-b5e02d55-bb86-46aa-8385-776fcdcd88d3'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:21.088611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b5e02d55-bb86-46aa-8385-776fcdcd88d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d669dd250824629a7c30c207034935e', 'request_id': 'req-b5e02d55-bb86-46aa-8385-776fcdcd88d3'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:21.095106 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b5e02d55-bb86-46aa-8385-776fcdcd88d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d669dd250824629a7c30c207034935e', 'request_id': 'req-b5e02d55-bb86-46aa-8385-776fcdcd88d3'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:21.111713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b5e02d55-bb86-46aa-8385-776fcdcd88d3 admin admin] The token cache is being invalidate because project 4d669dd250824629a7c30c207034935e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:21.113359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b5e02d55-bb86-46aa-8385-776fcdcd88d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:21.114362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b5e02d55-bb86-46aa-8385-776fcdcd88d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:21.116703 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 883/1773] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:20 2022] DELETE /identity/v3/projects/4d669dd250824629a7c30c207034935e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:21.121934 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bdee8-582f-43b8-b79f-e82e79ad77af None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:21.122469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bdee8-582f-43b8-b79f-e82e79ad77af None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:21.122469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bdee8-582f-43b8-b79f-e82e79ad77af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:21.159996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-061bdee8-582f-43b8-b79f-e82e79ad77af None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:21.163894 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-061bdee8-582f-43b8-b79f-e82e79ad77af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:21.299788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 891/1774] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:21.302903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc750e-664c-43e9-991c-4155f091e4ee None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:21.303532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc750e-664c-43e9-991c-4155f091e4ee None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:21.303978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc750e-664c-43e9-991c-4155f091e4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:21.334427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-58bc750e-664c-43e9-991c-4155f091e4ee None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:21.336074 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-58bc750e-664c-43e9-991c-4155f091e4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:21.352285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bdee8-582f-43b8-b79f-e82e79ad77af None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:21.360469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 884/1775] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:21.365438 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bdee8-582f-43b8-b79f-e82e79ad77af None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:21.382956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac5de8-1827-4932-8ca2-ce704c242698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:21.383914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac5de8-1827-4932-8ca2-ce704c242698 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:21.384205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac5de8-1827-4932-8ca2-ce704c242698 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:21.384685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac5de8-1827-4932-8ca2-ce704c242698 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:21.385636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac5de8-1827-4932-8ca2-ce704c242698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:00:21.386353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac5de8-1827-4932-8ca2-ce704c242698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:21.389218 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac5de8-1827-4932-8ca2-ce704c242698 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:21.409526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 892/1776] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:00:21.410989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc750e-664c-43e9-991c-4155f091e4ee None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:21.424931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc750e-664c-43e9-991c-4155f091e4ee None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:21.430640 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ec520-cb75-4a27-afb7-7feb1e6ae93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:21.431510 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec520-cb75-4a27-afb7-7feb1e6ae93a admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:21.431605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec520-cb75-4a27-afb7-7feb1e6ae93a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:21.431842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec520-cb75-4a27-afb7-7feb1e6ae93a admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:21.432854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ec520-cb75-4a27-afb7-7feb1e6ae93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:21.435733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ec520-cb75-4a27-afb7-7feb1e6ae93a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:21.510005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac5de8-1827-4932-8ca2-ce704c242698 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:21.512287 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7aac5de8-1827-4932-8ca2-ce704c242698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:21.535200 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 885/1777] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:21 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:21.536845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac5de8-1827-4932-8ca2-ce704c242698 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:21.538321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ec520-cb75-4a27-afb7-7feb1e6ae93a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:21.653725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ec520-cb75-4a27-afb7-7feb1e6ae93a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:21.659590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138c7ad-0327-43fa-9952-6bf6e0538899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:21.660791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138c7ad-0327-43fa-9952-6bf6e0538899 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:21.661285 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138c7ad-0327-43fa-9952-6bf6e0538899 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:21.661967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138c7ad-0327-43fa-9952-6bf6e0538899 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:21.662892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138c7ad-0327-43fa-9952-6bf6e0538899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:21.665076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138c7ad-0327-43fa-9952-6bf6e0538899 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:21.671322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:21.673557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:21.673851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:21.674137 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] PATH_INFO: `/v3/projects/34d6c7b6bbad43e78d69a1070004a82f` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:21.686115 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d6c7b6bbad43e78d69a1070004a82f)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:21.696483 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:21.797160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 886/1778] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:21 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:21.798793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ad04f-0019-400d-be06-57ba5c0cab96 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:21.799198 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ad04f-0019-400d-be06-57ba5c0cab96 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:21.799620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ad04f-0019-400d-be06-57ba5c0cab96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:21.834981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d82ad04f-0019-400d-be06-57ba5c0cab96 None None] MFA Rules not processed for user `e0d9dcb062ad4376866a98edebede7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:21.836971 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d82ad04f-0019-400d-be06-57ba5c0cab96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:21.915429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:21.915539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 887/1779] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:21.915539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ad04f-0019-400d-be06-57ba5c0cab96 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:21.941945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ad04f-0019-400d-be06-57ba5c0cab96 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:21.950858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9f64a-d798-4c97-bcf1-6cb008027650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:21.952113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9f64a-d798-4c97-bcf1-6cb008027650 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:21.952608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9f64a-d798-4c97-bcf1-6cb008027650 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:21.952953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9f64a-d798-4c97-bcf1-6cb008027650 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:21.953875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9f64a-d798-4c97-bcf1-6cb008027650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:21.956104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9f64a-d798-4c97-bcf1-6cb008027650 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:21.978152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 888/1780] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:21.982000 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9f64a-d798-4c97-bcf1-6cb008027650 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:21.996822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9f64a-d798-4c97-bcf1-6cb008027650 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:22.004848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81658946-8775-476a-a505-7eb148cdd69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:22.005593 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81658946-8775-476a-a505-7eb148cdd69c admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:22.005879 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81658946-8775-476a-a505-7eb148cdd69c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:22.006705 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81658946-8775-476a-a505-7eb148cdd69c admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:22.007468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81658946-8775-476a-a505-7eb148cdd69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:22.009080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81658946-8775-476a-a505-7eb148cdd69c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:22.027122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 889/1781] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:22.031030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81658946-8775-476a-a505-7eb148cdd69c admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:22.043248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81658946-8775-476a-a505-7eb148cdd69c admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:22.048591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40cfbc-1afa-48b1-b18c-b633bf724412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:22.050284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40cfbc-1afa-48b1-b18c-b633bf724412 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:22.050639 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40cfbc-1afa-48b1-b18c-b633bf724412 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:22.051007 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40cfbc-1afa-48b1-b18c-b633bf724412 admin admin] PATH_INFO: `/v3/projects/7845caaf5f574fde844b8f7104008357/users/bdc89a851b2540019aea1c4e05d271cd/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:22.075307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40cfbc-1afa-48b1-b18c-b633bf724412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7845caaf5f574fde844b8f7104008357, user_id=bdc89a851b2540019aea1c4e05d271cd, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:22.078158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40cfbc-1afa-48b1-b18c-b633bf724412 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:22.902383 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:22.905095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 890/1782] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:22 2022] PUT /identity/v3/projects/7845caaf5f574fde844b8f7104008357/users/bdc89a851b2540019aea1c4e05d271cd/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:22.908235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f3169-9b5b-44ba-89f0-91658d3778e9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:22.908534 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f3169-9b5b-44ba-89f0-91658d3778e9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:22.911931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f3169-9b5b-44ba-89f0-91658d3778e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:22.929267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d6c7b6bbad43e78d69a1070004a82f', 'request_id': 'req-d9845ca3-5810-4100-911f-3640fd8bbc46'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:22.967346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a72f3169-9b5b-44ba-89f0-91658d3778e9 None None] MFA Rules not processed for user `bdc89a851b2540019aea1c4e05d271cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:22.970332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a72f3169-9b5b-44ba-89f0-91658d3778e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:23.043310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d6c7b6bbad43e78d69a1070004a82f', 'request_id': 'req-d9845ca3-5810-4100-911f-3640fd8bbc46'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:23.058642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d6c7b6bbad43e78d69a1070004a82f', 'request_id': 'req-d9845ca3-5810-4100-911f-3640fd8bbc46'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:23.098800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] The token cache is being invalidate because project 34d6c7b6bbad43e78d69a1070004a82f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:23.102966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:23.104107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:23.108909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 893/1783] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:21 2022] DELETE /identity/v3/projects/34d6c7b6bbad43e78d69a1070004a82f => generated 0 bytes in 1600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:23.112843 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:23.114707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:23.129922 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 891/1784] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:23.135184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f3169-9b5b-44ba-89f0-91658d3778e9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:23.261704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9845ca3-5810-4100-911f-3640fd8bbc46 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:23.280679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:23.281731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:23.282020 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:23.282301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] PATH_INFO: `/v3/users/7fcd83c128e74896a98997ebf3628ec4` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:23.284643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fcd83c128e74896a98997ebf3628ec4)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:23.287973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:23.378604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f3169-9b5b-44ba-89f0-91658d3778e9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:23.407599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46095fc6-2e74-4e9d-a258-2c2d3618718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:23.408342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46095fc6-2e74-4e9d-a258-2c2d3618718f admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:23.408655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46095fc6-2e74-4e9d-a258-2c2d3618718f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:23.408946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46095fc6-2e74-4e9d-a258-2c2d3618718f admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:23.420143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46095fc6-2e74-4e9d-a258-2c2d3618718f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:23.422323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46095fc6-2e74-4e9d-a258-2c2d3618718f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:23.653784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 892/1785] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:23 2022] POST /identity/v3/projects => generated 387 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:23.659698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46095fc6-2e74-4e9d-a258-2c2d3618718f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:23.661888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-46095fc6-2e74-4e9d-a258-2c2d3618718f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:23.672759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fcd83c128e74896a98997ebf3628ec4'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:23.774569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fcd83c128e74896a98997ebf3628ec4'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:23.787332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fcd83c128e74896a98997ebf3628ec4'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:23.788164 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fcd83c128e74896a98997ebf3628ec4'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:23.789243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fcd83c128e74896a98997ebf3628ec4'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:23.851578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 894/1786] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:23 2022] DELETE /identity/v3/users/7fcd83c128e74896a98997ebf3628ec4 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:23.858955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46095fc6-2e74-4e9d-a258-2c2d3618718f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:23.965451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf628b2-0be2-4a59-a39d-413659f91e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:23.966189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf628b2-0be2-4a59-a39d-413659f91e4b admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:23.966578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf628b2-0be2-4a59-a39d-413659f91e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:23.967020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf628b2-0be2-4a59-a39d-413659f91e4b admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:23.967935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf628b2-0be2-4a59-a39d-413659f91e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:23.971075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf628b2-0be2-4a59-a39d-413659f91e4b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:24.097469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 893/1787] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:23 2022] POST /identity/v3/users => generated 300 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:24.101044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:24.102870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:24.130303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d58ff-b29c-4b9b-87a1-c98bdcb8d5a4 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:24.141331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dd6fc-b1a1-4b57-8e76-2df5fdc139d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:24.142524 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dd6fc-b1a1-4b57-8e76-2df5fdc139d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:24.143735 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dd6fc-b1a1-4b57-8e76-2df5fdc139d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:24.146398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dd6fc-b1a1-4b57-8e76-2df5fdc139d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:24.147823 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dd6fc-b1a1-4b57-8e76-2df5fdc139d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:24.150685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dd6fc-b1a1-4b57-8e76-2df5fdc139d2 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:24.170513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 895/1788] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:24.175120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf628b2-0be2-4a59-a39d-413659f91e4b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:24.195033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf628b2-0be2-4a59-a39d-413659f91e4b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:24.202210 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb6afc-a495-446f-a362-47ab8a5731cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:24.204468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb6afc-a495-446f-a362-47ab8a5731cb admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:24.204760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb6afc-a495-446f-a362-47ab8a5731cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:24.205033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb6afc-a495-446f-a362-47ab8a5731cb admin admin] PATH_INFO: `/v3/projects/78d92e6ed62d497687cb8c5a14a6dccf/users/46dd8e8c24c84b6a99d5e88f3a8a184c/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:24.244373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb6afc-a495-446f-a362-47ab8a5731cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d92e6ed62d497687cb8c5a14a6dccf, user_id=46dd8e8c24c84b6a99d5e88f3a8a184c, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:24.248014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb6afc-a495-446f-a362-47ab8a5731cb admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:24.332971 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 894/1789] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:24 2022] PUT /identity/v3/projects/78d92e6ed62d497687cb8c5a14a6dccf/users/46dd8e8c24c84b6a99d5e88f3a8a184c/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:24.337522 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dd6fc-b1a1-4b57-8e76-2df5fdc139d2 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:24.352206 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dd6fc-b1a1-4b57-8e76-2df5fdc139d2 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:24.448367 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc4928-22c7-4d41-a476-28ff420a3881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:24.449493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc4928-22c7-4d41-a476-28ff420a3881 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:24.449731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc4928-22c7-4d41-a476-28ff420a3881 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:24.450495 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc4928-22c7-4d41-a476-28ff420a3881 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:24.451340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc4928-22c7-4d41-a476-28ff420a3881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:24.454065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc4928-22c7-4d41-a476-28ff420a3881 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:24.470426 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 896/1790] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:24.475174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb6afc-a495-446f-a362-47ab8a5731cb admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:24.496193 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb6afc-a495-446f-a362-47ab8a5731cb admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:24.513091 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70c07f-9458-4c19-ae70-9d4e05835c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:24.513854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70c07f-9458-4c19-ae70-9d4e05835c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:24.514139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70c07f-9458-4c19-ae70-9d4e05835c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:24.514414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70c07f-9458-4c19-ae70-9d4e05835c8b admin admin] PATH_INFO: `/v3/projects/78d92e6ed62d497687cb8c5a14a6dccf/users/46dd8e8c24c84b6a99d5e88f3a8a184c/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:24.521342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70c07f-9458-4c19-ae70-9d4e05835c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d92e6ed62d497687cb8c5a14a6dccf, user_id=46dd8e8c24c84b6a99d5e88f3a8a184c, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:24.524027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70c07f-9458-4c19-ae70-9d4e05835c8b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:24.555003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 895/1791] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:24 2022] PUT /identity/v3/projects/78d92e6ed62d497687cb8c5a14a6dccf/users/46dd8e8c24c84b6a99d5e88f3a8a184c/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:24.571174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba71c3-1011-434b-8260-bb28b5a6b7f1 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:24.571174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba71c3-1011-434b-8260-bb28b5a6b7f1 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:24.571455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba71c3-1011-434b-8260-bb28b5a6b7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:24.615791 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6cba71c3-1011-434b-8260-bb28b5a6b7f1 None None] MFA Rules not processed for user `46dd8e8c24c84b6a99d5e88f3a8a184c`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:24.617250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6cba71c3-1011-434b-8260-bb28b5a6b7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:24.720803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 897/1792] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:24.740790 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70c07f-9458-4c19-ae70-9d4e05835c8b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:24.742578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-af70c07f-9458-4c19-ae70-9d4e05835c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:24.879432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70c07f-9458-4c19-ae70-9d4e05835c8b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:24.887896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34355e6-1553-4f75-8c4b-61f518dff9c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:24.890735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34355e6-1553-4f75-8c4b-61f518dff9c2 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:24.890735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34355e6-1553-4f75-8c4b-61f518dff9c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:24.890735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34355e6-1553-4f75-8c4b-61f518dff9c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:24.900229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34355e6-1553-4f75-8c4b-61f518dff9c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:24.901920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34355e6-1553-4f75-8c4b-61f518dff9c2 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:24.912901 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 896/1793] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:24.985935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba71c3-1011-434b-8260-bb28b5a6b7f1 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:24.993197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34355e6-1553-4f75-8c4b-61f518dff9c2 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:24.994661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b34355e6-1553-4f75-8c4b-61f518dff9c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:25.083038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34355e6-1553-4f75-8c4b-61f518dff9c2 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:25.083848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba71c3-1011-434b-8260-bb28b5a6b7f1 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:25.088617 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:25.088751 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484fd2c-2a7b-4ffd-ad17-4a3a122466a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:25.089532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484fd2c-2a7b-4ffd-ad17-4a3a122466a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:25.089816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484fd2c-2a7b-4ffd-ad17-4a3a122466a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:25.090090 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484fd2c-2a7b-4ffd-ad17-4a3a122466a0 admin admin] PATH_INFO: `/v3/users/bdc89a851b2540019aea1c4e05d271cd` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:25.090442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:25.090932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:25.091307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484fd2c-2a7b-4ffd-ad17-4a3a122466a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc89a851b2540019aea1c4e05d271cd)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:25.091573 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] PATH_INFO: `/v3/projects/c38233e504a640a3bccbf7e9d3d86e44` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:25.093122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38233e504a640a3bccbf7e9d3d86e44)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:25.093229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484fd2c-2a7b-4ffd-ad17-4a3a122466a0 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:25.097979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:25.271902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:25.358167 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5484fd2c-2a7b-4ffd-ad17-4a3a122466a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc89a851b2540019aea1c4e05d271cd'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:25.404134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38233e504a640a3bccbf7e9d3d86e44', 'request_id': 'req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:25.468511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:25.495184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5484fd2c-2a7b-4ffd-ad17-4a3a122466a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc89a851b2540019aea1c4e05d271cd'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:25.505920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5484fd2c-2a7b-4ffd-ad17-4a3a122466a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc89a851b2540019aea1c4e05d271cd'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:25.508556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5484fd2c-2a7b-4ffd-ad17-4a3a122466a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc89a851b2540019aea1c4e05d271cd'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:25.511607 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5484fd2c-2a7b-4ffd-ad17-4a3a122466a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc89a851b2540019aea1c4e05d271cd'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:25.575907 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 898/1794] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:24 2022] DELETE /identity/v3/users/bdc89a851b2540019aea1c4e05d271cd => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:25.580487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa9775-f5d4-4dfb-892c-6fe6693f5abc None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:25.581146 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa9775-f5d4-4dfb-892c-6fe6693f5abc None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:25.583904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa9775-f5d4-4dfb-892c-6fe6693f5abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:25.604987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38233e504a640a3bccbf7e9d3d86e44', 'request_id': 'req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:25.613839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38233e504a640a3bccbf7e9d3d86e44', 'request_id': 'req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:25.615831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-39fa9775-f5d4-4dfb-892c-6fe6693f5abc None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:25.618364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-39fa9775-f5d4-4dfb-892c-6fe6693f5abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:25.684361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] The token cache is being invalidate because project c38233e504a640a3bccbf7e9d3d86e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:25.685173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:25.691775 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:25.698188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 897/1795] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:24 2022] DELETE /identity/v3/projects/c38233e504a640a3bccbf7e9d3d86e44 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:25.708678 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:25.722146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:25.864696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 899/1796] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:25.912461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa9775-f5d4-4dfb-892c-6fe6693f5abc None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:25.914008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-39fa9775-f5d4-4dfb-892c-6fe6693f5abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:25.920624 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee84ab-8efc-4988-b5b2-41ff0cf8a41a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:25.936010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:25.937238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:25.937859 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:25.938418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] PATH_INFO: `/v3/users/21bb97ead8ca45c59dad85d630f2c983` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:25.942273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21bb97ead8ca45c59dad85d630f2c983)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:25.945048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:26.029500 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa9775-f5d4-4dfb-892c-6fe6693f5abc None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:26.041170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab820206-6571-4dce-b295-b11a8f22c615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:26.041875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab820206-6571-4dce-b295-b11a8f22c615 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:26.042151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab820206-6571-4dce-b295-b11a8f22c615 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:26.042421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab820206-6571-4dce-b295-b11a8f22c615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:26.059695 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab820206-6571-4dce-b295-b11a8f22c615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:26.061686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab820206-6571-4dce-b295-b11a8f22c615 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:26.080501 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 900/1797] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:00:26.188603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21bb97ead8ca45c59dad85d630f2c983'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:26.195603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2a4b9-ffde-408d-9063-5e2a8c2ca392 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:26.196065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2a4b9-ffde-408d-9063-5e2a8c2ca392 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:26.196482 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2a4b9-ffde-408d-9063-5e2a8c2ca392 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:26.198267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 901/1798] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 21:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:00:26.263296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c0af1-c879-4a2b-9107-0b276eb2ced3 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:26.264038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c0af1-c879-4a2b-9107-0b276eb2ced3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:26.264038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c0af1-c879-4a2b-9107-0b276eb2ced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:26.295720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-886c0af1-c879-4a2b-9107-0b276eb2ced3 None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:26.297224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-886c0af1-c879-4a2b-9107-0b276eb2ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:26.302254 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21bb97ead8ca45c59dad85d630f2c983'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:26.303152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21bb97ead8ca45c59dad85d630f2c983'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:26.318168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21bb97ead8ca45c59dad85d630f2c983'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:26.319202 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21bb97ead8ca45c59dad85d630f2c983'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:26.392389 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 898/1799] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:25 2022] DELETE /identity/v3/users/21bb97ead8ca45c59dad85d630f2c983 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:26.479032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 902/1800] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 21:00:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:26.491768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:26.493673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:26.644825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fb157-708c-45b9-a9fa-a071ceb08748 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:26.655882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd897d-3bdd-4a9e-972f-798afc2616b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:26.657047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd897d-3bdd-4a9e-972f-798afc2616b0 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:26.657572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd897d-3bdd-4a9e-972f-798afc2616b0 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:26.658080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd897d-3bdd-4a9e-972f-798afc2616b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:26.671059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd897d-3bdd-4a9e-972f-798afc2616b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:26.673170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd897d-3bdd-4a9e-972f-798afc2616b0 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:26.686554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 899/1801] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:27.250844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:27.817001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:27.991906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c0af1-c879-4a2b-9107-0b276eb2ced3 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:27.993704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-886c0af1-c879-4a2b-9107-0b276eb2ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:28.015324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c0af1-c879-4a2b-9107-0b276eb2ced3 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:28.049286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd897d-3bdd-4a9e-972f-798afc2616b0 service nova] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:28.050972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b1dd897d-3bdd-4a9e-972f-798afc2616b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:28.166902 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd897d-3bdd-4a9e-972f-798afc2616b0 service nova] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:28.171736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:28.172817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:28.173255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:28.173703 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5 admin admin] PATH_INFO: `/v3/projects/7845caaf5f574fde844b8f7104008357` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:28.175182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7845caaf5f574fde844b8f7104008357)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:28.177341 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:28.190599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86f286-2e98-46b8-abf5-e5c7504675ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:28.191480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86f286-2e98-46b8-abf5-e5c7504675ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:28.191760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86f286-2e98-46b8-abf5-e5c7504675ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:28.192036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86f286-2e98-46b8-abf5-e5c7504675ca admin admin] PATH_INFO: `/v3/projects/bd66d8ba8e1f4ad7898b812c165e2eff` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:28.196106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86f286-2e98-46b8-abf5-e5c7504675ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd66d8ba8e1f4ad7898b812c165e2eff)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:28.198304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86f286-2e98-46b8-abf5-e5c7504675ca admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:28.295899 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7845caaf5f574fde844b8f7104008357', 'request_id': 'req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:28.350464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-ff86f286-2e98-46b8-abf5-e5c7504675ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd66d8ba8e1f4ad7898b812c165e2eff', 'request_id': 'req-ff86f286-2e98-46b8-abf5-e5c7504675ca'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:28.420655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7845caaf5f574fde844b8f7104008357', 'request_id': 'req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:28.437370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7845caaf5f574fde844b8f7104008357', 'request_id': 'req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:28.482831 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5 admin admin] The token cache is being invalidate because project 7845caaf5f574fde844b8f7104008357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:28.483441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:28.485504 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3aa60b02-402e-4c7f-bf6c-9d8f611377f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:28.488916 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 900/1802] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:28 2022] DELETE /identity/v3/projects/7845caaf5f574fde844b8f7104008357 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:28.490677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872c35b-ba97-4088-ad3c-f6a6acf5ed4d None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:28.493411 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872c35b-ba97-4088-ad3c-f6a6acf5ed4d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:28.493959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872c35b-ba97-4088-ad3c-f6a6acf5ed4d None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:28.496866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 901/1803] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 21:00:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:00:28.498302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872c35b-ba97-4088-ad3c-f6a6acf5ed4d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:28.503921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-ff86f286-2e98-46b8-abf5-e5c7504675ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd66d8ba8e1f4ad7898b812c165e2eff', 'request_id': 'req-ff86f286-2e98-46b8-abf5-e5c7504675ca'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:28.513779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a872c35b-ba97-4088-ad3c-f6a6acf5ed4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:28.514226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-ff86f286-2e98-46b8-abf5-e5c7504675ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd66d8ba8e1f4ad7898b812c165e2eff', 'request_id': 'req-ff86f286-2e98-46b8-abf5-e5c7504675ca'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:28.537149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-ff86f286-2e98-46b8-abf5-e5c7504675ca admin admin] The token cache is being invalidate because project bd66d8ba8e1f4ad7898b812c165e2eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:28.537726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-ff86f286-2e98-46b8-abf5-e5c7504675ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:28.542201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-ff86f286-2e98-46b8-abf5-e5c7504675ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:28.542201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 903/1804] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:27 2022] DELETE /identity/v3/projects/bd66d8ba8e1f4ad7898b812c165e2eff => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:28.543152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c4c3d-b74f-4cb7-b835-3ef9a80b1339 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:28.543739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c4c3d-b74f-4cb7-b835-3ef9a80b1339 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:28.544212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c4c3d-b74f-4cb7-b835-3ef9a80b1339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:28.594289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4e1c4c3d-b74f-4cb7-b835-3ef9a80b1339 None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:28.596843 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4e1c4c3d-b74f-4cb7-b835-3ef9a80b1339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:28.602738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:28.657159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872c35b-ba97-4088-ad3c-f6a6acf5ed4d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:28.670462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50881fdb-b77b-4704-b234-f8d4d710eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:28.673238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50881fdb-b77b-4704-b234-f8d4d710eeb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:28.673647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50881fdb-b77b-4704-b234-f8d4d710eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:28.677932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50881fdb-b77b-4704-b234-f8d4d710eeb8 admin admin] PATH_INFO: `/v3/users/46dd8e8c24c84b6a99d5e88f3a8a184c` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:28.677932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50881fdb-b77b-4704-b234-f8d4d710eeb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46dd8e8c24c84b6a99d5e88f3a8a184c)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:28.678589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50881fdb-b77b-4704-b234-f8d4d710eeb8 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:28.743335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 904/1805] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:28.744641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f98a3-6283-4e84-be3d-2502481405b8 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:28.744937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f98a3-6283-4e84-be3d-2502481405b8 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:28.745214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f98a3-6283-4e84-be3d-2502481405b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:28.765806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-638f98a3-6283-4e84-be3d-2502481405b8 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:28.767255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-638f98a3-6283-4e84-be3d-2502481405b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:28.827465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 905/1806] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:28.829601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f98a3-6283-4e84-be3d-2502481405b8 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:28.833597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-638f98a3-6283-4e84-be3d-2502481405b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:28.867556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f98a3-6283-4e84-be3d-2502481405b8 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:28.874201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6aaf3-b3bd-4acf-89e9-9e7df68fa7d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:28.875234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6aaf3-b3bd-4acf-89e9-9e7df68fa7d5 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:28.875741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6aaf3-b3bd-4acf-89e9-9e7df68fa7d5 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:28.876216 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6aaf3-b3bd-4acf-89e9-9e7df68fa7d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:28.894822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6aaf3-b3bd-4acf-89e9-9e7df68fa7d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:28.896718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6aaf3-b3bd-4acf-89e9-9e7df68fa7d5 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:28.917417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 906/1807] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:28.919537 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50881fdb-b77b-4704-b234-f8d4d710eeb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46dd8e8c24c84b6a99d5e88f3a8a184c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:28.920335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9be7b5-8009-45c7-ac6c-4eee806e766e None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:28.920834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9be7b5-8009-45c7-ac6c-4eee806e766e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:28.921311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9be7b5-8009-45c7-ac6c-4eee806e766e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:28.957060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-aa9be7b5-8009-45c7-ac6c-4eee806e766e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:28.958457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-aa9be7b5-8009-45c7-ac6c-4eee806e766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:28.975690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 907/1808] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:28.976940 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9be7b5-8009-45c7-ac6c-4eee806e766e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:28.993817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9be7b5-8009-45c7-ac6c-4eee806e766e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:29.010685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97451b0-159c-4d9c-94c0-ac6838b36244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:29.011480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97451b0-159c-4d9c-94c0-ac6838b36244 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:29.011669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97451b0-159c-4d9c-94c0-ac6838b36244 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:29.011948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97451b0-159c-4d9c-94c0-ac6838b36244 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:29.012868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97451b0-159c-4d9c-94c0-ac6838b36244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:00:29.015644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97451b0-159c-4d9c-94c0-ac6838b36244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:29.030554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50881fdb-b77b-4704-b234-f8d4d710eeb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46dd8e8c24c84b6a99d5e88f3a8a184c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:29.030554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50881fdb-b77b-4704-b234-f8d4d710eeb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46dd8e8c24c84b6a99d5e88f3a8a184c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:29.030816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97451b0-159c-4d9c-94c0-ac6838b36244 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:29.035847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50881fdb-b77b-4704-b234-f8d4d710eeb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46dd8e8c24c84b6a99d5e88f3a8a184c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:29.037100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50881fdb-b77b-4704-b234-f8d4d710eeb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46dd8e8c24c84b6a99d5e88f3a8a184c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:29.041819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 908/1809] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:00:29.047589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97451b0-159c-4d9c-94c0-ac6838b36244 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:29.049741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a97451b0-159c-4d9c-94c0-ac6838b36244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:29.065956 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 902/1810] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:28 2022] DELETE /identity/v3/users/46dd8e8c24c84b6a99d5e88f3a8a184c => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:29.067888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97451b0-159c-4d9c-94c0-ac6838b36244 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:29.169563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a6c89-3584-4934-a532-1216b1d4bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:29.170744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a6c89-3584-4934-a532-1216b1d4bac9 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:29.171861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a6c89-3584-4934-a532-1216b1d4bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:29.173058 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a6c89-3584-4934-a532-1216b1d4bac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:29.173981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a6c89-3584-4934-a532-1216b1d4bac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:29.176340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a6c89-3584-4934-a532-1216b1d4bac9 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:29.278736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 909/1811] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:29 2022] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:29.283263 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50881fdb-b77b-4704-b234-f8d4d710eeb8 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:29.296313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50881fdb-b77b-4704-b234-f8d4d710eeb8 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:29.426308 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3c4ae-d822-4a87-9c7c-37da27a92999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:29.427065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3c4ae-d822-4a87-9c7c-37da27a92999 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:29.427423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3c4ae-d822-4a87-9c7c-37da27a92999 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:29.427792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3c4ae-d822-4a87-9c7c-37da27a92999 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:29.428556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3c4ae-d822-4a87-9c7c-37da27a92999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:29.431237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3c4ae-d822-4a87-9c7c-37da27a92999 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:29.573812 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 903/1812] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:29 2022] POST /identity/v3/users => generated 283 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:29.578057 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a6c89-3584-4934-a532-1216b1d4bac9 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:29.605345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a6c89-3584-4934-a532-1216b1d4bac9 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:29.630999 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7c4c5-be95-4595-96c8-bb495ad75603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:29.636608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c4c5-be95-4595-96c8-bb495ad75603 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:29.637669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c4c5-be95-4595-96c8-bb495ad75603 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:29.638170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c4c5-be95-4595-96c8-bb495ad75603 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:29.641159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7c4c5-be95-4595-96c8-bb495ad75603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:29.647169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7c4c5-be95-4595-96c8-bb495ad75603 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:29.670034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 910/1813] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:29.674619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3c4ae-d822-4a87-9c7c-37da27a92999 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:29.692438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3c4ae-d822-4a87-9c7c-37da27a92999 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:29.703920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fad86-ce49-485e-9520-8d32b9f6dd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:29.705170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fad86-ce49-485e-9520-8d32b9f6dd04 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:29.706173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fad86-ce49-485e-9520-8d32b9f6dd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:29.706592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fad86-ce49-485e-9520-8d32b9f6dd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:29.708593 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fad86-ce49-485e-9520-8d32b9f6dd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:29.711031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:29.719680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fad86-ce49-485e-9520-8d32b9f6dd04 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:29.728772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 904/1814] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:29.731006 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7c4c5-be95-4595-96c8-bb495ad75603 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:29.744036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7c4c5-be95-4595-96c8-bb495ad75603 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:29.749556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd4775-a176-49f7-ac65-c7dd200cd20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:29.750463 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd4775-a176-49f7-ac65-c7dd200cd20a admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:29.750743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd4775-a176-49f7-ac65-c7dd200cd20a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:29.751016 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd4775-a176-49f7-ac65-c7dd200cd20a admin admin] PATH_INFO: `/v3/projects/d2fde4c6cedd4230b44856d7ce577eee/users/78410ee2be474957b65f5c2e8acdc073/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:29.799699 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd4775-a176-49f7-ac65-c7dd200cd20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2fde4c6cedd4230b44856d7ce577eee, user_id=78410ee2be474957b65f5c2e8acdc073, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:29.803064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd4775-a176-49f7-ac65-c7dd200cd20a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:29.944695 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 911/1815] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:29 2022] PUT /identity/v3/projects/d2fde4c6cedd4230b44856d7ce577eee/users/78410ee2be474957b65f5c2e8acdc073/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:29.960848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5535d94-4387-42b2-8189-566f2465c6c0 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:29.960848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5535d94-4387-42b2-8189-566f2465c6c0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:29.960848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5535d94-4387-42b2-8189-566f2465c6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:29.994115 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d5535d94-4387-42b2-8189-566f2465c6c0 None None] MFA Rules not processed for user `78410ee2be474957b65f5c2e8acdc073`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:29.995423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d5535d94-4387-42b2-8189-566f2465c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:30.078619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 905/1816] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:30.083839 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd4775-a176-49f7-ac65-c7dd200cd20a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:30.173661 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd4775-a176-49f7-ac65-c7dd200cd20a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:30.182421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41633b5-e491-4290-8a0e-282f28867a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:30.183537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41633b5-e491-4290-8a0e-282f28867a14 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:30.183908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41633b5-e491-4290-8a0e-282f28867a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:30.184378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41633b5-e491-4290-8a0e-282f28867a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:30.185123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41633b5-e491-4290-8a0e-282f28867a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:30.187461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41633b5-e491-4290-8a0e-282f28867a14 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:30.312405 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 912/1817] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:30 2022] POST /identity/v3/projects => generated 367 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:30.317904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5535d94-4387-42b2-8189-566f2465c6c0 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:30.339943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5535d94-4387-42b2-8189-566f2465c6c0 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:30.445157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:30.458677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ba73f-01bf-447f-a973-56eeecfec6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:30.461905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba73f-01bf-447f-a973-56eeecfec6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:30.462207 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba73f-01bf-447f-a973-56eeecfec6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:30.462487 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba73f-01bf-447f-a973-56eeecfec6a7 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:30.463208 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ba73f-01bf-447f-a973-56eeecfec6a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:30.468636 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ba73f-01bf-447f-a973-56eeecfec6a7 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:30.627648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 906/1818] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:30 2022] POST /identity/v3/users => generated 290 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:30.632535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41633b5-e491-4290-8a0e-282f28867a14 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:30.650815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41633b5-e491-4290-8a0e-282f28867a14 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:30.665021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d36006-a70a-49c4-b987-a1f33fd85c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:30.665885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36006-a70a-49c4-b987-a1f33fd85c65 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:30.666238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36006-a70a-49c4-b987-a1f33fd85c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:30.666592 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36006-a70a-49c4-b987-a1f33fd85c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:30.667432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d36006-a70a-49c4-b987-a1f33fd85c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:30.669933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d36006-a70a-49c4-b987-a1f33fd85c65 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:30.685535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 913/1819] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:30.689727 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ba73f-01bf-447f-a973-56eeecfec6a7 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:30.704219 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ba73f-01bf-447f-a973-56eeecfec6a7 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:30.709353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249e8b2-27d8-4a1e-9588-7172f5a27e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:30.710266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e8b2-27d8-4a1e-9588-7172f5a27e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:30.710827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e8b2-27d8-4a1e-9588-7172f5a27e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:30.711247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e8b2-27d8-4a1e-9588-7172f5a27e8e admin admin] PATH_INFO: `/v3/projects/ad10efd757194946bae2ffc7b47429fc/users/72fb54fb570343ccb5417ad855567765/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:30.742573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d36006-a70a-49c4-b987-a1f33fd85c65 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:30.744582 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e0d36006-a70a-49c4-b987-a1f33fd85c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:30.748216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249e8b2-27d8-4a1e-9588-7172f5a27e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad10efd757194946bae2ffc7b47429fc, user_id=72fb54fb570343ccb5417ad855567765, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:30.752638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249e8b2-27d8-4a1e-9588-7172f5a27e8e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:30.760100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d36006-a70a-49c4-b987-a1f33fd85c65 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:30.765084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72d54c-1790-41c7-a698-4227879afae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:30.766221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72d54c-1790-41c7-a698-4227879afae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:30.767382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72d54c-1790-41c7-a698-4227879afae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:30.767783 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72d54c-1790-41c7-a698-4227879afae9 admin admin] PATH_INFO: `/v3/projects/78d92e6ed62d497687cb8c5a14a6dccf` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:30.769464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72d54c-1790-41c7-a698-4227879afae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78d92e6ed62d497687cb8c5a14a6dccf)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:30.771455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72d54c-1790-41c7-a698-4227879afae9 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:30.855113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 907/1820] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:30 2022] PUT /identity/v3/projects/ad10efd757194946bae2ffc7b47429fc/users/72fb54fb570343ccb5417ad855567765/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:30.858697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249e8b2-27d8-4a1e-9588-7172f5a27e8e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:30.900418 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0b72d54c-1790-41c7-a698-4227879afae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78d92e6ed62d497687cb8c5a14a6dccf', 'request_id': 'req-0b72d54c-1790-41c7-a698-4227879afae9'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:30.938540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249e8b2-27d8-4a1e-9588-7172f5a27e8e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:31.029003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0b72d54c-1790-41c7-a698-4227879afae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78d92e6ed62d497687cb8c5a14a6dccf', 'request_id': 'req-0b72d54c-1790-41c7-a698-4227879afae9'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:31.039255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0b72d54c-1790-41c7-a698-4227879afae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78d92e6ed62d497687cb8c5a14a6dccf', 'request_id': 'req-0b72d54c-1790-41c7-a698-4227879afae9'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:31.071859 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea37d66-fce5-47e1-b085-2d745d1f9fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:31.074451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea37d66-fce5-47e1-b085-2d745d1f9fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:31.074917 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea37d66-fce5-47e1-b085-2d745d1f9fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:31.075945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea37d66-fce5-47e1-b085-2d745d1f9fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:31.087416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0b72d54c-1790-41c7-a698-4227879afae9 admin admin] The token cache is being invalidate because project 78d92e6ed62d497687cb8c5a14a6dccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:31.087416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0b72d54c-1790-41c7-a698-4227879afae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:31.087700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea37d66-fce5-47e1-b085-2d745d1f9fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:31.087798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0b72d54c-1790-41c7-a698-4227879afae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:31.087896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea37d66-fce5-47e1-b085-2d745d1f9fe9 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:31.089487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 914/1821] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:30 2022] DELETE /identity/v3/projects/78d92e6ed62d497687cb8c5a14a6dccf => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:31.097407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e684e9d-f15b-47e8-bc4a-69e74606d2a7 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:31.098530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e684e9d-f15b-47e8-bc4a-69e74606d2a7 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:31.098873 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e684e9d-f15b-47e8-bc4a-69e74606d2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:31.106938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 908/1822] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:31.112262 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea37d66-fce5-47e1-b085-2d745d1f9fe9 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:31.116800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7ea37d66-fce5-47e1-b085-2d745d1f9fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:31.133275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-8e684e9d-f15b-47e8-bc4a-69e74606d2a7 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:31.135176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8e684e9d-f15b-47e8-bc4a-69e74606d2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:31.149002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 915/1823] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:31.158281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea37d66-fce5-47e1-b085-2d745d1f9fe9 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:31.162119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04601df-a1e5-45c3-8c06-4efcf56d3799 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:31.163505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04601df-a1e5-45c3-8c06-4efcf56d3799 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:31.164220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04601df-a1e5-45c3-8c06-4efcf56d3799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:31.164376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277a91b-5810-4cf2-9582-0e47ca598a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:31.165493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277a91b-5810-4cf2-9582-0e47ca598a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:31.165876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277a91b-5810-4cf2-9582-0e47ca598a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:31.166281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277a91b-5810-4cf2-9582-0e47ca598a3e admin admin] PATH_INFO: `/v3/projects/ad10efd757194946bae2ffc7b47429fc/users/72fb54fb570343ccb5417ad855567765/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:31.169956 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277a91b-5810-4cf2-9582-0e47ca598a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad10efd757194946bae2ffc7b47429fc, user_id=72fb54fb570343ccb5417ad855567765, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:31.173897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277a91b-5810-4cf2-9582-0e47ca598a3e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:31.195586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 909/1824] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:31 2022] PUT /identity/v3/projects/ad10efd757194946bae2ffc7b47429fc/users/72fb54fb570343ccb5417ad855567765/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:31.200979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a8714-1969-438d-8447-43e04cb636a9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:31.201598 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a8714-1969-438d-8447-43e04cb636a9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:31.202031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a8714-1969-438d-8447-43e04cb636a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:31.235851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-f04601df-a1e5-45c3-8c06-4efcf56d3799 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:31.237667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-f04601df-a1e5-45c3-8c06-4efcf56d3799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:31.238524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ab4a8714-1969-438d-8447-43e04cb636a9 None None] MFA Rules not processed for user `72fb54fb570343ccb5417ad855567765`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:31.240862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ab4a8714-1969-438d-8447-43e04cb636a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:31.351397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 916/1825] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:31.357993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04601df-a1e5-45c3-8c06-4efcf56d3799 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:31.389509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04601df-a1e5-45c3-8c06-4efcf56d3799 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:31.397058 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:31.399345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e0c96-0014-4f55-8265-c4f94b85d5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:31.400042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e0c96-0014-4f55-8265-c4f94b85d5df admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:31.402145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e0c96-0014-4f55-8265-c4f94b85d5df admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:31.402429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e0c96-0014-4f55-8265-c4f94b85d5df admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:31.404406 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e0c96-0014-4f55-8265-c4f94b85d5df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:00:31.404406 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e0c96-0014-4f55-8265-c4f94b85d5df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:31.405264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e0c96-0014-4f55-8265-c4f94b85d5df admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:31.432184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 917/1826] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:00:31.441181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e0c96-0014-4f55-8265-c4f94b85d5df admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:31.448464 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 910/1827] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:31.461302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a8714-1969-438d-8447-43e04cb636a9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:31.462828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ab4a8714-1969-438d-8447-43e04cb636a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:31.465809 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e0c96-0014-4f55-8265-c4f94b85d5df admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:31.480210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6b1e3-15fb-4314-8db0-5fea70aa9870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:31.482276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6b1e3-15fb-4314-8db0-5fea70aa9870 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:31.482394 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6b1e3-15fb-4314-8db0-5fea70aa9870 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:31.482623 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6b1e3-15fb-4314-8db0-5fea70aa9870 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:31.483333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6b1e3-15fb-4314-8db0-5fea70aa9870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:31.485293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6b1e3-15fb-4314-8db0-5fea70aa9870 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:31.599084 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a8714-1969-438d-8447-43e04cb636a9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:31.603016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a67d7-a61e-457b-94cc-5f9aa53e36ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:31.603600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a67d7-a61e-457b-94cc-5f9aa53e36ee service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:31.603886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a67d7-a61e-457b-94cc-5f9aa53e36ee service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:31.604807 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a67d7-a61e-457b-94cc-5f9aa53e36ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:31.641201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 918/1828] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:31 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:31.645880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6b1e3-15fb-4314-8db0-5fea70aa9870 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:31.660140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a67d7-a61e-457b-94cc-5f9aa53e36ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:31.663184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a67d7-a61e-457b-94cc-5f9aa53e36ee service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:31.692056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 911/1829] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:00:31.892220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6b1e3-15fb-4314-8db0-5fea70aa9870 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:31.911430 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae2624-70f0-4bb2-9f09-66b18b3ee848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:31.912584 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae2624-70f0-4bb2-9f09-66b18b3ee848 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:31.913492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae2624-70f0-4bb2-9f09-66b18b3ee848 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:31.920492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae2624-70f0-4bb2-9f09-66b18b3ee848 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:31.921901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae2624-70f0-4bb2-9f09-66b18b3ee848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:31.926013 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae2624-70f0-4bb2-9f09-66b18b3ee848 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:32.343996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 919/1830] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:31 2022] POST /identity/v3/users => generated 293 bytes in 699 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:32.348410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a67d7-a61e-457b-94cc-5f9aa53e36ee service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:32.380706 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a67d7-a61e-457b-94cc-5f9aa53e36ee service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:32.382654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73f1f3-62ae-47dc-b4fa-a08ef80d2e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:32.383629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73f1f3-62ae-47dc-b4fa-a08ef80d2e63 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:32.384112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73f1f3-62ae-47dc-b4fa-a08ef80d2e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:32.384624 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73f1f3-62ae-47dc-b4fa-a08ef80d2e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:32.385752 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73f1f3-62ae-47dc-b4fa-a08ef80d2e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:32.391549 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73f1f3-62ae-47dc-b4fa-a08ef80d2e63 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:32.418653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 912/1831] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:32.422272 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae2624-70f0-4bb2-9f09-66b18b3ee848 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:32.432972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73f1f3-62ae-47dc-b4fa-a08ef80d2e63 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:32.439076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae2624-70f0-4bb2-9f09-66b18b3ee848 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:32.454368 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24de9c-ff22-444a-bc8c-057ae07d1efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:32.455208 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24de9c-ff22-444a-bc8c-057ae07d1efc admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:32.456683 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24de9c-ff22-444a-bc8c-057ae07d1efc admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:32.457081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24de9c-ff22-444a-bc8c-057ae07d1efc admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:32.458984 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24de9c-ff22-444a-bc8c-057ae07d1efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:32.464033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24de9c-ff22-444a-bc8c-057ae07d1efc admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:32.493403 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 920/1832] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:32.495629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24de9c-ff22-444a-bc8c-057ae07d1efc admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:32.521463 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24de9c-ff22-444a-bc8c-057ae07d1efc admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:32.536958 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c373f-b8da-4287-9516-167609141c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:32.538087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c373f-b8da-4287-9516-167609141c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:32.539079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c373f-b8da-4287-9516-167609141c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:32.539781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c373f-b8da-4287-9516-167609141c38 admin admin] PATH_INFO: `/v3/projects/2b4acf68fc2d40bca21b621d2e82103e/users/160a728301ae41d1ada4a12a07110ddb/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:32.593043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73f1f3-62ae-47dc-b4fa-a08ef80d2e63 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:32.607018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c373f-b8da-4287-9516-167609141c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4acf68fc2d40bca21b621d2e82103e, user_id=160a728301ae41d1ada4a12a07110ddb, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:32.620861 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d84ec6-f768-4f22-ae5c-c3751da8f3de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:32.620861 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d84ec6-f768-4f22-ae5c-c3751da8f3de service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:32.621244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c373f-b8da-4287-9516-167609141c38 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:32.625908 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d84ec6-f768-4f22-ae5c-c3751da8f3de service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:32.626471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d84ec6-f768-4f22-ae5c-c3751da8f3de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:32.631594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f6d84ec6-f768-4f22-ae5c-c3751da8f3de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:32.704557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 921/1833] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:32 2022] PUT /identity/v3/projects/2b4acf68fc2d40bca21b621d2e82103e/users/160a728301ae41d1ada4a12a07110ddb/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:32.717785 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a884b-d7f8-4ad5-ac4e-cb7f4279edec None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:32.722975 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a884b-d7f8-4ad5-ac4e-cb7f4279edec None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:32.724072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a884b-d7f8-4ad5-ac4e-cb7f4279edec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:32.820842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:32.842824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6e8a884b-d7f8-4ad5-ac4e-cb7f4279edec None None] MFA Rules not processed for user `160a728301ae41d1ada4a12a07110ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:32.850654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6e8a884b-d7f8-4ad5-ac4e-cb7f4279edec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:32.897840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d84ec6-f768-4f22-ae5c-c3751da8f3de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:32.902369 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d84ec6-f768-4f22-ae5c-c3751da8f3de service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:32.935275 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 913/1834] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:33.066409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 922/1835] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:33.071468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d84ec6-f768-4f22-ae5c-c3751da8f3de service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:33.094104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d84ec6-f768-4f22-ae5c-c3751da8f3de service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:33.245592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb36190-bc8d-4d39-bde8-2301d610b31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:33.245592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb36190-bc8d-4d39-bde8-2301d610b31d admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:33.245853 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb36190-bc8d-4d39-bde8-2301d610b31d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:33.246166 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb36190-bc8d-4d39-bde8-2301d610b31d admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:33.246914 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb36190-bc8d-4d39-bde8-2301d610b31d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:33.248910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb36190-bc8d-4d39-bde8-2301d610b31d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:33.384031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 914/1836] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:33 2022] POST /identity/v3/projects => generated 389 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:33.388529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a884b-d7f8-4ad5-ac4e-cb7f4279edec None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:33.404682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a884b-d7f8-4ad5-ac4e-cb7f4279edec None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:33.536054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d3e33-ecc2-42ca-9158-c2774a4387c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:33.536547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d3e33-ecc2-42ca-9158-c2774a4387c1 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:33.536929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d3e33-ecc2-42ca-9158-c2774a4387c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:33.537271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d3e33-ecc2-42ca-9158-c2774a4387c1 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:33.538089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d3e33-ecc2-42ca-9158-c2774a4387c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:33.542435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d3e33-ecc2-42ca-9158-c2774a4387c1 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:33.660445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 923/1837] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:33 2022] POST /identity/v3/users => generated 301 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:33.664322 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb36190-bc8d-4d39-bde8-2301d610b31d admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:33.682011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:33.684798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb36190-bc8d-4d39-bde8-2301d610b31d admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:33.691429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38958b2c-689d-4da3-8133-66d868ba6b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:33.692679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38958b2c-689d-4da3-8133-66d868ba6b9a admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:33.693113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38958b2c-689d-4da3-8133-66d868ba6b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:33.693572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38958b2c-689d-4da3-8133-66d868ba6b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:33.694924 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38958b2c-689d-4da3-8133-66d868ba6b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:33.697046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38958b2c-689d-4da3-8133-66d868ba6b9a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:33.711900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 915/1838] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:33.715921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d3e33-ecc2-42ca-9158-c2774a4387c1 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:33.732005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d3e33-ecc2-42ca-9158-c2774a4387c1 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:33.740385 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc9e0e-cce2-4a34-b2b7-0e36e7767a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:33.741800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc9e0e-cce2-4a34-b2b7-0e36e7767a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:33.742372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc9e0e-cce2-4a34-b2b7-0e36e7767a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:33.742983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc9e0e-cce2-4a34-b2b7-0e36e7767a49 admin admin] PATH_INFO: `/v3/projects/5ea71b310a7846dcb8f51a58fdaf3840/users/73978665abb34158be86f7876d311fa8/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:33.784738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc9e0e-cce2-4a34-b2b7-0e36e7767a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea71b310a7846dcb8f51a58fdaf3840, user_id=73978665abb34158be86f7876d311fa8, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:33.788526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc9e0e-cce2-4a34-b2b7-0e36e7767a49 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:33.905232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 924/1839] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:33 2022] PUT /identity/v3/projects/5ea71b310a7846dcb8f51a58fdaf3840/users/73978665abb34158be86f7876d311fa8/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:33.906755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38958b2c-689d-4da3-8133-66d868ba6b9a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:33.923249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38958b2c-689d-4da3-8133-66d868ba6b9a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:34.130478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae971d-9430-445e-adb8-168ccccb5d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:34.131480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae971d-9430-445e-adb8-168ccccb5d14 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:34.131918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae971d-9430-445e-adb8-168ccccb5d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:34.132346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae971d-9430-445e-adb8-168ccccb5d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:34.133256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae971d-9430-445e-adb8-168ccccb5d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:34.138293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae971d-9430-445e-adb8-168ccccb5d14 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:34.164209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 916/1840] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:34.168118 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc9e0e-cce2-4a34-b2b7-0e36e7767a49 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:34.180859 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc9e0e-cce2-4a34-b2b7-0e36e7767a49 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:34.210488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163291e4-d3f2-426d-b48f-f3a149d070e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:34.212016 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163291e4-d3f2-426d-b48f-f3a149d070e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:34.212558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163291e4-d3f2-426d-b48f-f3a149d070e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:34.213052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163291e4-d3f2-426d-b48f-f3a149d070e9 admin admin] PATH_INFO: `/v3/projects/5ea71b310a7846dcb8f51a58fdaf3840/users/73978665abb34158be86f7876d311fa8/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:34.217973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163291e4-d3f2-426d-b48f-f3a149d070e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea71b310a7846dcb8f51a58fdaf3840, user_id=73978665abb34158be86f7876d311fa8, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:34.224277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163291e4-d3f2-426d-b48f-f3a149d070e9 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:34.254628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 925/1841] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:34 2022] PUT /identity/v3/projects/5ea71b310a7846dcb8f51a58fdaf3840/users/73978665abb34158be86f7876d311fa8/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:34.267079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d489a-8e8f-4653-85e9-1faf886cef87 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:34.268381 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d489a-8e8f-4653-85e9-1faf886cef87 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:34.269055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d489a-8e8f-4653-85e9-1faf886cef87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:34.368916 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b19d489a-8e8f-4653-85e9-1faf886cef87 None None] MFA Rules not processed for user `73978665abb34158be86f7876d311fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:34.370601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b19d489a-8e8f-4653-85e9-1faf886cef87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:34.522731 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 917/1842] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:34.536485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163291e4-d3f2-426d-b48f-f3a149d070e9 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:34.604109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163291e4-d3f2-426d-b48f-f3a149d070e9 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:34.608762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d31edb-f6bd-46fc-953c-438403d0e2b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:34.609626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31edb-f6bd-46fc-953c-438403d0e2b8 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:34.610309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31edb-f6bd-46fc-953c-438403d0e2b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:34.610856 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d31edb-f6bd-46fc-953c-438403d0e2b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:34.623949 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d31edb-f6bd-46fc-953c-438403d0e2b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:34.625942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d31edb-f6bd-46fc-953c-438403d0e2b8 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:34.652994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 926/1843] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:34.788673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d489a-8e8f-4653-85e9-1faf886cef87 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:34.858234 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d489a-8e8f-4653-85e9-1faf886cef87 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:34.862846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:34.863722 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:34.864006 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:34.864283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] PATH_INFO: `/v3/users/160a728301ae41d1ada4a12a07110ddb` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:34.865645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=160a728301ae41d1ada4a12a07110ddb)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:34.867735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:35.149967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:35.175889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160a728301ae41d1ada4a12a07110ddb'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:35.289923 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160a728301ae41d1ada4a12a07110ddb'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:35.291261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160a728301ae41d1ada4a12a07110ddb'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:35.309599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160a728301ae41d1ada4a12a07110ddb'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:35.310792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160a728301ae41d1ada4a12a07110ddb'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:35.347648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 918/1844] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:34 2022] DELETE /identity/v3/users/160a728301ae41d1ada4a12a07110ddb => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:35.347975 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3a71f-04c3-495c-9550-0378c0ce94f0 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:35.348300 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3a71f-04c3-495c-9550-0378c0ce94f0 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:35.348583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3a71f-04c3-495c-9550-0378c0ce94f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:35.374666 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-9cd3a71f-04c3-495c-9550-0378c0ce94f0 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:35.376048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-9cd3a71f-04c3-495c-9550-0378c0ce94f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:35.459171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 927/1845] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:35.470568 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:35.472667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:35.545279 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ef51-c33b-4d2f-a650-fcf53d1f7f6d admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:35.551239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b6846-215d-48b3-a355-def8b5fde7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:35.552413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b6846-215d-48b3-a355-def8b5fde7db service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:35.552702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b6846-215d-48b3-a355-def8b5fde7db service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:35.552985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b6846-215d-48b3-a355-def8b5fde7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:35.566351 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b6846-215d-48b3-a355-def8b5fde7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:35.568065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b6846-215d-48b3-a355-def8b5fde7db service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:35.579732 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 919/1846] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:36.186780 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3a71f-04c3-495c-9550-0378c0ce94f0 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:36.188494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-9cd3a71f-04c3-495c-9550-0378c0ce94f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:36.209735 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3a71f-04c3-495c-9550-0378c0ce94f0 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:36.215498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:36.216484 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:36.216829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:36.217032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] PATH_INFO: `/v3/projects/2b4acf68fc2d40bca21b621d2e82103e` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:36.218574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4acf68fc2d40bca21b621d2e82103e)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:36.220679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:36.361124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4acf68fc2d40bca21b621d2e82103e', 'request_id': 'req-2e058449-3948-474c-96f1-993f243370b0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:36.432842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4acf68fc2d40bca21b621d2e82103e', 'request_id': 'req-2e058449-3948-474c-96f1-993f243370b0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:36.443349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4acf68fc2d40bca21b621d2e82103e', 'request_id': 'req-2e058449-3948-474c-96f1-993f243370b0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:36.457084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] The token cache is being invalidate because project 2b4acf68fc2d40bca21b621d2e82103e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:36.457394 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:36.458278 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:36.460178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 928/1847] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:36 2022] DELETE /identity/v3/projects/2b4acf68fc2d40bca21b621d2e82103e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:36.464196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b6846-215d-48b3-a355-def8b5fde7db service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:36.475906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b6846-215d-48b3-a355-def8b5fde7db service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:36.540114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f0b69-f39f-4a26-bb4e-b7a22a3d653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:36.540936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f0b69-f39f-4a26-bb4e-b7a22a3d653f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:36.541216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f0b69-f39f-4a26-bb4e-b7a22a3d653f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:36.541523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f0b69-f39f-4a26-bb4e-b7a22a3d653f admin admin] PATH_INFO: `/v3/users/73978665abb34158be86f7876d311fa8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:36.542942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f0b69-f39f-4a26-bb4e-b7a22a3d653f admin admin] RBAC: Authorizing `identity:delete_user(user_id=73978665abb34158be86f7876d311fa8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:36.544888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f0b69-f39f-4a26-bb4e-b7a22a3d653f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:36.728159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ff8f0b69-f39f-4a26-bb4e-b7a22a3d653f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73978665abb34158be86f7876d311fa8'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:36.816996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ff8f0b69-f39f-4a26-bb4e-b7a22a3d653f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73978665abb34158be86f7876d311fa8'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:36.818401 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ff8f0b69-f39f-4a26-bb4e-b7a22a3d653f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73978665abb34158be86f7876d311fa8'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:36.837988 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ff8f0b69-f39f-4a26-bb4e-b7a22a3d653f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73978665abb34158be86f7876d311fa8'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:36.839300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ff8f0b69-f39f-4a26-bb4e-b7a22a3d653f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73978665abb34158be86f7876d311fa8'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:36.871289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 920/1848] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:36 2022] DELETE /identity/v3/users/73978665abb34158be86f7876d311fa8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:37.350464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:37.657846 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:37.659367 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:37.704384 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e058449-3948-474c-96f1-993f243370b0 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:37.771748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:37.772703 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:37.773053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:37.773420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc admin admin] PATH_INFO: `/v3/projects/5ea71b310a7846dcb8f51a58fdaf3840` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:37.774773 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ea71b310a7846dcb8f51a58fdaf3840)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:37.776894 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:37.896788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea71b310a7846dcb8f51a58fdaf3840', 'request_id': 'req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:38.079085 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea71b310a7846dcb8f51a58fdaf3840', 'request_id': 'req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:38.086970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea71b310a7846dcb8f51a58fdaf3840', 'request_id': 'req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:38.104538 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc admin admin] The token cache is being invalidate because project 5ea71b310a7846dcb8f51a58fdaf3840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:38.104843 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:38.105650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f4bbc526-e7c6-4f7f-a79e-6f31952c80cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:38.114129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 929/1849] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:37 2022] DELETE /identity/v3/projects/5ea71b310a7846dcb8f51a58fdaf3840 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:38.128429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1f5c5-8dbc-4e89-94ce-fa31c5331838 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:38.128871 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1f5c5-8dbc-4e89-94ce-fa31c5331838 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:38.128976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1f5c5-8dbc-4e89-94ce-fa31c5331838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:38.151739 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b2f1f5c5-8dbc-4e89-94ce-fa31c5331838 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:38.153959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b2f1f5c5-8dbc-4e89-94ce-fa31c5331838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:38.233862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 921/1850] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:38.243989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05de2c5-d092-4abb-b79c-472a40251bfd None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:38.244284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05de2c5-d092-4abb-b79c-472a40251bfd None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:38.244795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05de2c5-d092-4abb-b79c-472a40251bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:38.274861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a05de2c5-d092-4abb-b79c-472a40251bfd None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:38.276718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a05de2c5-d092-4abb-b79c-472a40251bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:38.286316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 930/1851] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:38.290193 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1f5c5-8dbc-4e89-94ce-fa31c5331838 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:38.315330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1f5c5-8dbc-4e89-94ce-fa31c5331838 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:38.323956 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f7a3b-eefd-4876-8d56-f9e1346a485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:38.324869 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f7a3b-eefd-4876-8d56-f9e1346a485e admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:38.325347 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f7a3b-eefd-4876-8d56-f9e1346a485e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:38.326088 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f7a3b-eefd-4876-8d56-f9e1346a485e admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:38.327311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f7a3b-eefd-4876-8d56-f9e1346a485e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:00:38.327860 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f7a3b-eefd-4876-8d56-f9e1346a485e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:38.329842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f7a3b-eefd-4876-8d56-f9e1346a485e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:38.349420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 922/1852] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:00:38.352893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05de2c5-d092-4abb-b79c-472a40251bfd None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:38.363132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05de2c5-d092-4abb-b79c-472a40251bfd None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:38.368347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b98788-ef5b-4175-a9e2-c30bd2ca46f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:38.369015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b98788-ef5b-4175-a9e2-c30bd2ca46f6 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:38.369300 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b98788-ef5b-4175-a9e2-c30bd2ca46f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:38.369744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b98788-ef5b-4175-a9e2-c30bd2ca46f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:38.374175 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b98788-ef5b-4175-a9e2-c30bd2ca46f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:38.374175 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b98788-ef5b-4175-a9e2-c30bd2ca46f6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:38.469621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 931/1853] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:38 2022] POST /identity/v3/projects => generated 407 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:38.474264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f7a3b-eefd-4876-8d56-f9e1346a485e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:38.484846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f7a3b-eefd-4876-8d56-f9e1346a485e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:38.580014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0facb7-2745-4d4a-b8c6-9bc01765d2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:38.581243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0facb7-2745-4d4a-b8c6-9bc01765d2dc admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:38.581602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0facb7-2745-4d4a-b8c6-9bc01765d2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:38.581884 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0facb7-2745-4d4a-b8c6-9bc01765d2dc admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:38.582602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0facb7-2745-4d4a-b8c6-9bc01765d2dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:38.584630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0facb7-2745-4d4a-b8c6-9bc01765d2dc admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:38.690898 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 923/1854] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:38 2022] POST /identity/v3/users => generated 304 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:38.695126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b98788-ef5b-4175-a9e2-c30bd2ca46f6 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:38.709894 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b98788-ef5b-4175-a9e2-c30bd2ca46f6 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:38.718701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e19c4-b4e4-476e-9472-fadfb2d32a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:38.720411 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e19c4-b4e4-476e-9472-fadfb2d32a32 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:38.727597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e19c4-b4e4-476e-9472-fadfb2d32a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:38.727597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e19c4-b4e4-476e-9472-fadfb2d32a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:38.727597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e19c4-b4e4-476e-9472-fadfb2d32a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:38.727597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e19c4-b4e4-476e-9472-fadfb2d32a32 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:38.743375 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 932/1855] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:38.744121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0facb7-2745-4d4a-b8c6-9bc01765d2dc admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:38.759358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0facb7-2745-4d4a-b8c6-9bc01765d2dc admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:38.764873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6e9e7-a6e0-45e0-8c92-3e6ea07bf42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:38.765913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6e9e7-a6e0-45e0-8c92-3e6ea07bf42c admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:38.766352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6e9e7-a6e0-45e0-8c92-3e6ea07bf42c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:38.766788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6e9e7-a6e0-45e0-8c92-3e6ea07bf42c admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:38.768349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6e9e7-a6e0-45e0-8c92-3e6ea07bf42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:38.770234 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6e9e7-a6e0-45e0-8c92-3e6ea07bf42c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:38.782603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 924/1856] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:38.788599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e19c4-b4e4-476e-9472-fadfb2d32a32 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:38.799753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e19c4-b4e4-476e-9472-fadfb2d32a32 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:38.805570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c8969-eb9e-4541-99e4-b1bbf7dec774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:38.808164 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c8969-eb9e-4541-99e4-b1bbf7dec774 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:38.808707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c8969-eb9e-4541-99e4-b1bbf7dec774 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:38.809008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c8969-eb9e-4541-99e4-b1bbf7dec774 admin admin] PATH_INFO: `/v3/projects/7742b72a8c084c14ac4cf35f474254ed/users/37c9b439aaea453a90934cf9f9a3d2a6/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:38.831109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c8969-eb9e-4541-99e4-b1bbf7dec774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7742b72a8c084c14ac4cf35f474254ed, user_id=37c9b439aaea453a90934cf9f9a3d2a6, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:38.831109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c8969-eb9e-4541-99e4-b1bbf7dec774 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:38.946487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 933/1857] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:38 2022] PUT /identity/v3/projects/7742b72a8c084c14ac4cf35f474254ed/users/37c9b439aaea453a90934cf9f9a3d2a6/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:38.957427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7498a0-5e3d-4cf4-9ae7-224c4500a813 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:38.957721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7498a0-5e3d-4cf4-9ae7-224c4500a813 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:38.957997 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7498a0-5e3d-4cf4-9ae7-224c4500a813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:38.989016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ef7498a0-5e3d-4cf4-9ae7-224c4500a813 None None] MFA Rules not processed for user `37c9b439aaea453a90934cf9f9a3d2a6`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:38.990266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ef7498a0-5e3d-4cf4-9ae7-224c4500a813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:39.062730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 925/1858] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:39.067866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c8969-eb9e-4541-99e4-b1bbf7dec774 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:39.134822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c8969-eb9e-4541-99e4-b1bbf7dec774 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:39.140054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e48f9-aa39-4671-9e7b-76329d95eae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:39.140822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e48f9-aa39-4671-9e7b-76329d95eae5 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:39.141263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e48f9-aa39-4671-9e7b-76329d95eae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:39.141575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e48f9-aa39-4671-9e7b-76329d95eae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:39.142353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e48f9-aa39-4671-9e7b-76329d95eae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:39.144930 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e48f9-aa39-4671-9e7b-76329d95eae5 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:39.231772 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 934/1859] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:39 2022] POST /identity/v3/projects => generated 409 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:39.235774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7498a0-5e3d-4cf4-9ae7-224c4500a813 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:39.247692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7498a0-5e3d-4cf4-9ae7-224c4500a813 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:39.309844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec309-1097-46c9-bd8d-4e02aa6c9813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:39.310701 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec309-1097-46c9-bd8d-4e02aa6c9813 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:39.311121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec309-1097-46c9-bd8d-4e02aa6c9813 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:39.311735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec309-1097-46c9-bd8d-4e02aa6c9813 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:39.312169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dec309-1097-46c9-bd8d-4e02aa6c9813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:39.314849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dec309-1097-46c9-bd8d-4e02aa6c9813 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:39.428064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 926/1860] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:39 2022] POST /identity/v3/users => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:39.432363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e48f9-aa39-4671-9e7b-76329d95eae5 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:39.443674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e48f9-aa39-4671-9e7b-76329d95eae5 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:39.449531 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc994c6-ae29-4295-8139-030712d709ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:39.450250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc994c6-ae29-4295-8139-030712d709ef admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:39.450669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc994c6-ae29-4295-8139-030712d709ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:39.451141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc994c6-ae29-4295-8139-030712d709ef admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:39.451938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc994c6-ae29-4295-8139-030712d709ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:39.453859 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc994c6-ae29-4295-8139-030712d709ef admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:39.468686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 935/1861] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:39.470233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec309-1097-46c9-bd8d-4e02aa6c9813 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:39.481174 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec309-1097-46c9-bd8d-4e02aa6c9813 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:39.485909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f6f58-4b04-440e-97d9-9aee10b1de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:39.486835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f6f58-4b04-440e-97d9-9aee10b1de3e admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:39.487114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f6f58-4b04-440e-97d9-9aee10b1de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:39.487387 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f6f58-4b04-440e-97d9-9aee10b1de3e admin admin] PATH_INFO: `/v3/projects/75be38fd6e0c4583b40ba6f122ab30c9/users/e2075288596c41c8bbb28434479daa2d/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:39.505796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f6f58-4b04-440e-97d9-9aee10b1de3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be38fd6e0c4583b40ba6f122ab30c9, user_id=e2075288596c41c8bbb28434479daa2d, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:39.509305 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f6f58-4b04-440e-97d9-9aee10b1de3e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:39.595201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:39.613180 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 927/1862] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:39 2022] PUT /identity/v3/projects/75be38fd6e0c4583b40ba6f122ab30c9/users/e2075288596c41c8bbb28434479daa2d/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:39.618615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc994c6-ae29-4295-8139-030712d709ef admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:39.639158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc994c6-ae29-4295-8139-030712d709ef admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:39.716552 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04a52b-9c9b-4db5-8084-c5ca96fc18dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:39.717228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a52b-9c9b-4db5-8084-c5ca96fc18dc admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:39.717552 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a52b-9c9b-4db5-8084-c5ca96fc18dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:39.717833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a52b-9c9b-4db5-8084-c5ca96fc18dc admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:39.718555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04a52b-9c9b-4db5-8084-c5ca96fc18dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:39.720196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04a52b-9c9b-4db5-8084-c5ca96fc18dc admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:39.730599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 936/1863] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:39.734945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f6f58-4b04-440e-97d9-9aee10b1de3e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:39.748712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f6f58-4b04-440e-97d9-9aee10b1de3e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:39.756176 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3a5af-cc17-4d4c-bf20-6516078acefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:39.757309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3a5af-cc17-4d4c-bf20-6516078acefe admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:39.757820 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3a5af-cc17-4d4c-bf20-6516078acefe admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:39.758231 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3a5af-cc17-4d4c-bf20-6516078acefe admin admin] PATH_INFO: `/v3/projects/75be38fd6e0c4583b40ba6f122ab30c9/users/e2075288596c41c8bbb28434479daa2d/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:39.760333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3a5af-cc17-4d4c-bf20-6516078acefe admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be38fd6e0c4583b40ba6f122ab30c9, user_id=e2075288596c41c8bbb28434479daa2d, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:39.763120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3a5af-cc17-4d4c-bf20-6516078acefe admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:39.778566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 928/1864] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:39 2022] PUT /identity/v3/projects/75be38fd6e0c4583b40ba6f122ab30c9/users/e2075288596c41c8bbb28434479daa2d/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:39.789245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac2783-e44a-40de-b5e8-66d9965f8305 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:39.789581 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac2783-e44a-40de-b5e8-66d9965f8305 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:39.789924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac2783-e44a-40de-b5e8-66d9965f8305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:39.820490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-3cac2783-e44a-40de-b5e8-66d9965f8305 None None] MFA Rules not processed for user `e2075288596c41c8bbb28434479daa2d`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:39.822095 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3cac2783-e44a-40de-b5e8-66d9965f8305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:39.917948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 937/1865] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:39 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:39.929444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3a5af-cc17-4d4c-bf20-6516078acefe admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:39.931230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4fc3a5af-cc17-4d4c-bf20-6516078acefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:39.989890 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3a5af-cc17-4d4c-bf20-6516078acefe admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:39.993601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b7957-af92-4bbf-8e4c-ab480a03c853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:39.994363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b7957-af92-4bbf-8e4c-ab480a03c853 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:39.994754 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b7957-af92-4bbf-8e4c-ab480a03c853 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:39.995049 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b7957-af92-4bbf-8e4c-ab480a03c853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:40.006733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b7957-af92-4bbf-8e4c-ab480a03c853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:40.008291 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b7957-af92-4bbf-8e4c-ab480a03c853 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:40.018490 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 929/1866] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:39 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:40.511151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac2783-e44a-40de-b5e8-66d9965f8305 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:40.512636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3cac2783-e44a-40de-b5e8-66d9965f8305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:40.525077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac2783-e44a-40de-b5e8-66d9965f8305 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:40.531650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923963f-3205-4f87-b455-d33837b5902a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:40.533712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923963f-3205-4f87-b455-d33837b5902a service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:40.534105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923963f-3205-4f87-b455-d33837b5902a service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:40.534405 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923963f-3205-4f87-b455-d33837b5902a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:40.621535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923963f-3205-4f87-b455-d33837b5902a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:40.624345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923963f-3205-4f87-b455-d33837b5902a service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:40.631802 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b7957-af92-4bbf-8e4c-ab480a03c853 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:40.634191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fa3b7957-af92-4bbf-8e4c-ab480a03c853 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:40.638634 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 938/1867] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:40 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:40.772810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b7957-af92-4bbf-8e4c-ab480a03c853 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:40.778761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:40.780092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:40.780515 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:40.780954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] PATH_INFO: `/v3/users/78410ee2be474957b65f5c2e8acdc073` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:40.782522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78410ee2be474957b65f5c2e8acdc073)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:40.785917 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:41.119255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78410ee2be474957b65f5c2e8acdc073'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:41.244396 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78410ee2be474957b65f5c2e8acdc073'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:41.245327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78410ee2be474957b65f5c2e8acdc073'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:41.258346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78410ee2be474957b65f5c2e8acdc073'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:41.258961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78410ee2be474957b65f5c2e8acdc073'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:41.282477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 930/1868] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:40 2022] DELETE /identity/v3/users/78410ee2be474957b65f5c2e8acdc073 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:41.287050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff74b27-2f81-44af-a611-e3367006a802 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:41.287731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff74b27-2f81-44af-a611-e3367006a802 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:41.288157 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff74b27-2f81-44af-a611-e3367006a802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:41.308013 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6ff74b27-2f81-44af-a611-e3367006a802 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:41.310340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6ff74b27-2f81-44af-a611-e3367006a802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:41.378037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 939/1869] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:41.388829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:41.390402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:41.468489 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411be93-bcd3-4d13-978a-6e9a2331a74f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:41.473323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac9b11-4fce-48f0-9b1d-a972acdea511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:41.474192 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac9b11-4fce-48f0-9b1d-a972acdea511 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:41.474476 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac9b11-4fce-48f0-9b1d-a972acdea511 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:41.474753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac9b11-4fce-48f0-9b1d-a972acdea511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:41.485514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac9b11-4fce-48f0-9b1d-a972acdea511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:41.487938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac9b11-4fce-48f0-9b1d-a972acdea511 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:41.507610 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 931/1870] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:41.567531 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:41.628718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff74b27-2f81-44af-a611-e3367006a802 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:41.630301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6ff74b27-2f81-44af-a611-e3367006a802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:41.648084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff74b27-2f81-44af-a611-e3367006a802 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:41.654349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:41.656032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:41.656467 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:41.656940 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] PATH_INFO: `/v3/users/69b83dd027bf4b59b2c91efa989fa9f5` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:41.658778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b83dd027bf4b59b2c91efa989fa9f5)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:41.660951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:41.901644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b83dd027bf4b59b2c91efa989fa9f5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:42.003840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b83dd027bf4b59b2c91efa989fa9f5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:42.013400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:42.023883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b83dd027bf4b59b2c91efa989fa9f5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:42.025081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b83dd027bf4b59b2c91efa989fa9f5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:42.026551 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b83dd027bf4b59b2c91efa989fa9f5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:42.053815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 940/1871] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:41 2022] DELETE /identity/v3/users/69b83dd027bf4b59b2c91efa989fa9f5 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:42.058644 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0547f-d468-4d5e-837e-e4bd7d3ea346 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:42.059038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0547f-d468-4d5e-837e-e4bd7d3ea346 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:42.059859 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0547f-d468-4d5e-837e-e4bd7d3ea346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:42.083484 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d9d0547f-d468-4d5e-837e-e4bd7d3ea346 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:42.084847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d9d0547f-d468-4d5e-837e-e4bd7d3ea346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:42.099473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:42.103283 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:42.192168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 932/1872] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:42.199943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8104e30-d0f2-4de8-be29-945a015dfda9 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:42.207206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0547f-d468-4d5e-837e-e4bd7d3ea346 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:42.208745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:42.209039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d9d0547f-d468-4d5e-837e-e4bd7d3ea346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:42.209788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:42.210147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:42.210487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] PATH_INFO: `/v3/projects/d2fde4c6cedd4230b44856d7ce577eee` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:42.212477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2fde4c6cedd4230b44856d7ce577eee)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:42.215403 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:42.286294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0547f-d468-4d5e-837e-e4bd7d3ea346 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:42.290034 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528fdf-6377-4fe1-857a-0c0792df617e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:42.290708 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528fdf-6377-4fe1-857a-0c0792df617e service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:42.290991 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528fdf-6377-4fe1-857a-0c0792df617e service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:42.291371 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528fdf-6377-4fe1-857a-0c0792df617e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:42.302208 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39528fdf-6377-4fe1-857a-0c0792df617e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:42.303817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39528fdf-6377-4fe1-857a-0c0792df617e service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:42.315840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 933/1873] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:42.380490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2fde4c6cedd4230b44856d7ce577eee', 'request_id': 'req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:42.482389 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2fde4c6cedd4230b44856d7ce577eee', 'request_id': 'req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:42.489579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2fde4c6cedd4230b44856d7ce577eee', 'request_id': 'req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:42.506787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] The token cache is being invalidate because project d2fde4c6cedd4230b44856d7ce577eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:42.507198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:42.507983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:42.509775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 941/1874] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:42 2022] DELETE /identity/v3/projects/d2fde4c6cedd4230b44856d7ce577eee => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:42.514392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528fdf-6377-4fe1-857a-0c0792df617e service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:42.525500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528fdf-6377-4fe1-857a-0c0792df617e service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:42.611838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:42.612872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:42.613164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:42.613641 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] PATH_INFO: `/v3/users/72fb54fb570343ccb5417ad855567765` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:42.615062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72fb54fb570343ccb5417ad855567765)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:42.617109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:42.868864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72fb54fb570343ccb5417ad855567765'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:42.983687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72fb54fb570343ccb5417ad855567765'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:42.984332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72fb54fb570343ccb5417ad855567765'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:43.018487 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72fb54fb570343ccb5417ad855567765'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:43.021111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72fb54fb570343ccb5417ad855567765'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:43.063104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 934/1875] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:42 2022] DELETE /identity/v3/users/72fb54fb570343ccb5417ad855567765 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:43.456761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:43.458282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:43.492395 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d743d-a24c-4f3e-9d8d-5aeb8000e6c8 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:43.573490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:43.574350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:43.574798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:43.575221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] PATH_INFO: `/v3/projects/2503ed15de784654907a1e69e056c809` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:43.576768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2503ed15de784654907a1e69e056c809)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:43.578974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:43.722682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:43.724687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:43.740567 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d73d7-854c-4082-b272-1e9a9b147381 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:43.765010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2503ed15de784654907a1e69e056c809', 'request_id': 'req-e01ba063-9351-4643-b4db-2e5b8a24c880'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:43.800548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:43.844737 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff372176-cd32-4527-89c8-983ae83a6aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:43.846344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff372176-cd32-4527-89c8-983ae83a6aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:43.846726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff372176-cd32-4527-89c8-983ae83a6aae admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:43.847115 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff372176-cd32-4527-89c8-983ae83a6aae admin admin] PATH_INFO: `/v3/projects/ad10efd757194946bae2ffc7b47429fc` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:43.848573 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff372176-cd32-4527-89c8-983ae83a6aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad10efd757194946bae2ffc7b47429fc)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:43.850654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff372176-cd32-4527-89c8-983ae83a6aae admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:43.887828 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2503ed15de784654907a1e69e056c809', 'request_id': 'req-e01ba063-9351-4643-b4db-2e5b8a24c880'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:43.895508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2503ed15de784654907a1e69e056c809', 'request_id': 'req-e01ba063-9351-4643-b4db-2e5b8a24c880'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:43.907259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] The token cache is being invalidate because project 2503ed15de784654907a1e69e056c809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:43.907734 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:43.909106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:43.910887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 942/1876] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:43 2022] DELETE /identity/v3/projects/2503ed15de784654907a1e69e056c809 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:43.914701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:43.916478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:43.930102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba063-9351-4643-b4db-2e5b8a24c880 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:43.937480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec0f4e-c0af-4197-8386-ae59ac02ab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:43.938621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec0f4e-c0af-4197-8386-ae59ac02ab6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:43.939452 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec0f4e-c0af-4197-8386-ae59ac02ab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:43.940199 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec0f4e-c0af-4197-8386-ae59ac02ab6f admin admin] PATH_INFO: `/v3/users/68b4a34152654dc5a0f5c735a19bade0` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:43.941844 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec0f4e-c0af-4197-8386-ae59ac02ab6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b4a34152654dc5a0f5c735a19bade0)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:43.944296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec0f4e-c0af-4197-8386-ae59ac02ab6f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:43.967386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ff372176-cd32-4527-89c8-983ae83a6aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad10efd757194946bae2ffc7b47429fc', 'request_id': 'req-ff372176-cd32-4527-89c8-983ae83a6aae'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:44.083854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ff372176-cd32-4527-89c8-983ae83a6aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad10efd757194946bae2ffc7b47429fc', 'request_id': 'req-ff372176-cd32-4527-89c8-983ae83a6aae'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:44.091277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ff372176-cd32-4527-89c8-983ae83a6aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad10efd757194946bae2ffc7b47429fc', 'request_id': 'req-ff372176-cd32-4527-89c8-983ae83a6aae'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:44.109662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ff372176-cd32-4527-89c8-983ae83a6aae admin admin] The token cache is being invalidate because project ad10efd757194946bae2ffc7b47429fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:44.109662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ff372176-cd32-4527-89c8-983ae83a6aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:44.109662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ff372176-cd32-4527-89c8-983ae83a6aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:44.109990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 935/1877] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:43 2022] DELETE /identity/v3/projects/ad10efd757194946bae2ffc7b47429fc => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:44.115296 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b453efd-5f20-4e6b-8bba-3bdfb7874899 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:44.115601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b453efd-5f20-4e6b-8bba-3bdfb7874899 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:44.116049 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b453efd-5f20-4e6b-8bba-3bdfb7874899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:44.138709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-9b453efd-5f20-4e6b-8bba-3bdfb7874899 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:44.140031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-9b453efd-5f20-4e6b-8bba-3bdfb7874899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:44.187198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-feec0f4e-c0af-4197-8386-ae59ac02ab6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b4a34152654dc5a0f5c735a19bade0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:44.228372 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 936/1878] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:44.238682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cf40b-258b-4fb2-8f11-b4638e0009f8 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:44.239112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cf40b-258b-4fb2-8f11-b4638e0009f8 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:44.239459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cf40b-258b-4fb2-8f11-b4638e0009f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:44.249313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-feec0f4e-c0af-4197-8386-ae59ac02ab6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b4a34152654dc5a0f5c735a19bade0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:44.253975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:44.262262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-feec0f4e-c0af-4197-8386-ae59ac02ab6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b4a34152654dc5a0f5c735a19bade0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:44.264097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-feec0f4e-c0af-4197-8386-ae59ac02ab6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b4a34152654dc5a0f5c735a19bade0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:44.264888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-feec0f4e-c0af-4197-8386-ae59ac02ab6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b4a34152654dc5a0f5c735a19bade0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:44.292632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-9b6cf40b-258b-4fb2-8f11-b4638e0009f8 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:44.293949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-9b6cf40b-258b-4fb2-8f11-b4638e0009f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:44.300931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 943/1879] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:43 2022] DELETE /identity/v3/users/68b4a34152654dc5a0f5c735a19bade0 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:44.313720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 937/1880] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:44.318633 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec0f4e-c0af-4197-8386-ae59ac02ab6f admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:44.422628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec0f4e-c0af-4197-8386-ae59ac02ab6f admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:44.427950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ae93-eab1-4a44-a886-f93041637cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:44.429227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ae93-eab1-4a44-a886-f93041637cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:44.429227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ae93-eab1-4a44-a886-f93041637cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:44.429729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ae93-eab1-4a44-a886-f93041637cb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:44.431004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06ae93-eab1-4a44-a886-f93041637cb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:00:44.431385 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06ae93-eab1-4a44-a886-f93041637cb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:44.433256 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06ae93-eab1-4a44-a886-f93041637cb0 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:44.452992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 944/1881] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:00:44.454683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cf40b-258b-4fb2-8f11-b4638e0009f8 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:44.466623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cf40b-258b-4fb2-8f11-b4638e0009f8 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:44.473632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59251a08-fdba-453f-997e-7ccee5a80435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:44.474378 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59251a08-fdba-453f-997e-7ccee5a80435 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:44.474668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59251a08-fdba-453f-997e-7ccee5a80435 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:44.474950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59251a08-fdba-453f-997e-7ccee5a80435 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:44.475667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59251a08-fdba-453f-997e-7ccee5a80435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:44.477712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59251a08-fdba-453f-997e-7ccee5a80435 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:44.600098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 938/1882] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:44 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:44.604873 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ae93-eab1-4a44-a886-f93041637cb0 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:44.620326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ae93-eab1-4a44-a886-f93041637cb0 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:44.707733 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a912-31b9-4c86-ab7a-de6c45598ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:44.708610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a912-31b9-4c86-ab7a-de6c45598ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:44.708996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a912-31b9-4c86-ab7a-de6c45598ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:44.709394 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a912-31b9-4c86-ab7a-de6c45598ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:44.710225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93a912-31b9-4c86-ab7a-de6c45598ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:44.712950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93a912-31b9-4c86-ab7a-de6c45598ea5 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:44.869995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 945/1883] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:44 2022] POST /identity/v3/users => generated 286 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:44.874534 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59251a08-fdba-453f-997e-7ccee5a80435 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:44.886202 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59251a08-fdba-453f-997e-7ccee5a80435 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:44.892518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f89f6-1f1c-4ed7-827f-941f462078d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:44.894675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f89f6-1f1c-4ed7-827f-941f462078d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:44.894675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f89f6-1f1c-4ed7-827f-941f462078d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:44.895764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f89f6-1f1c-4ed7-827f-941f462078d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:44.896541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f89f6-1f1c-4ed7-827f-941f462078d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:44.898336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f89f6-1f1c-4ed7-827f-941f462078d0 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:44.912096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 939/1884] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:44.916588 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a912-31b9-4c86-ab7a-de6c45598ea5 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:44.928767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a912-31b9-4c86-ab7a-de6c45598ea5 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:44.936159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e5e7f-a941-461a-93b4-1eb461a7f8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:44.937167 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e5e7f-a941-461a-93b4-1eb461a7f8be admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:44.937926 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e5e7f-a941-461a-93b4-1eb461a7f8be admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:44.938395 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e5e7f-a941-461a-93b4-1eb461a7f8be admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:44.939851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e5e7f-a941-461a-93b4-1eb461a7f8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:44.945641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e5e7f-a941-461a-93b4-1eb461a7f8be admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:44.963778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 946/1885] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:44.964549 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f89f6-1f1c-4ed7-827f-941f462078d0 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:44.981117 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f89f6-1f1c-4ed7-827f-941f462078d0 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:44.987054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30934a-aac8-4c8a-870d-d25ebf0e18a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:44.988007 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30934a-aac8-4c8a-870d-d25ebf0e18a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:44.988211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30934a-aac8-4c8a-870d-d25ebf0e18a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:44.988496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30934a-aac8-4c8a-870d-d25ebf0e18a1 admin admin] PATH_INFO: `/v3/projects/3aee17c3b800432e8b8e7f10041c038b/users/fb62ab13dbaf404ebb0a30cfd1053f42/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:45.006339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30934a-aac8-4c8a-870d-d25ebf0e18a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aee17c3b800432e8b8e7f10041c038b, user_id=fb62ab13dbaf404ebb0a30cfd1053f42, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:45.010556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30934a-aac8-4c8a-870d-d25ebf0e18a1 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:45.087796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 940/1886] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:44 2022] PUT /identity/v3/projects/3aee17c3b800432e8b8e7f10041c038b/users/fb62ab13dbaf404ebb0a30cfd1053f42/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:45.092820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b42e-e828-4b0e-9c24-78bb7975ad99 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:45.093231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b42e-e828-4b0e-9c24-78bb7975ad99 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:45.093602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b42e-e828-4b0e-9c24-78bb7975ad99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:45.115633 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-5624b42e-e828-4b0e-9c24-78bb7975ad99 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:45.116970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5624b42e-e828-4b0e-9c24-78bb7975ad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:45.185506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 947/1887] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:45.206306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30934a-aac8-4c8a-870d-d25ebf0e18a1 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:45.206306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fe30934a-aac8-4c8a-870d-d25ebf0e18a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:45.276661 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624b42e-e828-4b0e-9c24-78bb7975ad99 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:45.278629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5624b42e-e828-4b0e-9c24-78bb7975ad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:45.291965 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624b42e-e828-4b0e-9c24-78bb7975ad99 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:45.298324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f743136-4409-4893-93dd-272ab265f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:45.299412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30934a-aac8-4c8a-870d-d25ebf0e18a1 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:45.305398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f743136-4409-4893-93dd-272ab265f944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:45.305398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f743136-4409-4893-93dd-272ab265f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:45.305398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f743136-4409-4893-93dd-272ab265f944 admin admin] PATH_INFO: `/v3/projects/f55c2e4d235d489094779f04eb5a5f90` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:45.307244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f743136-4409-4893-93dd-272ab265f944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f55c2e4d235d489094779f04eb5a5f90)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:45.310224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f743136-4409-4893-93dd-272ab265f944 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:45.316334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d70fd-ef36-48a4-a35a-7a68964cbd6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:45.317252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d70fd-ef36-48a4-a35a-7a68964cbd6e service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:45.317773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d70fd-ef36-48a4-a35a-7a68964cbd6e service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:45.318481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d70fd-ef36-48a4-a35a-7a68964cbd6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:45.338458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d70fd-ef36-48a4-a35a-7a68964cbd6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:45.340165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d70fd-ef36-48a4-a35a-7a68964cbd6e service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:45.354547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 941/1888] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:45.497151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0f743136-4409-4893-93dd-272ab265f944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f55c2e4d235d489094779f04eb5a5f90', 'request_id': 'req-0f743136-4409-4893-93dd-272ab265f944'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:45.611008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0f743136-4409-4893-93dd-272ab265f944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f55c2e4d235d489094779f04eb5a5f90', 'request_id': 'req-0f743136-4409-4893-93dd-272ab265f944'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:45.619824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0f743136-4409-4893-93dd-272ab265f944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f55c2e4d235d489094779f04eb5a5f90', 'request_id': 'req-0f743136-4409-4893-93dd-272ab265f944'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:45.632912 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0f743136-4409-4893-93dd-272ab265f944 admin admin] The token cache is being invalidate because project f55c2e4d235d489094779f04eb5a5f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:45.633621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0f743136-4409-4893-93dd-272ab265f944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:45.634672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0f743136-4409-4893-93dd-272ab265f944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:45.636410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 948/1889] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:45 2022] DELETE /identity/v3/projects/f55c2e4d235d489094779f04eb5a5f90 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:45.641768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be73e0-1f6b-4b90-93bd-fedddc1951a5 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:45.642120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be73e0-1f6b-4b90-93bd-fedddc1951a5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:45.642775 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be73e0-1f6b-4b90-93bd-fedddc1951a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:45.662508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-74be73e0-1f6b-4b90-93bd-fedddc1951a5 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:45.663764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-74be73e0-1f6b-4b90-93bd-fedddc1951a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:45.738766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 942/1890] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:45.741106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63696-5162-4dac-95a0-55ab60713aa3 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:45.741424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63696-5162-4dac-95a0-55ab60713aa3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:45.741702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63696-5162-4dac-95a0-55ab60713aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:45.761968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-cec63696-5162-4dac-95a0-55ab60713aa3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:45.763190 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-cec63696-5162-4dac-95a0-55ab60713aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:45.772453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:45.776346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 949/1891] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:45.782010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be73e0-1f6b-4b90-93bd-fedddc1951a5 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:45.792994 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be73e0-1f6b-4b90-93bd-fedddc1951a5 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:45.797942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14e623-6a45-46d5-bbc6-f7f60eb6cf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:45.798632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14e623-6a45-46d5-bbc6-f7f60eb6cf2a admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:45.799508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14e623-6a45-46d5-bbc6-f7f60eb6cf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:45.799780 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14e623-6a45-46d5-bbc6-f7f60eb6cf2a admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:45.800650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14e623-6a45-46d5-bbc6-f7f60eb6cf2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:00:45.800834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14e623-6a45-46d5-bbc6-f7f60eb6cf2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:45.802588 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14e623-6a45-46d5-bbc6-f7f60eb6cf2a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:45.817948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 943/1892] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:00:45.820459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec63696-5162-4dac-95a0-55ab60713aa3 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:45.834330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec63696-5162-4dac-95a0-55ab60713aa3 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:45.851739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78c20-fccf-4539-b587-c66024072e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:45.851739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78c20-fccf-4539-b587-c66024072e11 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:45.852158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78c20-fccf-4539-b587-c66024072e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:45.852495 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78c20-fccf-4539-b587-c66024072e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:45.853498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c78c20-fccf-4539-b587-c66024072e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:45.857581 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c78c20-fccf-4539-b587-c66024072e11 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:45.992070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 950/1893] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:45 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:45.996341 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14e623-6a45-46d5-bbc6-f7f60eb6cf2a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:46.007040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14e623-6a45-46d5-bbc6-f7f60eb6cf2a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:46.095428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d6de4-0f48-4dcc-90ed-1cbc2412a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:46.096834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d6de4-0f48-4dcc-90ed-1cbc2412a4cb admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:46.097131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d6de4-0f48-4dcc-90ed-1cbc2412a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:46.097471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d6de4-0f48-4dcc-90ed-1cbc2412a4cb admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:46.098313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d6de4-0f48-4dcc-90ed-1cbc2412a4cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:46.100285 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d6de4-0f48-4dcc-90ed-1cbc2412a4cb admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:46.129409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:46.193746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 944/1894] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:45 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:46.197331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78c20-fccf-4539-b587-c66024072e11 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:46.209707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78c20-fccf-4539-b587-c66024072e11 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:46.214802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbde5b-a03d-4ccc-961d-79ed3e4971ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:46.215569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbde5b-a03d-4ccc-961d-79ed3e4971ac admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:46.215962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbde5b-a03d-4ccc-961d-79ed3e4971ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:46.216467 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbde5b-a03d-4ccc-961d-79ed3e4971ac admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:46.217345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbde5b-a03d-4ccc-961d-79ed3e4971ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:46.219085 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbde5b-a03d-4ccc-961d-79ed3e4971ac admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:46.243638 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 951/1895] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:46.248213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d6de4-0f48-4dcc-90ed-1cbc2412a4cb admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:46.264591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d6de4-0f48-4dcc-90ed-1cbc2412a4cb admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:46.272616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd60a6a-2792-4f16-bcc1-e55adf4e8e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:46.273481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd60a6a-2792-4f16-bcc1-e55adf4e8e88 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:46.274091 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd60a6a-2792-4f16-bcc1-e55adf4e8e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:46.274286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd60a6a-2792-4f16-bcc1-e55adf4e8e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:46.275556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd60a6a-2792-4f16-bcc1-e55adf4e8e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:46.277977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd60a6a-2792-4f16-bcc1-e55adf4e8e88 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:46.332337 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbde5b-a03d-4ccc-961d-79ed3e4971ac admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:46.343244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 945/1896] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:46.349230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbde5b-a03d-4ccc-961d-79ed3e4971ac admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:46.367650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbb9cc-3f00-47b0-884c-3a5261d2e110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:46.371888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbb9cc-3f00-47b0-884c-3a5261d2e110 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:46.371888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbb9cc-3f00-47b0-884c-3a5261d2e110 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:46.371888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbb9cc-3f00-47b0-884c-3a5261d2e110 admin admin] PATH_INFO: `/v3/projects/84e1b323e0c14946a15adf2e1dd91004/users/66b1cbbba29e4719ab346f1097ce6dce/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:46.407592 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbb9cc-3f00-47b0-884c-3a5261d2e110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e1b323e0c14946a15adf2e1dd91004, user_id=66b1cbbba29e4719ab346f1097ce6dce, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:46.410792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbb9cc-3f00-47b0-884c-3a5261d2e110 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:46.516778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 952/1897] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:46 2022] PUT /identity/v3/projects/84e1b323e0c14946a15adf2e1dd91004/users/66b1cbbba29e4719ab346f1097ce6dce/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:46.527754 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8699535-715d-4241-92a9-3597217844da None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:46.528045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8699535-715d-4241-92a9-3597217844da None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:46.528349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8699535-715d-4241-92a9-3597217844da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:46.558425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b8699535-715d-4241-92a9-3597217844da None None] MFA Rules not processed for user `66b1cbbba29e4719ab346f1097ce6dce`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:46.559654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b8699535-715d-4241-92a9-3597217844da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:46.675332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 946/1898] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:46.679613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbb9cc-3f00-47b0-884c-3a5261d2e110 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:46.779178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbb9cc-3f00-47b0-884c-3a5261d2e110 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:46.785534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05665abe-2e00-4cb1-9162-9f08e2fbc0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:46.786794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05665abe-2e00-4cb1-9162-9f08e2fbc0a0 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:46.787265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05665abe-2e00-4cb1-9162-9f08e2fbc0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:46.787774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05665abe-2e00-4cb1-9162-9f08e2fbc0a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:46.788697 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05665abe-2e00-4cb1-9162-9f08e2fbc0a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:46.791151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05665abe-2e00-4cb1-9162-9f08e2fbc0a0 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:46.931986 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 953/1899] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:46 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:46.936291 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8699535-715d-4241-92a9-3597217844da None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:46.947509 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8699535-715d-4241-92a9-3597217844da None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:47.010087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da010cf-e0b9-4fa3-bca0-2299304c2665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:47.010801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da010cf-e0b9-4fa3-bca0-2299304c2665 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:47.011088 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da010cf-e0b9-4fa3-bca0-2299304c2665 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:47.011376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da010cf-e0b9-4fa3-bca0-2299304c2665 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:47.012166 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da010cf-e0b9-4fa3-bca0-2299304c2665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:47.014312 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da010cf-e0b9-4fa3-bca0-2299304c2665 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:47.085858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 947/1900] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:46 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:47.090127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05665abe-2e00-4cb1-9162-9f08e2fbc0a0 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:47.102565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05665abe-2e00-4cb1-9162-9f08e2fbc0a0 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:47.120258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25183aa4-1184-4174-a595-e56e631fd19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:47.121107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25183aa4-1184-4174-a595-e56e631fd19f admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:47.121660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25183aa4-1184-4174-a595-e56e631fd19f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:47.125605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25183aa4-1184-4174-a595-e56e631fd19f admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:47.125605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25183aa4-1184-4174-a595-e56e631fd19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:47.125605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25183aa4-1184-4174-a595-e56e631fd19f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:47.139638 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 954/1901] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:47.146277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da010cf-e0b9-4fa3-bca0-2299304c2665 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:47.168729 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da010cf-e0b9-4fa3-bca0-2299304c2665 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:47.187933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe8f17-7242-4c33-bfd5-236b5e6200fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:47.190346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8f17-7242-4c33-bfd5-236b5e6200fa admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:47.190638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8f17-7242-4c33-bfd5-236b5e6200fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:47.194739 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8f17-7242-4c33-bfd5-236b5e6200fa admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:47.195823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe8f17-7242-4c33-bfd5-236b5e6200fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:47.198066 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe8f17-7242-4c33-bfd5-236b5e6200fa admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:47.218311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 948/1902] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:47.219828 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25183aa4-1184-4174-a595-e56e631fd19f admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:47.232224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25183aa4-1184-4174-a595-e56e631fd19f admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:47.237756 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe058e4-5313-4e77-8e46-d75967083d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:47.238712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe058e4-5313-4e77-8e46-d75967083d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:47.239000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe058e4-5313-4e77-8e46-d75967083d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:47.239280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe058e4-5313-4e77-8e46-d75967083d8d admin admin] PATH_INFO: `/v3/projects/9d3e3405adf24251afbb697e6607fb92/users/f731b9b9113f43498c80ad6c814c620b/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:47.261090 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe058e4-5313-4e77-8e46-d75967083d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3e3405adf24251afbb697e6607fb92, user_id=f731b9b9113f43498c80ad6c814c620b, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:47.264679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe058e4-5313-4e77-8e46-d75967083d8d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:47.377795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 955/1903] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:47 2022] PUT /identity/v3/projects/9d3e3405adf24251afbb697e6607fb92/users/f731b9b9113f43498c80ad6c814c620b/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:47.390329 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3899fd-e6eb-43ec-b4b0-5e6faedd1ca6 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:47.390621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3899fd-e6eb-43ec-b4b0-5e6faedd1ca6 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:47.391298 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3899fd-e6eb-43ec-b4b0-5e6faedd1ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:47.476578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-fd3899fd-e6eb-43ec-b4b0-5e6faedd1ca6 None None] MFA Rules not processed for user `f731b9b9113f43498c80ad6c814c620b`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:47.478393 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fd3899fd-e6eb-43ec-b4b0-5e6faedd1ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:47.592776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 949/1904] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:47.593671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe058e4-5313-4e77-8e46-d75967083d8d admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:47.684472 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe058e4-5313-4e77-8e46-d75967083d8d admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:47.693209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9899e32-ccfe-40d7-af9b-3db3a72e531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:47.698750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9899e32-ccfe-40d7-af9b-3db3a72e531b admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:47.698750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9899e32-ccfe-40d7-af9b-3db3a72e531b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:47.698750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9899e32-ccfe-40d7-af9b-3db3a72e531b admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:47.698750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9899e32-ccfe-40d7-af9b-3db3a72e531b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:47.710025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9899e32-ccfe-40d7-af9b-3db3a72e531b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:47.715852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78579e1-9afb-4ab7-9c23-ec29b5aa5c11 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:47.716333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78579e1-9afb-4ab7-9c23-ec29b5aa5c11 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:47.716693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78579e1-9afb-4ab7-9c23-ec29b5aa5c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:47.772867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-f78579e1-9afb-4ab7-9c23-ec29b5aa5c11 None None] MFA Rules not processed for user `fb62ab13dbaf404ebb0a30cfd1053f42`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:47.772867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f78579e1-9afb-4ab7-9c23-ec29b5aa5c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:47.822935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 956/1905] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:47 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:47.827485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9899e32-ccfe-40d7-af9b-3db3a72e531b admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:47.862823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 950/1906] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:47.868789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78579e1-9afb-4ab7-9c23-ec29b5aa5c11 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:47.870751 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f78579e1-9afb-4ab7-9c23-ec29b5aa5c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:47.890786 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78579e1-9afb-4ab7-9c23-ec29b5aa5c11 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:47.919783 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9899e32-ccfe-40d7-af9b-3db3a72e531b admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:47.927235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8339a-c13b-46ec-96d3-272554518442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:47.928218 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8339a-c13b-46ec-96d3-272554518442 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:47.929136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8339a-c13b-46ec-96d3-272554518442 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:47.929919 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8339a-c13b-46ec-96d3-272554518442 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:47.930880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8339a-c13b-46ec-96d3-272554518442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:47.933222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8339a-c13b-46ec-96d3-272554518442 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:47.968545 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae5c02-132a-4116-ac11-5ca1233c5cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:47.969225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae5c02-132a-4116-ac11-5ca1233c5cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:47.969548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae5c02-132a-4116-ac11-5ca1233c5cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:47.969830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae5c02-132a-4116-ac11-5ca1233c5cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:47.971063 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae5c02-132a-4116-ac11-5ca1233c5cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:47.972996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae5c02-132a-4116-ac11-5ca1233c5cd9 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:48.056547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 957/1907] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:47 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:48.060482 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8339a-c13b-46ec-96d3-272554518442 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:48.070906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8339a-c13b-46ec-96d3-272554518442 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:48.075912 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279994d-a681-4851-b0ed-e7002ff2130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:48.076664 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279994d-a681-4851-b0ed-e7002ff2130b admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:48.077022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279994d-a681-4851-b0ed-e7002ff2130b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:48.077370 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279994d-a681-4851-b0ed-e7002ff2130b admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:48.078228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279994d-a681-4851-b0ed-e7002ff2130b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:48.080036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279994d-a681-4851-b0ed-e7002ff2130b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:48.091718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 958/1908] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:48.096450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279994d-a681-4851-b0ed-e7002ff2130b admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:48.109834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279994d-a681-4851-b0ed-e7002ff2130b admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:48.116409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 951/1909] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:47 2022] POST /identity/v3/projects => generated 371 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:48.116575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550806e-616c-4904-9077-318de0e44df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:48.117423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae5c02-132a-4116-ac11-5ca1233c5cd9 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:48.117555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550806e-616c-4904-9077-318de0e44df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:48.117809 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550806e-616c-4904-9077-318de0e44df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:48.117978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550806e-616c-4904-9077-318de0e44df2 admin admin] PATH_INFO: `/v3/projects/4caac297f3f140c889beb0255b8c5e70/users/e7ec82f8135b40718ed089bc8fa3b766/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:48.140366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550806e-616c-4904-9077-318de0e44df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4caac297f3f140c889beb0255b8c5e70, user_id=e7ec82f8135b40718ed089bc8fa3b766, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:48.144075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550806e-616c-4904-9077-318de0e44df2 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:48.263512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae5c02-132a-4116-ac11-5ca1233c5cd9 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:48.263512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be799d1-61e3-4a52-9a60-a47b782fd557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:48.263512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be799d1-61e3-4a52-9a60-a47b782fd557 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:48.263512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be799d1-61e3-4a52-9a60-a47b782fd557 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:48.264762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be799d1-61e3-4a52-9a60-a47b782fd557 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:48.264762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be799d1-61e3-4a52-9a60-a47b782fd557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:48.264762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be799d1-61e3-4a52-9a60-a47b782fd557 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:48.572248 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 959/1910] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:48 2022] PUT /identity/v3/projects/4caac297f3f140c889beb0255b8c5e70/users/e7ec82f8135b40718ed089bc8fa3b766/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:48.591597 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 952/1911] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:48 2022] POST /identity/v3/users => generated 292 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:48.592082 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550806e-616c-4904-9077-318de0e44df2 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:48.592826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be799d1-61e3-4a52-9a60-a47b782fd557 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:48.610381 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be799d1-61e3-4a52-9a60-a47b782fd557 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:48.681934 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550806e-616c-4904-9077-318de0e44df2 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:48.686103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4990d2-f710-494d-8666-ea76485ae4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:48.686800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4990d2-f710-494d-8666-ea76485ae4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:48.687138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4990d2-f710-494d-8666-ea76485ae4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:48.687418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4990d2-f710-494d-8666-ea76485ae4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:48.688213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4990d2-f710-494d-8666-ea76485ae4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:48.688371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666449ab-a331-4266-886f-74feb5567e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:48.689045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666449ab-a331-4266-886f-74feb5567e3a admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:48.689911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666449ab-a331-4266-886f-74feb5567e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:48.690192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666449ab-a331-4266-886f-74feb5567e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:48.690419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4990d2-f710-494d-8666-ea76485ae4f1 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:48.691014 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666449ab-a331-4266-886f-74feb5567e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:48.692612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666449ab-a331-4266-886f-74feb5567e3a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:48.704842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 953/1912] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:48.705738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 960/1913] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:48.707073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4990d2-f710-494d-8666-ea76485ae4f1 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:48.709034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666449ab-a331-4266-886f-74feb5567e3a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:48.717841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4990d2-f710-494d-8666-ea76485ae4f1 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:48.721063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666449ab-a331-4266-886f-74feb5567e3a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:48.723297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030342e-33b3-41c6-97e5-cb4c4576ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:48.724327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030342e-33b3-41c6-97e5-cb4c4576ace8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:48.724666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030342e-33b3-41c6-97e5-cb4c4576ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:48.725024 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030342e-33b3-41c6-97e5-cb4c4576ace8 admin admin] PATH_INFO: `/v3/projects/9e99212d3cc649eeb8b27c7473502914/users/632970735da349ea97fad171b5b431dc/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:48.728660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c0646-13ae-4304-91ca-3e18684e6703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:48.729952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c0646-13ae-4304-91ca-3e18684e6703 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:48.730296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c0646-13ae-4304-91ca-3e18684e6703 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:48.730743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c0646-13ae-4304-91ca-3e18684e6703 admin admin] PATH_INFO: `/v3/projects/4caac297f3f140c889beb0255b8c5e70/users/e7ec82f8135b40718ed089bc8fa3b766/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:48.732941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c0646-13ae-4304-91ca-3e18684e6703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4caac297f3f140c889beb0255b8c5e70, user_id=e7ec82f8135b40718ed089bc8fa3b766, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:48.736548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c0646-13ae-4304-91ca-3e18684e6703 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:48.743945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030342e-33b3-41c6-97e5-cb4c4576ace8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e99212d3cc649eeb8b27c7473502914, user_id=632970735da349ea97fad171b5b431dc, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:48.746852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030342e-33b3-41c6-97e5-cb4c4576ace8 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:48.750201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 961/1914] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:48 2022] PUT /identity/v3/projects/4caac297f3f140c889beb0255b8c5e70/users/e7ec82f8135b40718ed089bc8fa3b766/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:48.765490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8a35f-3a08-4c72-ad30-f6e686acc1b2 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:48.765832 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8a35f-3a08-4c72-ad30-f6e686acc1b2 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:48.766118 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8a35f-3a08-4c72-ad30-f6e686acc1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:48.787622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:48.796411 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-c8f8a35f-3a08-4c72-ad30-f6e686acc1b2 None None] MFA Rules not processed for user `e7ec82f8135b40718ed089bc8fa3b766`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:48.797707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c8f8a35f-3a08-4c72-ad30-f6e686acc1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:48.888519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 954/1915] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:48 2022] PUT /identity/v3/projects/9e99212d3cc649eeb8b27c7473502914/users/632970735da349ea97fad171b5b431dc/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:48.893044 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030342e-33b3-41c6-97e5-cb4c4576ace8 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:48.901564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 962/1916] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:48.913511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8a35f-3a08-4c72-ad30-f6e686acc1b2 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:48.915354 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c8f8a35f-3a08-4c72-ad30-f6e686acc1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:48.995386 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8a35f-3a08-4c72-ad30-f6e686acc1b2 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:49.054451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030342e-33b3-41c6-97e5-cb4c4576ace8 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:49.074502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c345458-c67f-444f-8ab4-4dfbc68bff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:49.075201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c345458-c67f-444f-8ab4-4dfbc68bff63 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:49.075485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c345458-c67f-444f-8ab4-4dfbc68bff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:49.075780 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c345458-c67f-444f-8ab4-4dfbc68bff63 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:49.076595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c345458-c67f-444f-8ab4-4dfbc68bff63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:49.078198 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c345458-c67f-444f-8ab4-4dfbc68bff63 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:49.097072 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 955/1917] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:49.100069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75f145-7edb-4736-86c6-324360f80027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:49.100748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f145-7edb-4736-86c6-324360f80027 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:49.101827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f145-7edb-4736-86c6-324360f80027 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:49.102115 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75f145-7edb-4736-86c6-324360f80027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:49.105138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c345458-c67f-444f-8ab4-4dfbc68bff63 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:49.107081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0c345458-c67f-444f-8ab4-4dfbc68bff63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:49.124460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c345458-c67f-444f-8ab4-4dfbc68bff63 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:49.132310 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:49.133534 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:49.134029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:49.134622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] PATH_INFO: `/v3/users/37c9b439aaea453a90934cf9f9a3d2a6` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:49.136217 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c9b439aaea453a90934cf9f9a3d2a6)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:49.138629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:49.197566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75f145-7edb-4736-86c6-324360f80027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:49.197566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75f145-7edb-4736-86c6-324360f80027 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:49.211664 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 963/1918] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:00:49.214335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75f145-7edb-4736-86c6-324360f80027 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:49.232382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75f145-7edb-4736-86c6-324360f80027 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:49.239641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c622e-5bb0-4cd9-9ac1-1fc7b5bc2de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:49.240685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c622e-5bb0-4cd9-9ac1-1fc7b5bc2de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:49.242017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c622e-5bb0-4cd9-9ac1-1fc7b5bc2de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:49.242400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c622e-5bb0-4cd9-9ac1-1fc7b5bc2de9 admin admin] PATH_INFO: `/v3/projects/9e99212d3cc649eeb8b27c7473502914/users/632970735da349ea97fad171b5b431dc/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:49.244813 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c622e-5bb0-4cd9-9ac1-1fc7b5bc2de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e99212d3cc649eeb8b27c7473502914, user_id=632970735da349ea97fad171b5b431dc, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:49.249392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c622e-5bb0-4cd9-9ac1-1fc7b5bc2de9 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:49.275992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 964/1919] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:49 2022] PUT /identity/v3/projects/9e99212d3cc649eeb8b27c7473502914/users/632970735da349ea97fad171b5b431dc/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:49.422490 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c9b439aaea453a90934cf9f9a3d2a6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:49.473084 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:49.580931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c9b439aaea453a90934cf9f9a3d2a6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:49.581679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c9b439aaea453a90934cf9f9a3d2a6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:49.589554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c9b439aaea453a90934cf9f9a3d2a6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:49.590977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c9b439aaea453a90934cf9f9a3d2a6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:49.619687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 956/1920] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:49 2022] DELETE /identity/v3/users/37c9b439aaea453a90934cf9f9a3d2a6 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:49.624443 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42086698-f879-4570-963f-41de9aed1048 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:49.624765 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42086698-f879-4570-963f-41de9aed1048 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:49.625048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42086698-f879-4570-963f-41de9aed1048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:49.650252 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-42086698-f879-4570-963f-41de9aed1048 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:49.651505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-42086698-f879-4570-963f-41de9aed1048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:49.753921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 965/1921] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:49.770085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:49.771855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:49.854587 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4db8d-9327-4b6b-90f1-cf45ef9770bd admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:49.861642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10828902-8d0b-4e2a-be90-63e62dbdc445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:49.862338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10828902-8d0b-4e2a-be90-63e62dbdc445 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:49.862626 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10828902-8d0b-4e2a-be90-63e62dbdc445 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:49.862903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10828902-8d0b-4e2a-be90-63e62dbdc445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:49.873489 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10828902-8d0b-4e2a-be90-63e62dbdc445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:49.874934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10828902-8d0b-4e2a-be90-63e62dbdc445 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:49.884963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 957/1922] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:50.678352 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42086698-f879-4570-963f-41de9aed1048 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:50.680122 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-42086698-f879-4570-963f-41de9aed1048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:50.693474 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42086698-f879-4570-963f-41de9aed1048 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:50.699078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bf9cd-513c-41e4-9bea-64635c1eb9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:50.700075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bf9cd-513c-41e4-9bea-64635c1eb9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:50.700359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bf9cd-513c-41e4-9bea-64635c1eb9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:50.700624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bf9cd-513c-41e4-9bea-64635c1eb9cd admin admin] PATH_INFO: `/v3/projects/7742b72a8c084c14ac4cf35f474254ed` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:50.702318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bf9cd-513c-41e4-9bea-64635c1eb9cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7742b72a8c084c14ac4cf35f474254ed)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:50.704580 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bf9cd-513c-41e4-9bea-64635c1eb9cd admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:50.832861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-888bf9cd-513c-41e4-9bea-64635c1eb9cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7742b72a8c084c14ac4cf35f474254ed', 'request_id': 'req-888bf9cd-513c-41e4-9bea-64635c1eb9cd'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:50.912453 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-888bf9cd-513c-41e4-9bea-64635c1eb9cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7742b72a8c084c14ac4cf35f474254ed', 'request_id': 'req-888bf9cd-513c-41e4-9bea-64635c1eb9cd'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:50.920308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-888bf9cd-513c-41e4-9bea-64635c1eb9cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7742b72a8c084c14ac4cf35f474254ed', 'request_id': 'req-888bf9cd-513c-41e4-9bea-64635c1eb9cd'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:50.933471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-888bf9cd-513c-41e4-9bea-64635c1eb9cd admin admin] The token cache is being invalidate because project 7742b72a8c084c14ac4cf35f474254ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:50.934034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-888bf9cd-513c-41e4-9bea-64635c1eb9cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:50.934900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-888bf9cd-513c-41e4-9bea-64635c1eb9cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:50.937096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 966/1923] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:50 2022] DELETE /identity/v3/projects/7742b72a8c084c14ac4cf35f474254ed => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:50.941338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10828902-8d0b-4e2a-be90-63e62dbdc445 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:50.951857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10828902-8d0b-4e2a-be90-63e62dbdc445 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:51.013357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5c24b-cf6e-43af-8d12-72ff45f30b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:51.014346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c24b-cf6e-43af-8d12-72ff45f30b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:51.014628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c24b-cf6e-43af-8d12-72ff45f30b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:51.014910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c24b-cf6e-43af-8d12-72ff45f30b8b admin admin] PATH_INFO: `/v3/users/e2075288596c41c8bbb28434479daa2d` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:51.016120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5c24b-cf6e-43af-8d12-72ff45f30b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2075288596c41c8bbb28434479daa2d)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:51.018114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5c24b-cf6e-43af-8d12-72ff45f30b8b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:51.130528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:51.176200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652aa25-bfe5-4696-9e8f-6b6182a34b3f None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:51.176200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652aa25-bfe5-4696-9e8f-6b6182a34b3f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:51.176415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652aa25-bfe5-4696-9e8f-6b6182a34b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:51.245913 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-d652aa25-bfe5-4696-9e8f-6b6182a34b3f None None] MFA Rules not processed for user `632970735da349ea97fad171b5b431dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:51.247807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d652aa25-bfe5-4696-9e8f-6b6182a34b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:51.269016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c2e5c24b-cf6e-43af-8d12-72ff45f30b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2075288596c41c8bbb28434479daa2d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:51.352849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c2e5c24b-cf6e-43af-8d12-72ff45f30b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2075288596c41c8bbb28434479daa2d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:51.354194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c2e5c24b-cf6e-43af-8d12-72ff45f30b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2075288596c41c8bbb28434479daa2d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:51.365939 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c2e5c24b-cf6e-43af-8d12-72ff45f30b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2075288596c41c8bbb28434479daa2d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:51.367821 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c2e5c24b-cf6e-43af-8d12-72ff45f30b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2075288596c41c8bbb28434479daa2d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:51.394202 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 958/1924] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:50 2022] DELETE /identity/v3/users/e2075288596c41c8bbb28434479daa2d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:51.400458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 967/1925] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:51.413073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa7bc6-4a53-4fcb-9f76-9f97f79688cd None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:51.418399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa7bc6-4a53-4fcb-9f76-9f97f79688cd None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:51.418399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa7bc6-4a53-4fcb-9f76-9f97f79688cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:51.437857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-cbfa7bc6-4a53-4fcb-9f76-9f97f79688cd None None] MFA Rules not processed for user `fb62ab13dbaf404ebb0a30cfd1053f42`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:51.440925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cbfa7bc6-4a53-4fcb-9f76-9f97f79688cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:51.510704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 959/1926] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:51.525498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652aa25-bfe5-4696-9e8f-6b6182a34b3f None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:51.529457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d652aa25-bfe5-4696-9e8f-6b6182a34b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:51.613684 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652aa25-bfe5-4696-9e8f-6b6182a34b3f None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:51.716703 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41555970-e2c6-4b55-a873-a5c650f04d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:51.717643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555970-e2c6-4b55-a873-a5c650f04d86 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:51.718080 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555970-e2c6-4b55-a873-a5c650f04d86 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:51.718541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555970-e2c6-4b55-a873-a5c650f04d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:51.724353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-41555970-e2c6-4b55-a873-a5c650f04d86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:51.734389 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41555970-e2c6-4b55-a873-a5c650f04d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:51.736535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41555970-e2c6-4b55-a873-a5c650f04d86 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:51.761575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 968/1927] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:51.813093 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa7bc6-4a53-4fcb-9f76-9f97f79688cd None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:51.815632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cbfa7bc6-4a53-4fcb-9f76-9f97f79688cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:51.912021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa7bc6-4a53-4fcb-9f76-9f97f79688cd None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:51.917068 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce694d7-9a4a-4d9c-b3c4-44cd7b614f74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:51.917068 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce694d7-9a4a-4d9c-b3c4-44cd7b614f74 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:51.917068 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce694d7-9a4a-4d9c-b3c4-44cd7b614f74 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:51.917329 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce694d7-9a4a-4d9c-b3c4-44cd7b614f74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:51.929186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5ce694d7-9a4a-4d9c-b3c4-44cd7b614f74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:51.996056 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41555970-e2c6-4b55-a873-a5c650f04d86 service nova] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:51.998416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-41555970-e2c6-4b55-a873-a5c650f04d86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:52.021743 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce694d7-9a4a-4d9c-b3c4-44cd7b614f74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:52.023399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce694d7-9a4a-4d9c-b3c4-44cd7b614f74 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:52.041479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 960/1928] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:52.065442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:52.135087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41555970-e2c6-4b55-a873-a5c650f04d86 service nova] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:52.140935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89311e86-3949-42c3-bac8-90a466c90835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:52.142154 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89311e86-3949-42c3-bac8-90a466c90835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:52.142468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89311e86-3949-42c3-bac8-90a466c90835 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:52.143092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89311e86-3949-42c3-bac8-90a466c90835 admin admin] PATH_INFO: `/v3/projects/75be38fd6e0c4583b40ba6f122ab30c9` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:52.144902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89311e86-3949-42c3-bac8-90a466c90835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75be38fd6e0c4583b40ba6f122ab30c9)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:52.149066 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89311e86-3949-42c3-bac8-90a466c90835 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:52.261330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:52.314781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-89311e86-3949-42c3-bac8-90a466c90835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75be38fd6e0c4583b40ba6f122ab30c9', 'request_id': 'req-89311e86-3949-42c3-bac8-90a466c90835'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:52.438508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-89311e86-3949-42c3-bac8-90a466c90835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75be38fd6e0c4583b40ba6f122ab30c9', 'request_id': 'req-89311e86-3949-42c3-bac8-90a466c90835'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:52.445325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-89311e86-3949-42c3-bac8-90a466c90835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75be38fd6e0c4583b40ba6f122ab30c9', 'request_id': 'req-89311e86-3949-42c3-bac8-90a466c90835'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:52.457357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-89311e86-3949-42c3-bac8-90a466c90835 admin admin] The token cache is being invalidate because project 75be38fd6e0c4583b40ba6f122ab30c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:52.457673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-89311e86-3949-42c3-bac8-90a466c90835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:52.458345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-89311e86-3949-42c3-bac8-90a466c90835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:52.460213 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 969/1929] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:51 2022] DELETE /identity/v3/projects/75be38fd6e0c4583b40ba6f122ab30c9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:52.465008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017ee57-9e4e-4954-b863-d25597df0628 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:52.465838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017ee57-9e4e-4954-b863-d25597df0628 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:52.466122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017ee57-9e4e-4954-b863-d25597df0628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:52.485124 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7017ee57-9e4e-4954-b863-d25597df0628 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:52.487154 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7017ee57-9e4e-4954-b863-d25597df0628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:52.593220 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 961/1930] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:52.601327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163aec4-2f38-49f3-a3a4-f388e5ccb94d None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:52.601673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163aec4-2f38-49f3-a3a4-f388e5ccb94d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:52.602216 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163aec4-2f38-49f3-a3a4-f388e5ccb94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:52.626835 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-0163aec4-2f38-49f3-a3a4-f388e5ccb94d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:52.628270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0163aec4-2f38-49f3-a3a4-f388e5ccb94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:52.639488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 970/1931] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:52.649229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017ee57-9e4e-4954-b863-d25597df0628 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:52.676762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017ee57-9e4e-4954-b863-d25597df0628 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:52.679026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a32a95-c077-4478-92f8-a7ac2de82e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:52.679748 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a32a95-c077-4478-92f8-a7ac2de82e78 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:52.679969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a32a95-c077-4478-92f8-a7ac2de82e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:52.680513 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a32a95-c077-4478-92f8-a7ac2de82e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:52.681326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a32a95-c077-4478-92f8-a7ac2de82e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:00:52.681579 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a32a95-c077-4478-92f8-a7ac2de82e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:52.683243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a32a95-c077-4478-92f8-a7ac2de82e78 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:52.697338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 962/1932] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:00:52.701663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163aec4-2f38-49f3-a3a4-f388e5ccb94d None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:52.712033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163aec4-2f38-49f3-a3a4-f388e5ccb94d None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:52.716854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a0e81-b183-4056-878e-c3f6d77cf9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:52.717880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0e81-b183-4056-878e-c3f6d77cf9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:52.718326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0e81-b183-4056-878e-c3f6d77cf9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:52.718680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0e81-b183-4056-878e-c3f6d77cf9a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:52.719429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a0e81-b183-4056-878e-c3f6d77cf9a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:52.722073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a0e81-b183-4056-878e-c3f6d77cf9a6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:52.854151 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a32a95-c077-4478-92f8-a7ac2de82e78 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:52.856494 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-07a32a95-c077-4478-92f8-a7ac2de82e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:52.865716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 971/1933] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:52 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:52.870822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a0e81-b183-4056-878e-c3f6d77cf9a6 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:52.876142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a32a95-c077-4478-92f8-a7ac2de82e78 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:52.938705 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a0e81-b183-4056-878e-c3f6d77cf9a6 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:52.943248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:52.943601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4a890-158f-4e73-bef9-405c5aadff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:52.944184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:52.944471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4a890-158f-4e73-bef9-405c5aadff90 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:52.944576 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:52.944703 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4a890-158f-4e73-bef9-405c5aadff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:52.944843 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] PATH_INFO: `/v3/users/b50590f1e051490cb6927ca0d33567f2` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:52.945646 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4a890-158f-4e73-bef9-405c5aadff90 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:52.946029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b50590f1e051490cb6927ca0d33567f2)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:52.946747 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4a890-158f-4e73-bef9-405c5aadff90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:52.947958 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:52.948647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4a890-158f-4e73-bef9-405c5aadff90 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:53.066407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 972/1934] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:52 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:53.070564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4a890-158f-4e73-bef9-405c5aadff90 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:53.082077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4a890-158f-4e73-bef9-405c5aadff90 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:53.087885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebd23b-f168-4a42-994d-78aa0014cbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:53.088740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebd23b-f168-4a42-994d-78aa0014cbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:53.089030 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebd23b-f168-4a42-994d-78aa0014cbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:53.089312 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebd23b-f168-4a42-994d-78aa0014cbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:53.092427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebd23b-f168-4a42-994d-78aa0014cbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:53.092427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebd23b-f168-4a42-994d-78aa0014cbb3 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:53.105548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 973/1935] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:53.106645 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebd23b-f168-4a42-994d-78aa0014cbb3 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:53.116658 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebd23b-f168-4a42-994d-78aa0014cbb3 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:53.121542 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d941288-ca16-4826-b3cd-ef49c1360201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:53.122560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941288-ca16-4826-b3cd-ef49c1360201 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:53.123028 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941288-ca16-4826-b3cd-ef49c1360201 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:53.123313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941288-ca16-4826-b3cd-ef49c1360201 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:53.124039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d941288-ca16-4826-b3cd-ef49c1360201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:53.125716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d941288-ca16-4826-b3cd-ef49c1360201 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:53.136504 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 974/1936] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:53.140591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d941288-ca16-4826-b3cd-ef49c1360201 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:53.151211 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d941288-ca16-4826-b3cd-ef49c1360201 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:53.155717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79ced0-a64a-4dff-bb2b-42314afffd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:53.156569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79ced0-a64a-4dff-bb2b-42314afffd4c admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:53.156850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79ced0-a64a-4dff-bb2b-42314afffd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:53.157127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79ced0-a64a-4dff-bb2b-42314afffd4c admin admin] PATH_INFO: `/v3/projects/78923669fdc94a73a958fef272c604d6/users/492e921a928b40b7b67b010a0c3b5307/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:53.171358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79ced0-a64a-4dff-bb2b-42314afffd4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78923669fdc94a73a958fef272c604d6, user_id=492e921a928b40b7b67b010a0c3b5307, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:53.174176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79ced0-a64a-4dff-bb2b-42314afffd4c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:53.207744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b50590f1e051490cb6927ca0d33567f2'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:53.283952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 975/1937] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:53 2022] PUT /identity/v3/projects/78923669fdc94a73a958fef272c604d6/users/492e921a928b40b7b67b010a0c3b5307/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:53.294246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d4b55-ef93-45d1-9029-92bdbbbc4ef7 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:53.294570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d4b55-ef93-45d1-9029-92bdbbbc4ef7 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:53.294857 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d4b55-ef93-45d1-9029-92bdbbbc4ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:53.307900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b50590f1e051490cb6927ca0d33567f2'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:53.309049 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b50590f1e051490cb6927ca0d33567f2'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:53.319723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b50590f1e051490cb6927ca0d33567f2'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:53.320434 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b50590f1e051490cb6927ca0d33567f2'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:53.332757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-9a3d4b55-ef93-45d1-9029-92bdbbbc4ef7 None None] MFA Rules not processed for user `492e921a928b40b7b67b010a0c3b5307`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:53.334801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-9a3d4b55-ef93-45d1-9029-92bdbbbc4ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:53.345624 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 963/1938] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:52 2022] DELETE /identity/v3/users/b50590f1e051490cb6927ca0d33567f2 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:53.410187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 976/1939] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:53.414550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:53.416622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:53.484353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce7541-a410-4f8c-a4a0-177d8b185b41 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:53.489683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e76ba2-44d1-48d1-bed1-f4bed226c70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:53.490360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e76ba2-44d1-48d1-bed1-f4bed226c70f admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:53.490649 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e76ba2-44d1-48d1-bed1-f4bed226c70f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:53.490929 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e76ba2-44d1-48d1-bed1-f4bed226c70f admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:53.491624 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e76ba2-44d1-48d1-bed1-f4bed226c70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:53.493612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e76ba2-44d1-48d1-bed1-f4bed226c70f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:53.531259 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:53.599870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 964/1940] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:53 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:53.603909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d4b55-ef93-45d1-9029-92bdbbbc4ef7 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:53.628533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e76ba2-44d1-48d1-bed1-f4bed226c70f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:53.631282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c1e76ba2-44d1-48d1-bed1-f4bed226c70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:53.708578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d4b55-ef93-45d1-9029-92bdbbbc4ef7 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:53.710215 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e76ba2-44d1-48d1-bed1-f4bed226c70f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:53.714220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fc908-4868-487f-8130-3b03c7f288a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:53.719394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:53.719672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc908-4868-487f-8130-3b03c7f288a6 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:53.719672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc908-4868-487f-8130-3b03c7f288a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:53.719672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc908-4868-487f-8130-3b03c7f288a6 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:53.719858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:53.719858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:53.719858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] PATH_INFO: `/v3/projects/551d8b2868394c0ab1ea93b4a8728b70` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:53.720081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fc908-4868-487f-8130-3b03c7f288a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:53.720253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=551d8b2868394c0ab1ea93b4a8728b70)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:53.720342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fc908-4868-487f-8130-3b03c7f288a6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:53.720432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:53.833522 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 977/1941] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:53 2022] POST /identity/v3/users => generated 300 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:53.834772 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fc908-4868-487f-8130-3b03c7f288a6 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:53.844580 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fc908-4868-487f-8130-3b03c7f288a6 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:53.862131 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca9db-5036-445d-adb4-9242533649da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:53.862862 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca9db-5036-445d-adb4-9242533649da admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:53.863141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca9db-5036-445d-adb4-9242533649da admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:53.863415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca9db-5036-445d-adb4-9242533649da admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:53.864135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ca9db-5036-445d-adb4-9242533649da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:53.865770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ca9db-5036-445d-adb4-9242533649da admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:53.868082 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '551d8b2868394c0ab1ea93b4a8728b70', 'request_id': 'req-361f25de-d6ef-4da9-8f90-37903d0f0439'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:53.879624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 978/1942] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:53.889338 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca9db-5036-445d-adb4-9242533649da admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:53.890309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b95ca9db-5036-445d-adb4-9242533649da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:53.932625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '551d8b2868394c0ab1ea93b4a8728b70', 'request_id': 'req-361f25de-d6ef-4da9-8f90-37903d0f0439'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:53.938915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '551d8b2868394c0ab1ea93b4a8728b70', 'request_id': 'req-361f25de-d6ef-4da9-8f90-37903d0f0439'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:53.946619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca9db-5036-445d-adb4-9242533649da admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:53.950141 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] The token cache is being invalidate because project 551d8b2868394c0ab1ea93b4a8728b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:53.950631 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:53.951313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:53.952929 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 965/1943] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:53 2022] DELETE /identity/v3/projects/551d8b2868394c0ab1ea93b4a8728b70 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:53.953713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:53.955047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:53.999590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0144b2-a256-41f5-81d7-dcd14d420cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:54.000153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0144b2-a256-41f5-81d7-dcd14d420cec service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.000431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0144b2-a256-41f5-81d7-dcd14d420cec service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.000705 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0144b2-a256-41f5-81d7-dcd14d420cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.002547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3d0144b2-a256-41f5-81d7-dcd14d420cec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:54.020955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f25de-d6ef-4da9-8f90-37903d0f0439 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:54.025733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42299dc5-655d-4cf0-a7a4-3de243452fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:54.026625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42299dc5-655d-4cf0-a7a4-3de243452fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.026973 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42299dc5-655d-4cf0-a7a4-3de243452fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.027266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42299dc5-655d-4cf0-a7a4-3de243452fc6 admin admin] PATH_INFO: `/v3/projects/2969a1577bcf4d0f887b76b3b098a814/users/3e2af96098804e2cb5977f0f3c7712ba/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.046721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42299dc5-655d-4cf0-a7a4-3de243452fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2969a1577bcf4d0f887b76b3b098a814, user_id=3e2af96098804e2cb5977f0f3c7712ba, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:54.050031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42299dc5-655d-4cf0-a7a4-3de243452fc6 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:54.069361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0144b2-a256-41f5-81d7-dcd14d420cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:54.070900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0144b2-a256-41f5-81d7-dcd14d420cec service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:54.080700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 979/1944] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:00:54.081993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb59ae-dc00-45d1-8cdf-1a7e09672808 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.082283 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb59ae-dc00-45d1-8cdf-1a7e09672808 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.082590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb59ae-dc00-45d1-8cdf-1a7e09672808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.101564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-e9fb59ae-dc00-45d1-8cdf-1a7e09672808 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:54.104629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e9fb59ae-dc00-45d1-8cdf-1a7e09672808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:54.115382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 980/1945] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:54.121200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b920762-fa11-49d3-b7e0-8f929d4641a3 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.121575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b920762-fa11-49d3-b7e0-8f929d4641a3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.121807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b920762-fa11-49d3-b7e0-8f929d4641a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.149434 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 966/1946] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:53 2022] PUT /identity/v3/projects/2969a1577bcf4d0f887b76b3b098a814/users/3e2af96098804e2cb5977f0f3c7712ba/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:54.152290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4b920762-fa11-49d3-b7e0-8f929d4641a3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:54.153031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42299dc5-655d-4cf0-a7a4-3de243452fc6 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:54.153565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4b920762-fa11-49d3-b7e0-8f929d4641a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:54.226390 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 981/1947] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:54.238344 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b920762-fa11-49d3-b7e0-8f929d4641a3 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:54.238501 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42299dc5-655d-4cf0-a7a4-3de243452fc6 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:54.240359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ba36d-b36e-4f4c-9844-f2425c4f8f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:54.241025 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ba36d-b36e-4f4c-9844-f2425c4f8f24 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.241309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ba36d-b36e-4f4c-9844-f2425c4f8f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.241751 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ba36d-b36e-4f4c-9844-f2425c4f8f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.242325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b920762-fa11-49d3-b7e0-8f929d4641a3 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:54.242511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ba36d-b36e-4f4c-9844-f2425c4f8f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:54.244635 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ba36d-b36e-4f4c-9844-f2425c4f8f24 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:54.248356 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178336-116c-431b-a5c8-1bb4659cbc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:54.249442 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178336-116c-431b-a5c8-1bb4659cbc1b admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.249678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178336-116c-431b-a5c8-1bb4659cbc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.250121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178336-116c-431b-a5c8-1bb4659cbc1b admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.251259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f178336-116c-431b-a5c8-1bb4659cbc1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:00:54.251447 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f178336-116c-431b-a5c8-1bb4659cbc1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:54.253119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f178336-116c-431b-a5c8-1bb4659cbc1b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:54.256273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 967/1948] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:54.260157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ba36d-b36e-4f4c-9844-f2425c4f8f24 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:54.273054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 982/1949] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:00:54.274459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178336-116c-431b-a5c8-1bb4659cbc1b admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:54.276743 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ba36d-b36e-4f4c-9844-f2425c4f8f24 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:54.282278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f784e4-d9ac-4553-a009-d08b36882e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:54.283992 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f784e4-d9ac-4553-a009-d08b36882e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.284458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f784e4-d9ac-4553-a009-d08b36882e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.284936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f784e4-d9ac-4553-a009-d08b36882e2e admin admin] PATH_INFO: `/v3/projects/2969a1577bcf4d0f887b76b3b098a814/users/3e2af96098804e2cb5977f0f3c7712ba/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.287963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178336-116c-431b-a5c8-1bb4659cbc1b admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:54.288056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f784e4-d9ac-4553-a009-d08b36882e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2969a1577bcf4d0f887b76b3b098a814, user_id=3e2af96098804e2cb5977f0f3c7712ba, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:54.291270 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f784e4-d9ac-4553-a009-d08b36882e2e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:54.293024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fc5b7-e4f8-4853-9ef2-c6c788b1f7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:54.293805 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fc5b7-e4f8-4853-9ef2-c6c788b1f7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.294297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fc5b7-e4f8-4853-9ef2-c6c788b1f7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.295363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fc5b7-e4f8-4853-9ef2-c6c788b1f7b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.297745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fc5b7-e4f8-4853-9ef2-c6c788b1f7b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:54.298200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fc5b7-e4f8-4853-9ef2-c6c788b1f7b6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:54.317785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 968/1950] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:54 2022] PUT /identity/v3/projects/2969a1577bcf4d0f887b76b3b098a814/users/3e2af96098804e2cb5977f0f3c7712ba/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:00:54.335589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a57e5-3d0d-4a48-8aed-d1f73337cb8e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.335884 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a57e5-3d0d-4a48-8aed-d1f73337cb8e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.336198 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a57e5-3d0d-4a48-8aed-d1f73337cb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.363953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-6d0a57e5-3d0d-4a48-8aed-d1f73337cb8e None None] MFA Rules not processed for user `3e2af96098804e2cb5977f0f3c7712ba`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:54.365173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6d0a57e5-3d0d-4a48-8aed-d1f73337cb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:54.414814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 983/1951] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:54 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:00:54.418951 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fc5b7-e4f8-4853-9ef2-c6c788b1f7b6 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:54.437266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 969/1952] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:54.448716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a57e5-3d0d-4a48-8aed-d1f73337cb8e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:54.450186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6d0a57e5-3d0d-4a48-8aed-d1f73337cb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:54.484028 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fc5b7-e4f8-4853-9ef2-c6c788b1f7b6 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:54.488995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eed675-8bc3-4709-a890-e07be2a85221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:54.489701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eed675-8bc3-4709-a890-e07be2a85221 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.489986 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eed675-8bc3-4709-a890-e07be2a85221 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.490258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eed675-8bc3-4709-a890-e07be2a85221 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.490939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eed675-8bc3-4709-a890-e07be2a85221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:54.492884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eed675-8bc3-4709-a890-e07be2a85221 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:54.509638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a57e5-3d0d-4a48-8aed-d1f73337cb8e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:54.534987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:54.557752 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3726dae-3c41-467a-97c7-0513646f54eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:54.558409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3726dae-3c41-467a-97c7-0513646f54eb service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.558697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3726dae-3c41-467a-97c7-0513646f54eb service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.558979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3726dae-3c41-467a-97c7-0513646f54eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.618386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3726dae-3c41-467a-97c7-0513646f54eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:54.619830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3726dae-3c41-467a-97c7-0513646f54eb service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:54.627946 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 984/1953] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:54 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:54.629062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eed675-8bc3-4709-a890-e07be2a85221 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:54.631740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 970/1954] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:00:54.639328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eed675-8bc3-4709-a890-e07be2a85221 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:54.645100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb606fd-c93d-4329-bfde-6bd93c252f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:54.645798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb606fd-c93d-4329-bfde-6bd93c252f49 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.646083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb606fd-c93d-4329-bfde-6bd93c252f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.646360 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb606fd-c93d-4329-bfde-6bd93c252f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.647081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb606fd-c93d-4329-bfde-6bd93c252f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:54.648983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb606fd-c93d-4329-bfde-6bd93c252f49 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:54.659745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 985/1955] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:54.663772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3726dae-3c41-467a-97c7-0513646f54eb service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:54.674642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3726dae-3c41-467a-97c7-0513646f54eb service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:54.679640 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739a95a-eda6-41cc-85a4-8b146879e232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:54.680330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739a95a-eda6-41cc-85a4-8b146879e232 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.680652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739a95a-eda6-41cc-85a4-8b146879e232 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.680933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739a95a-eda6-41cc-85a4-8b146879e232 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.681745 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739a95a-eda6-41cc-85a4-8b146879e232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:54.683353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739a95a-eda6-41cc-85a4-8b146879e232 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:54.694030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 971/1956] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:00:54.698511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb606fd-c93d-4329-bfde-6bd93c252f49 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:54.709339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb606fd-c93d-4329-bfde-6bd93c252f49 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:54.714044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8288c9-157f-4760-b9e6-250e9f7c98c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:54.718576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8288c9-157f-4760-b9e6-250e9f7c98c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.718576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8288c9-157f-4760-b9e6-250e9f7c98c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.718576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8288c9-157f-4760-b9e6-250e9f7c98c5 admin admin] PATH_INFO: `/v3/projects/38e5e280f11c4ec390daaa29e8646bf5/users/144ffe175b7f493d8f263588cbffe5ad/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.730789 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8288c9-157f-4760-b9e6-250e9f7c98c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e5e280f11c4ec390daaa29e8646bf5, user_id=144ffe175b7f493d8f263588cbffe5ad, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:54.733478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8288c9-157f-4760-b9e6-250e9f7c98c5 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:54.893341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 986/1957] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:00:54 2022] PUT /identity/v3/projects/38e5e280f11c4ec390daaa29e8646bf5/users/144ffe175b7f493d8f263588cbffe5ad/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:54.904652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e603522-98e3-4e41-892d-585ca57e5849 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:54.904945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e603522-98e3-4e41-892d-585ca57e5849 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:54.905217 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e603522-98e3-4e41-892d-585ca57e5849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:54.931719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-8e603522-98e3-4e41-892d-585ca57e5849 None None] MFA Rules not processed for user `144ffe175b7f493d8f263588cbffe5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:54.932902 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8e603522-98e3-4e41-892d-585ca57e5849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:55.003026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 972/1958] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:55.012887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8288c9-157f-4760-b9e6-250e9f7c98c5 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:55.014789 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0c8288c9-157f-4760-b9e6-250e9f7c98c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:55.089764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8288c9-157f-4760-b9e6-250e9f7c98c5 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:55.095216 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b357b32-acf5-4bab-867e-66d6e2e3b96b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:55.095914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b357b32-acf5-4bab-867e-66d6e2e3b96b service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:55.096198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b357b32-acf5-4bab-867e-66d6e2e3b96b service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:55.096475 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b357b32-acf5-4bab-867e-66d6e2e3b96b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:55.104565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b357b32-acf5-4bab-867e-66d6e2e3b96b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:55.106237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b357b32-acf5-4bab-867e-66d6e2e3b96b service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:55.117159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 987/1959] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:55.890077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:56.441037 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e603522-98e3-4e41-892d-585ca57e5849 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:56.509695 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e603522-98e3-4e41-892d-585ca57e5849 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:56.515130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:56.516094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:56.520565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:56.520565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] PATH_INFO: `/v3/users/492e921a928b40b7b67b010a0c3b5307` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:56.520565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=492e921a928b40b7b67b010a0c3b5307)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:56.520565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:56.806762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492e921a928b40b7b67b010a0c3b5307'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:56.898978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492e921a928b40b7b67b010a0c3b5307'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:56.899643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492e921a928b40b7b67b010a0c3b5307'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:56.907290 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492e921a928b40b7b67b010a0c3b5307'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:56.907975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492e921a928b40b7b67b010a0c3b5307'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:56.928577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 973/1960] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:56 2022] DELETE /identity/v3/users/492e921a928b40b7b67b010a0c3b5307 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:56.933136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cecaa-949d-4e84-bb18-a2607da835c6 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:56.933722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cecaa-949d-4e84-bb18-a2607da835c6 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:56.939229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cecaa-949d-4e84-bb18-a2607da835c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:56.951676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-7c8cecaa-949d-4e84-bb18-a2607da835c6 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:56.952891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7c8cecaa-949d-4e84-bb18-a2607da835c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:57.018222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 988/1961] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:57.028176 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:57.029716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:57.088627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2728a8-9c97-4601-9469-dc9456850862 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:57.092275 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aef608-5c9b-428f-97bc-4866aa81e840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:57.092931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aef608-5c9b-428f-97bc-4866aa81e840 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:57.093211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aef608-5c9b-428f-97bc-4866aa81e840 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:57.093522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aef608-5c9b-428f-97bc-4866aa81e840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:57.103680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aef608-5c9b-428f-97bc-4866aa81e840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:57.105104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aef608-5c9b-428f-97bc-4866aa81e840 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:57.115457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 974/1962] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:57.267513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:57.645105 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:57.875815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cecaa-949d-4e84-bb18-a2607da835c6 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:57.878518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7c8cecaa-949d-4e84-bb18-a2607da835c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:57.911491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cecaa-949d-4e84-bb18-a2607da835c6 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:57.917123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:57.918032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:57.918318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:57.918602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] PATH_INFO: `/v3/projects/78923669fdc94a73a958fef272c604d6` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:57.919796 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78923669fdc94a73a958fef272c604d6)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:57.921960 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:58.089949 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78923669fdc94a73a958fef272c604d6', 'request_id': 'req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:58.183106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78923669fdc94a73a958fef272c604d6', 'request_id': 'req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:58.192950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78923669fdc94a73a958fef272c604d6', 'request_id': 'req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:58.211174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] The token cache is being invalidate because project 78923669fdc94a73a958fef272c604d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:58.212002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:58.212922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:58.215919 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 989/1963] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:57 2022] DELETE /identity/v3/projects/78923669fdc94a73a958fef272c604d6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:58.219691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aef608-5c9b-428f-97bc-4866aa81e840 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:58.233233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aef608-5c9b-428f-97bc-4866aa81e840 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:58.305632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:58.305632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:58.305632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:58.305632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] PATH_INFO: `/v3/users/3e2af96098804e2cb5977f0f3c7712ba` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:58.306099 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e2af96098804e2cb5977f0f3c7712ba)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:58.306099 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:58.544129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e2af96098804e2cb5977f0f3c7712ba'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:58.637963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e2af96098804e2cb5977f0f3c7712ba'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:58.638626 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e2af96098804e2cb5977f0f3c7712ba'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:58.646906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e2af96098804e2cb5977f0f3c7712ba'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:58.647698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e2af96098804e2cb5977f0f3c7712ba'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:58.670396 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 975/1964] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:58 2022] DELETE /identity/v3/users/3e2af96098804e2cb5977f0f3c7712ba => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:58.683953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:58.685814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:58.698805 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33316e-69d2-45c7-8fc2-04ac8a42abe3 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:58.757243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fd294-da02-4d7e-9fc9-bb24b3ef380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:58.758262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fd294-da02-4d7e-9fc9-bb24b3ef380c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:58.758547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fd294-da02-4d7e-9fc9-bb24b3ef380c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:58.758945 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fd294-da02-4d7e-9fc9-bb24b3ef380c admin admin] PATH_INFO: `/v3/users/144ffe175b7f493d8f263588cbffe5ad` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:58.760029 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fd294-da02-4d7e-9fc9-bb24b3ef380c admin admin] RBAC: Authorizing `identity:delete_user(user_id=144ffe175b7f493d8f263588cbffe5ad)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:58.762033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fd294-da02-4d7e-9fc9-bb24b3ef380c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:59.060579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dc9fd294-da02-4d7e-9fc9-bb24b3ef380c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144ffe175b7f493d8f263588cbffe5ad'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.099363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:59.100791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:59.113889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db94bf-561c-49c9-8039-24a43ec6887a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:59.118576 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e542a-19d4-493e-89d0-aa441bdcd974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:59.119508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e542a-19d4-493e-89d0-aa441bdcd974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.119838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e542a-19d4-493e-89d0-aa441bdcd974 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.120077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e542a-19d4-493e-89d0-aa441bdcd974 admin admin] PATH_INFO: `/v3/projects/2969a1577bcf4d0f887b76b3b098a814` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.121459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e542a-19d4-493e-89d0-aa441bdcd974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2969a1577bcf4d0f887b76b3b098a814)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:59.125324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e542a-19d4-493e-89d0-aa441bdcd974 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:59.144858 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dc9fd294-da02-4d7e-9fc9-bb24b3ef380c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144ffe175b7f493d8f263588cbffe5ad'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.161702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dc9fd294-da02-4d7e-9fc9-bb24b3ef380c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144ffe175b7f493d8f263588cbffe5ad'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.162420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dc9fd294-da02-4d7e-9fc9-bb24b3ef380c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144ffe175b7f493d8f263588cbffe5ad'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.163032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dc9fd294-da02-4d7e-9fc9-bb24b3ef380c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144ffe175b7f493d8f263588cbffe5ad'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.179909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 990/1965] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:58 2022] DELETE /identity/v3/users/144ffe175b7f493d8f263588cbffe5ad => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:59.184424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4846b7-f952-44a0-9c79-4d118ed14b6e None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.184741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4846b7-f952-44a0-9c79-4d118ed14b6e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.185047 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4846b7-f952-44a0-9c79-4d118ed14b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.202667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6d4846b7-f952-44a0-9c79-4d118ed14b6e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:59.203956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6d4846b7-f952-44a0-9c79-4d118ed14b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:59.222145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-234e542a-19d4-493e-89d0-aa441bdcd974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2969a1577bcf4d0f887b76b3b098a814', 'request_id': 'req-234e542a-19d4-493e-89d0-aa441bdcd974'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.265396 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 991/1966] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:00:59.276025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4846b7-f952-44a0-9c79-4d118ed14b6e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:59.279966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6d4846b7-f952-44a0-9c79-4d118ed14b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:59.287273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-234e542a-19d4-493e-89d0-aa441bdcd974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2969a1577bcf4d0f887b76b3b098a814', 'request_id': 'req-234e542a-19d4-493e-89d0-aa441bdcd974'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.290226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-234e542a-19d4-493e-89d0-aa441bdcd974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2969a1577bcf4d0f887b76b3b098a814', 'request_id': 'req-234e542a-19d4-493e-89d0-aa441bdcd974'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.302393 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-234e542a-19d4-493e-89d0-aa441bdcd974 admin admin] The token cache is being invalidate because project 2969a1577bcf4d0f887b76b3b098a814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:00:59.302606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-234e542a-19d4-493e-89d0-aa441bdcd974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.303199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-234e542a-19d4-493e-89d0-aa441bdcd974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.307961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 976/1967] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:59 2022] DELETE /identity/v3/projects/2969a1577bcf4d0f887b76b3b098a814 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:59.311009 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2dcf2-21be-41d6-b783-a3a4e599d2ce None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.311292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2dcf2-21be-41d6-b783-a3a4e599d2ce None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.312189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2dcf2-21be-41d6-b783-a3a4e599d2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.334295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d5f2dcf2-21be-41d6-b783-a3a4e599d2ce None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:59.335598 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d5f2dcf2-21be-41d6-b783-a3a4e599d2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:59.352259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4846b7-f952-44a0-9c79-4d118ed14b6e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:59.409868 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 977/1968] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:59.410098 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccfaf8-7bfe-4ed4-ba32-a08ab397fee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:59.410098 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccfaf8-7bfe-4ed4-ba32-a08ab397fee2 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.410311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2dcf2-21be-41d6-b783-a3a4e599d2ce None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:59.410398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccfaf8-7bfe-4ed4-ba32-a08ab397fee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.410398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccfaf8-7bfe-4ed4-ba32-a08ab397fee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.411798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d5f2dcf2-21be-41d6-b783-a3a4e599d2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:59.411914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-52ccfaf8-7bfe-4ed4-ba32-a08ab397fee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:59.426524 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccfaf8-7bfe-4ed4-ba32-a08ab397fee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:59.427682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2dcf2-21be-41d6-b783-a3a4e599d2ce None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:59.430973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccfaf8-7bfe-4ed4-ba32-a08ab397fee2 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:59.432404 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66099914-5f5d-41c3-a413-d0601c2f9a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:59.433277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66099914-5f5d-41c3-a413-d0601c2f9a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.433588 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66099914-5f5d-41c3-a413-d0601c2f9a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.433864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66099914-5f5d-41c3-a413-d0601c2f9a19 admin admin] PATH_INFO: `/v3/users/66b1cbbba29e4719ab346f1097ce6dce` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.435058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66099914-5f5d-41c3-a413-d0601c2f9a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b1cbbba29e4719ab346f1097ce6dce)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:59.437092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66099914-5f5d-41c3-a413-d0601c2f9a19 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:59.439294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 992/1969] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:00:59.440983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a478c-8213-46ba-bf9b-0d5577a4c4b1 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.441276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a478c-8213-46ba-bf9b-0d5577a4c4b1 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.441644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a478c-8213-46ba-bf9b-0d5577a4c4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.461064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-8e4a478c-8213-46ba-bf9b-0d5577a4c4b1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:59.462329 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8e4a478c-8213-46ba-bf9b-0d5577a4c4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:59.476557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 993/1970] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:59.477733 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a478c-8213-46ba-bf9b-0d5577a4c4b1 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:59.489664 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a478c-8213-46ba-bf9b-0d5577a4c4b1 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:59.493012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:59.497846 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5a282-cb26-4845-bba6-7fef71f54cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:59.498872 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5a282-cb26-4845-bba6-7fef71f54cca admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.499212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5a282-cb26-4845-bba6-7fef71f54cca admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.500077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5a282-cb26-4845-bba6-7fef71f54cca admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.500881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5a282-cb26-4845-bba6-7fef71f54cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:00:59.501265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5a282-cb26-4845-bba6-7fef71f54cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:59.503638 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5a282-cb26-4845-bba6-7fef71f54cca admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:59.517415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 994/1971] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:00:59.520169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5a282-cb26-4845-bba6-7fef71f54cca admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:59.530302 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5a282-cb26-4845-bba6-7fef71f54cca admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:59.535159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58d6d5-a97b-4c06-9d30-52fc211f3419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:59.535911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58d6d5-a97b-4c06-9d30-52fc211f3419 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.536198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58d6d5-a97b-4c06-9d30-52fc211f3419 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.536473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58d6d5-a97b-4c06-9d30-52fc211f3419 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.537214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58d6d5-a97b-4c06-9d30-52fc211f3419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:59.539217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58d6d5-a97b-4c06-9d30-52fc211f3419 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:59.631786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 995/1972] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:00:59 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:59.636495 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58d6d5-a97b-4c06-9d30-52fc211f3419 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:59.698641 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-66099914-5f5d-41c3-a413-d0601c2f9a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b1cbbba29e4719ab346f1097ce6dce'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.703903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58d6d5-a97b-4c06-9d30-52fc211f3419 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:59.706922 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:00:59.708876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0306c-50df-4f85-a899-4fa526817ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:59.709587 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0306c-50df-4f85-a899-4fa526817ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.709881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0306c-50df-4f85-a899-4fa526817ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.710162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0306c-50df-4f85-a899-4fa526817ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.710851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0306c-50df-4f85-a899-4fa526817ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:59.712820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0306c-50df-4f85-a899-4fa526817ea4 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:59.758023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-66099914-5f5d-41c3-a413-d0601c2f9a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b1cbbba29e4719ab346f1097ce6dce'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.758646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-66099914-5f5d-41c3-a413-d0601c2f9a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b1cbbba29e4719ab346f1097ce6dce'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.766141 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-66099914-5f5d-41c3-a413-d0601c2f9a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b1cbbba29e4719ab346f1097ce6dce'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.766846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-66099914-5f5d-41c3-a413-d0601c2f9a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b1cbbba29e4719ab346f1097ce6dce'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:00:59.786067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 978/1973] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:00:59 2022] DELETE /identity/v3/users/66b1cbbba29e4719ab346f1097ce6dce => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:00:59.790674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b278d81-bb9e-4c65-bbdf-b32a7c1553b7 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.791055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b278d81-bb9e-4c65-bbdf-b32a7c1553b7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.791410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b278d81-bb9e-4c65-bbdf-b32a7c1553b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.794811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 996/1974] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:00:59 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:00:59.798615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0306c-50df-4f85-a899-4fa526817ea4 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:59.800874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c1e0306c-50df-4f85-a899-4fa526817ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:59.810225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-6b278d81-bb9e-4c65-bbdf-b32a7c1553b7 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:00:59.811411 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6b278d81-bb9e-4c65-bbdf-b32a7c1553b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:59.812944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0306c-50df-4f85-a899-4fa526817ea4 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:59.872545 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 979/1975] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:00:59.877018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee3c60-b75d-40fc-87a1-705d33f2dc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:59.877018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee3c60-b75d-40fc-87a1-705d33f2dc40 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.877018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee3c60-b75d-40fc-87a1-705d33f2dc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.877018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee3c60-b75d-40fc-87a1-705d33f2dc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.877764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee3c60-b75d-40fc-87a1-705d33f2dc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:59.877764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee3c60-b75d-40fc-87a1-705d33f2dc40 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:59.882521 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b278d81-bb9e-4c65-bbdf-b32a7c1553b7 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:59.883958 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6b278d81-bb9e-4c65-bbdf-b32a7c1553b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:59.889308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 997/1976] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:00:59.890197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee3c60-b75d-40fc-87a1-705d33f2dc40 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:59.891882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-27ee3c60-b75d-40fc-87a1-705d33f2dc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:00:59.906245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee3c60-b75d-40fc-87a1-705d33f2dc40 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:59.911656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad815c-2cc6-456b-8d99-fc9df455d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:59.912523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad815c-2cc6-456b-8d99-fc9df455d5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.912804 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad815c-2cc6-456b-8d99-fc9df455d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.913086 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad815c-2cc6-456b-8d99-fc9df455d5ec admin admin] PATH_INFO: `/v3/projects/38e5e280f11c4ec390daaa29e8646bf5` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.914429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad815c-2cc6-456b-8d99-fc9df455d5ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e5e280f11c4ec390daaa29e8646bf5)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:59.916515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad815c-2cc6-456b-8d99-fc9df455d5ec admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:59.947675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b278d81-bb9e-4c65-bbdf-b32a7c1553b7 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:59.951326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff3aa5-77f1-44f4-9851-eeb9adba875a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:59.952037 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff3aa5-77f1-44f4-9851-eeb9adba875a service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.952327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff3aa5-77f1-44f4-9851-eeb9adba875a service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.952605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff3aa5-77f1-44f4-9851-eeb9adba875a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.962333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff3aa5-77f1-44f4-9851-eeb9adba875a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:59.963756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff3aa5-77f1-44f4-9851-eeb9adba875a service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:00:59.973918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 980/1977] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:00:59.974706 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff3aa5-77f1-44f4-9851-eeb9adba875a service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:00:59.983930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff3aa5-77f1-44f4-9851-eeb9adba875a service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:00:59.989303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea8e9-7372-4ea7-91ac-10322afd0730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:00:59.989988 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea8e9-7372-4ea7-91ac-10322afd0730 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:00:59.990276 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea8e9-7372-4ea7-91ac-10322afd0730 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:00:59.990552 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea8e9-7372-4ea7-91ac-10322afd0730 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:00:59.991266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ea8e9-7372-4ea7-91ac-10322afd0730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:00:59.992888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ea8e9-7372-4ea7-91ac-10322afd0730 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:00.003932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 981/1978] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:00.008293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea8e9-7372-4ea7-91ac-10322afd0730 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:00.018080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea8e9-7372-4ea7-91ac-10322afd0730 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:00.024358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb497c6-d446-4a8e-bfe6-a14a5a554f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:00.025248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb497c6-d446-4a8e-bfe6-a14a5a554f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:00.025560 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb497c6-d446-4a8e-bfe6-a14a5a554f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:00.025838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb497c6-d446-4a8e-bfe6-a14a5a554f74 admin admin] PATH_INFO: `/v3/projects/65e7c5e2059e4ea5a35d0b2cc3d849f2/users/8159af055be549d796217dd68cb624d5/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:00.039069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5fad815c-2cc6-456b-8d99-fc9df455d5ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e5e280f11c4ec390daaa29e8646bf5', 'request_id': 'req-5fad815c-2cc6-456b-8d99-fc9df455d5ec'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:00.045354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb497c6-d446-4a8e-bfe6-a14a5a554f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e7c5e2059e4ea5a35d0b2cc3d849f2, user_id=8159af055be549d796217dd68cb624d5, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:00.048228 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb497c6-d446-4a8e-bfe6-a14a5a554f74 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:00.126961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5fad815c-2cc6-456b-8d99-fc9df455d5ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e5e280f11c4ec390daaa29e8646bf5', 'request_id': 'req-5fad815c-2cc6-456b-8d99-fc9df455d5ec'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:00.133337 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5fad815c-2cc6-456b-8d99-fc9df455d5ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e5e280f11c4ec390daaa29e8646bf5', 'request_id': 'req-5fad815c-2cc6-456b-8d99-fc9df455d5ec'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:00.134147 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 982/1979] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:00 2022] PUT /identity/v3/projects/65e7c5e2059e4ea5a35d0b2cc3d849f2/users/8159af055be549d796217dd68cb624d5/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:01:00.144806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f719117-45b6-4eb4-84b7-f280a51c947d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:00.145824 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f719117-45b6-4eb4-84b7-f280a51c947d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:00.146280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f719117-45b6-4eb4-84b7-f280a51c947d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:00.146595 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5fad815c-2cc6-456b-8d99-fc9df455d5ec admin admin] The token cache is being invalidate because project 38e5e280f11c4ec390daaa29e8646bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:00.147059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5fad815c-2cc6-456b-8d99-fc9df455d5ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:00.147642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5fad815c-2cc6-456b-8d99-fc9df455d5ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:00.152565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 998/1980] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:00:59 2022] DELETE /identity/v3/projects/38e5e280f11c4ec390daaa29e8646bf5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:00.153974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1e800-5f69-4145-b18d-17c3547681ce None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:00.154262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1e800-5f69-4145-b18d-17c3547681ce None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:00.154538 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1e800-5f69-4145-b18d-17c3547681ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:00.191114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2f719117-45b6-4eb4-84b7-f280a51c947d None None] MFA Rules not processed for user `8159af055be549d796217dd68cb624d5`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:00.192959 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b1e1e800-5f69-4145-b18d-17c3547681ce None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:00.193145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2f719117-45b6-4eb4-84b7-f280a51c947d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:00.194788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b1e1e800-5f69-4145-b18d-17c3547681ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:00.279983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 999/1981] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:00.289292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce23f-2afe-452b-a173-6c7ef9a1d3a4 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:00.289606 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce23f-2afe-452b-a173-6c7ef9a1d3a4 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:00.289891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce23f-2afe-452b-a173-6c7ef9a1d3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:00.296008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 983/1982] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:00.320027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f719117-45b6-4eb4-84b7-f280a51c947d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:00.322335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2f719117-45b6-4eb4-84b7-f280a51c947d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:00.326497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-27dce23f-2afe-452b-a173-6c7ef9a1d3a4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:00.328570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-27dce23f-2afe-452b-a173-6c7ef9a1d3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:00.342269 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1000/1983] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:00.346664 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce23f-2afe-452b-a173-6c7ef9a1d3a4 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:00.359938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce23f-2afe-452b-a173-6c7ef9a1d3a4 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:00.368071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dbf1d-099f-48e3-bead-0f1a939a4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:00.368071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dbf1d-099f-48e3-bead-0f1a939a4f25 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:00.368071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dbf1d-099f-48e3-bead-0f1a939a4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:00.368071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dbf1d-099f-48e3-bead-0f1a939a4f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:00.368550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dbf1d-099f-48e3-bead-0f1a939a4f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:01:00.368773 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dbf1d-099f-48e3-bead-0f1a939a4f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:00.370581 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dbf1d-099f-48e3-bead-0f1a939a4f25 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:00.383178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1001/1984] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:01:00.387915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dbf1d-099f-48e3-bead-0f1a939a4f25 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:00.390592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f719117-45b6-4eb4-84b7-f280a51c947d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:00.394979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42433688-3f31-4fc3-8aac-ba4e70e867ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a22cd803304a19a58bfbe17addb11f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:00.395636 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42433688-3f31-4fc3-8aac-ba4e70e867ae service glance] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:00.395921 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42433688-3f31-4fc3-8aac-ba4e70e867ae service glance] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:00.396582 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42433688-3f31-4fc3-8aac-ba4e70e867ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:00.398230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dbf1d-099f-48e3-bead-0f1a939a4f25 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:00.402871 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966be44-3fa1-4446-bbeb-4537571ada4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:00.403632 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966be44-3fa1-4446-bbeb-4537571ada4b admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:00.403788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966be44-3fa1-4446-bbeb-4537571ada4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:00.404054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966be44-3fa1-4446-bbeb-4537571ada4b admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:00.404734 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966be44-3fa1-4446-bbeb-4537571ada4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:00.405488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42433688-3f31-4fc3-8aac-ba4e70e867ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:00.406665 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966be44-3fa1-4446-bbeb-4537571ada4b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:00.406904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42433688-3f31-4fc3-8aac-ba4e70e867ae service glance] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:00.418166 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 984/1985] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:01:00.425699 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42433688-3f31-4fc3-8aac-ba4e70e867ae service glance] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:00.428148 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-42433688-3f31-4fc3-8aac-ba4e70e867ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:00.449600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42433688-3f31-4fc3-8aac-ba4e70e867ae service glance] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:00.449600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:00.449600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:00.450407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:00.450407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] PATH_INFO: `/v3/projects/84e1b323e0c14946a15adf2e1dd91004` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:00.451402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e1b323e0c14946a15adf2e1dd91004)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:00.453707 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:00.509510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1002/1986] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:00 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:01:00.513431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966be44-3fa1-4446-bbeb-4537571ada4b admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:00.587612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966be44-3fa1-4446-bbeb-4537571ada4b admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:00.593336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e1b323e0c14946a15adf2e1dd91004', 'request_id': 'req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:00.640576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:00.657799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e736b41-9c3e-404e-9939-19a93a1a9c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:00.658504 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e736b41-9c3e-404e-9939-19a93a1a9c15 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:00.658854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e736b41-9c3e-404e-9939-19a93a1a9c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:00.659128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e736b41-9c3e-404e-9939-19a93a1a9c15 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:00.659812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e736b41-9c3e-404e-9939-19a93a1a9c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:00.662029 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e736b41-9c3e-404e-9939-19a93a1a9c15 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:00.666459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e1b323e0c14946a15adf2e1dd91004', 'request_id': 'req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:00.673323 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e1b323e0c14946a15adf2e1dd91004', 'request_id': 'req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:00.687631 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] The token cache is being invalidate because project 84e1b323e0c14946a15adf2e1dd91004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:00.688206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:00.690904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:00.692767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 985/1987] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:00 2022] DELETE /identity/v3/projects/84e1b323e0c14946a15adf2e1dd91004 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:01:00.700498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:00.702015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:00.715265 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f0b77-52b2-42b9-a9ab-de05389ac54f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:00.721216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:00.722132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:00.722414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:00.722697 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] PATH_INFO: `/v3/users/f731b9b9113f43498c80ad6c814c620b` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:00.724275 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f731b9b9113f43498c80ad6c814c620b)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:00.726300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:00.761822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:00.793068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1003/1988] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:00 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:00.794391 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e736b41-9c3e-404e-9939-19a93a1a9c15 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:00.796217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3e736b41-9c3e-404e-9939-19a93a1a9c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:00.808041 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e736b41-9c3e-404e-9939-19a93a1a9c15 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:00.812828 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8095b-5a7b-48c2-9396-a2cedd7d4238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:00.813520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8095b-5a7b-48c2-9396-a2cedd7d4238 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:00.813811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8095b-5a7b-48c2-9396-a2cedd7d4238 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:00.814089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8095b-5a7b-48c2-9396-a2cedd7d4238 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:00.815345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8095b-5a7b-48c2-9396-a2cedd7d4238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:00.816928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8095b-5a7b-48c2-9396-a2cedd7d4238 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:00.827477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1004/1989] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:01:00.832110 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8095b-5a7b-48c2-9396-a2cedd7d4238 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:00.841963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8095b-5a7b-48c2-9396-a2cedd7d4238 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:00.846726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab7a7b-e221-4ef7-a54b-a0fa7fbf01ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:00.847522 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab7a7b-e221-4ef7-a54b-a0fa7fbf01ae admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:00.847631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab7a7b-e221-4ef7-a54b-a0fa7fbf01ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:00.847915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab7a7b-e221-4ef7-a54b-a0fa7fbf01ae admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:00.850557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab7a7b-e221-4ef7-a54b-a0fa7fbf01ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:00.850557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab7a7b-e221-4ef7-a54b-a0fa7fbf01ae admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:00.861046 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1005/1990] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:01:00.865719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab7a7b-e221-4ef7-a54b-a0fa7fbf01ae admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:00.875759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab7a7b-e221-4ef7-a54b-a0fa7fbf01ae admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:00.881024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce76eb9-0afd-493b-820a-1795e3a9a0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:00.881933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce76eb9-0afd-493b-820a-1795e3a9a0ad admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:00.882224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce76eb9-0afd-493b-820a-1795e3a9a0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:00.882505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce76eb9-0afd-493b-820a-1795e3a9a0ad admin admin] PATH_INFO: `/v3/projects/728538f82257478fb61effcb7c173d03/users/55f9bdd6d3a44836ad35721a70ce7bb1/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:00.902232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce76eb9-0afd-493b-820a-1795e3a9a0ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=728538f82257478fb61effcb7c173d03, user_id=55f9bdd6d3a44836ad35721a70ce7bb1, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:00.902232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce76eb9-0afd-493b-820a-1795e3a9a0ad admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:00.960739 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f731b9b9113f43498c80ad6c814c620b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:01.036194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1006/1991] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:00 2022] PUT /identity/v3/projects/728538f82257478fb61effcb7c173d03/users/55f9bdd6d3a44836ad35721a70ce7bb1/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:01:01.047706 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063970d-f2ea-4585-be7f-00837e46654e None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:01.047995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063970d-f2ea-4585-be7f-00837e46654e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:01.048275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063970d-f2ea-4585-be7f-00837e46654e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:01.052474 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f731b9b9113f43498c80ad6c814c620b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:01.053179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f731b9b9113f43498c80ad6c814c620b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:01.060935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f731b9b9113f43498c80ad6c814c620b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:01.061658 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f731b9b9113f43498c80ad6c814c620b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:01.075425 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-2063970d-f2ea-4585-be7f-00837e46654e None None] MFA Rules not processed for user `55f9bdd6d3a44836ad35721a70ce7bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:01.076623 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2063970d-f2ea-4585-be7f-00837e46654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:01.080465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 986/1992] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:00 2022] DELETE /identity/v3/users/f731b9b9113f43498c80ad6c814c620b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:01.146246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1007/1993] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:01.157115 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:01.158580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:01.235051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beffa03-4157-4ebe-af87-90cf68a3640c admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:01.241234 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdb9c3-d133-463e-b7b0-2cace1fdb150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:01.241979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdb9c3-d133-463e-b7b0-2cace1fdb150 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:01.242267 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdb9c3-d133-463e-b7b0-2cace1fdb150 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:01.242561 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdb9c3-d133-463e-b7b0-2cace1fdb150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:01.298593 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdb9c3-d133-463e-b7b0-2cace1fdb150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:01.300874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdb9c3-d133-463e-b7b0-2cace1fdb150 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:01.310114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 987/1994] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:01.548028 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063970d-f2ea-4585-be7f-00837e46654e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:01.548028 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2063970d-f2ea-4585-be7f-00837e46654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:01.632404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063970d-f2ea-4585-be7f-00837e46654e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:01.679459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdb9c3-d133-463e-b7b0-2cace1fdb150 service nova] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:01.680963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d8fdb9c3-d133-463e-b7b0-2cace1fdb150 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:01.691477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bc204-ca10-4142-8321-98fcb39eb157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:01.692372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bc204-ca10-4142-8321-98fcb39eb157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:01.692657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bc204-ca10-4142-8321-98fcb39eb157 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:01.692937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bc204-ca10-4142-8321-98fcb39eb157 admin admin] PATH_INFO: `/v3/users/55f9bdd6d3a44836ad35721a70ce7bb1` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:01.694298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bc204-ca10-4142-8321-98fcb39eb157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f9bdd6d3a44836ad35721a70ce7bb1)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:01.696259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bc204-ca10-4142-8321-98fcb39eb157 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:01.724324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdb9c3-d133-463e-b7b0-2cace1fdb150 service nova] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:01.729168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:01.730263 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:01.730549 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:01.730824 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] PATH_INFO: `/v3/projects/9d3e3405adf24251afbb697e6607fb92` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:01.732034 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d3e3405adf24251afbb697e6607fb92)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:01.733993 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:01.796201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:01.929698 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-4b1bc204-ca10-4142-8321-98fcb39eb157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f9bdd6d3a44836ad35721a70ce7bb1'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:01.930746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d3e3405adf24251afbb697e6607fb92', 'request_id': 'req-c04ac620-f48c-453f-b428-66fe44e839cc'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.070147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-4b1bc204-ca10-4142-8321-98fcb39eb157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f9bdd6d3a44836ad35721a70ce7bb1'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.080935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-4b1bc204-ca10-4142-8321-98fcb39eb157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f9bdd6d3a44836ad35721a70ce7bb1'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.081760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-4b1bc204-ca10-4142-8321-98fcb39eb157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f9bdd6d3a44836ad35721a70ce7bb1'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.082380 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-4b1bc204-ca10-4142-8321-98fcb39eb157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f9bdd6d3a44836ad35721a70ce7bb1'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.104554 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1008/1995] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:01 2022] DELETE /identity/v3/users/55f9bdd6d3a44836ad35721a70ce7bb1 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:02.108749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d213fb-d9ac-495c-921b-6906851f685b None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:02.109600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d213fb-d9ac-495c-921b-6906851f685b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:02.109600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d213fb-d9ac-495c-921b-6906851f685b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:02.145823 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-12d213fb-d9ac-495c-921b-6906851f685b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:02.147008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-12d213fb-d9ac-495c-921b-6906851f685b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:02.174906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d3e3405adf24251afbb697e6607fb92', 'request_id': 'req-c04ac620-f48c-453f-b428-66fe44e839cc'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.184282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d3e3405adf24251afbb697e6607fb92', 'request_id': 'req-c04ac620-f48c-453f-b428-66fe44e839cc'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.190529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:02.195029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] The token cache is being invalidate because project 9d3e3405adf24251afbb697e6607fb92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:02.195315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.196004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.197833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 988/1996] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:01 2022] DELETE /identity/v3/projects/9d3e3405adf24251afbb697e6607fb92 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:01:02.202059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:02.203419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:02.244062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1009/1997] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:02.254978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d213fb-d9ac-495c-921b-6906851f685b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:02.256769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-12d213fb-d9ac-495c-921b-6906851f685b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:02.316514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ac620-f48c-453f-b428-66fe44e839cc admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:02.324366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:02.325245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:02.325535 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:02.325819 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] PATH_INFO: `/v3/users/e7ec82f8135b40718ed089bc8fa3b766` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:02.327182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ec82f8135b40718ed089bc8fa3b766)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:02.329311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:02.365985 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d213fb-d9ac-495c-921b-6906851f685b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:02.369712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c6856-f02b-46ba-862d-931d808198ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:02.370362 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c6856-f02b-46ba-862d-931d808198ba service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:02.370639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c6856-f02b-46ba-862d-931d808198ba service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:02.370913 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c6856-f02b-46ba-862d-931d808198ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:02.381444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c6856-f02b-46ba-862d-931d808198ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:02.382869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c6856-f02b-46ba-862d-931d808198ba service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:02.393142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1010/1998] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:01:02.594498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ec82f8135b40718ed089bc8fa3b766'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.665970 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ec82f8135b40718ed089bc8fa3b766'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.666622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ec82f8135b40718ed089bc8fa3b766'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.675110 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ec82f8135b40718ed089bc8fa3b766'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.675843 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ec82f8135b40718ed089bc8fa3b766'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:02.697094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 989/1999] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:02 2022] DELETE /identity/v3/users/e7ec82f8135b40718ed089bc8fa3b766 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:01:02.948171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c6856-f02b-46ba-862d-931d808198ba service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:02.949768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-626c6856-f02b-46ba-862d-931d808198ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:02.968498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c6856-f02b-46ba-862d-931d808198ba service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:03.031601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:03.043266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe34e71-e101-4a46-9e93-84c0d4abd918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:03.044270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe34e71-e101-4a46-9e93-84c0d4abd918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.044565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe34e71-e101-4a46-9e93-84c0d4abd918 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.044876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe34e71-e101-4a46-9e93-84c0d4abd918 admin admin] PATH_INFO: `/v3/projects/728538f82257478fb61effcb7c173d03` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.046234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe34e71-e101-4a46-9e93-84c0d4abd918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=728538f82257478fb61effcb7c173d03)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:03.048075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe34e71-e101-4a46-9e93-84c0d4abd918 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:03.163630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:03.165227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:03.180175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab35ce-55b5-468e-b0d6-9479e04cf98f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:03.194924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bfe34e71-e101-4a46-9e93-84c0d4abd918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '728538f82257478fb61effcb7c173d03', 'request_id': 'req-bfe34e71-e101-4a46-9e93-84c0d4abd918'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:03.254573 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:03.255480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.255809 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.256186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39 admin admin] PATH_INFO: `/v3/projects/4caac297f3f140c889beb0255b8c5e70` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.257426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4caac297f3f140c889beb0255b8c5e70)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:03.259381 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:03.284113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bfe34e71-e101-4a46-9e93-84c0d4abd918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '728538f82257478fb61effcb7c173d03', 'request_id': 'req-bfe34e71-e101-4a46-9e93-84c0d4abd918'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:03.290221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bfe34e71-e101-4a46-9e93-84c0d4abd918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '728538f82257478fb61effcb7c173d03', 'request_id': 'req-bfe34e71-e101-4a46-9e93-84c0d4abd918'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:03.302358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bfe34e71-e101-4a46-9e93-84c0d4abd918 admin admin] The token cache is being invalidate because project 728538f82257478fb61effcb7c173d03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:03.302644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bfe34e71-e101-4a46-9e93-84c0d4abd918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:03.303304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bfe34e71-e101-4a46-9e93-84c0d4abd918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:03.304869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1011/2000] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:02 2022] DELETE /identity/v3/projects/728538f82257478fb61effcb7c173d03 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:03.309916 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440bfa9-e8c3-4119-ac38-a5530d000667 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.310269 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440bfa9-e8c3-4119-ac38-a5530d000667 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.310556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440bfa9-e8c3-4119-ac38-a5530d000667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.351104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-f440bfa9-e8c3-4119-ac38-a5530d000667 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:03.352345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-f440bfa9-e8c3-4119-ac38-a5530d000667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:03.360819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1012/2001] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:03.368544 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13690a-81f3-492a-bfc7-583f56775138 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.368835 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13690a-81f3-492a-bfc7-583f56775138 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.369116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13690a-81f3-492a-bfc7-583f56775138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.387231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6f13690a-81f3-492a-bfc7-583f56775138 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:03.388419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6f13690a-81f3-492a-bfc7-583f56775138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:03.406295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4caac297f3f140c889beb0255b8c5e70', 'request_id': 'req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:03.420638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:03.447149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1013/2002] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:03.451409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13690a-81f3-492a-bfc7-583f56775138 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:03.460972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13690a-81f3-492a-bfc7-583f56775138 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:03.465889 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b64fe-5c0d-4c0a-a5c2-68997b3e1df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:03.466140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4caac297f3f140c889beb0255b8c5e70', 'request_id': 'req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:03.466568 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b64fe-5c0d-4c0a-a5c2-68997b3e1df1 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.466856 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b64fe-5c0d-4c0a-a5c2-68997b3e1df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.467139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b64fe-5c0d-4c0a-a5c2-68997b3e1df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.467867 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b64fe-5c0d-4c0a-a5c2-68997b3e1df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:01:03.468181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b64fe-5c0d-4c0a-a5c2-68997b3e1df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:03.469929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b64fe-5c0d-4c0a-a5c2-68997b3e1df1 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:03.473077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4caac297f3f140c889beb0255b8c5e70', 'request_id': 'req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:03.482560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1014/2003] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:01:03.486324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39 admin admin] The token cache is being invalidate because project 4caac297f3f140c889beb0255b8c5e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:03.486619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:03.486928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b64fe-5c0d-4c0a-a5c2-68997b3e1df1 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:03.487324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b00f33d9-8dc3-4754-87b0-bc9b791a3d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:03.488558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-879b64fe-5c0d-4c0a-a5c2-68997b3e1df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:03.488795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 990/2004] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:03 2022] DELETE /identity/v3/projects/4caac297f3f140c889beb0255b8c5e70 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:03.495754 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c600a0f-1cac-495c-87c1-d60e08e40dd6 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.496044 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c600a0f-1cac-495c-87c1-d60e08e40dd6 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.496671 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c600a0f-1cac-495c-87c1-d60e08e40dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.507146 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b64fe-5c0d-4c0a-a5c2-68997b3e1df1 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:03.512265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7645a7-8d5c-4c67-995e-14aa6734e830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:03.512939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7645a7-8d5c-4c67-995e-14aa6734e830 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.513227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7645a7-8d5c-4c67-995e-14aa6734e830 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.513547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7645a7-8d5c-4c67-995e-14aa6734e830 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.514311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7645a7-8d5c-4c67-995e-14aa6734e830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:03.516201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7645a7-8d5c-4c67-995e-14aa6734e830 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:03.518864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-5c600a0f-1cac-495c-87c1-d60e08e40dd6 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:03.520139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5c600a0f-1cac-495c-87c1-d60e08e40dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:03.528211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 991/2005] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:03.536434 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4267725-35ad-49f3-94bd-48a784a48b6a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.536664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4267725-35ad-49f3-94bd-48a784a48b6a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.536939 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4267725-35ad-49f3-94bd-48a784a48b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.561297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d4267725-35ad-49f3-94bd-48a784a48b6a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:03.561297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d4267725-35ad-49f3-94bd-48a784a48b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:03.564006 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 992/2006] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:03.568718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4267725-35ad-49f3-94bd-48a784a48b6a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:03.577708 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4267725-35ad-49f3-94bd-48a784a48b6a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:03.584666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7c58d-8468-428e-b867-69bd043203ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:03.585539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7c58d-8468-428e-b867-69bd043203ef admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.590067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7c58d-8468-428e-b867-69bd043203ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.590067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7c58d-8468-428e-b867-69bd043203ef admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.590067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7c58d-8468-428e-b867-69bd043203ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:01:03.590067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7c58d-8468-428e-b867-69bd043203ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:03.590067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7c58d-8468-428e-b867-69bd043203ef admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:03.601361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 993/2007] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:01:03.606384 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7c58d-8468-428e-b867-69bd043203ef admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:03.616183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7c58d-8468-428e-b867-69bd043203ef admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:03.616636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1015/2008] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:03 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:01:03.629042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7645a7-8d5c-4c67-995e-14aa6734e830 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:03.688828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9979a-71d3-47ed-a2f9-de71e84bcdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:03.690105 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9979a-71d3-47ed-a2f9-de71e84bcdc4 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.690392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9979a-71d3-47ed-a2f9-de71e84bcdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.690674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9979a-71d3-47ed-a2f9-de71e84bcdc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.691369 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9979a-71d3-47ed-a2f9-de71e84bcdc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:03.693294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9979a-71d3-47ed-a2f9-de71e84bcdc4 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:03.707011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7645a7-8d5c-4c67-995e-14aa6734e830 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:03.712241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e08cd-98e0-4800-ac5f-5bb516ed4d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:03.712999 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e08cd-98e0-4800-ac5f-5bb516ed4d8b admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.713319 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e08cd-98e0-4800-ac5f-5bb516ed4d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.713682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e08cd-98e0-4800-ac5f-5bb516ed4d8b admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.714454 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e08cd-98e0-4800-ac5f-5bb516ed4d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:03.716811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e08cd-98e0-4800-ac5f-5bb516ed4d8b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:03.790846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 994/2009] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:03 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:01:03.794914 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9979a-71d3-47ed-a2f9-de71e84bcdc4 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:03.819794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1016/2010] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:03 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:03.821335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e08cd-98e0-4800-ac5f-5bb516ed4d8b admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:03.832064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e08cd-98e0-4800-ac5f-5bb516ed4d8b admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:03.861080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9979a-71d3-47ed-a2f9-de71e84bcdc4 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:03.866568 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6627dc-08ca-47b7-8658-4aee49e9a07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:03.867253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6627dc-08ca-47b7-8658-4aee49e9a07b admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.867673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6627dc-08ca-47b7-8658-4aee49e9a07b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.867961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6627dc-08ca-47b7-8658-4aee49e9a07b admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.868673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6627dc-08ca-47b7-8658-4aee49e9a07b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:03.870887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6627dc-08ca-47b7-8658-4aee49e9a07b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:03.891822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b859aa-51c7-470d-a99f-c775669547e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:03.892536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b859aa-51c7-470d-a99f-c775669547e9 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.892942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b859aa-51c7-470d-a99f-c775669547e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.893241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b859aa-51c7-470d-a99f-c775669547e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.894011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b859aa-51c7-470d-a99f-c775669547e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:03.895621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b859aa-51c7-470d-a99f-c775669547e9 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:03.907711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1017/2011] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:01:03.912190 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b859aa-51c7-470d-a99f-c775669547e9 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:03.924819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b859aa-51c7-470d-a99f-c775669547e9 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:03.930073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17addc-f355-4790-971f-9318f283cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:03.930720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17addc-f355-4790-971f-9318f283cf72 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.931012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17addc-f355-4790-971f-9318f283cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.931508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17addc-f355-4790-971f-9318f283cf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.932321 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17addc-f355-4790-971f-9318f283cf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:03.934009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17addc-f355-4790-971f-9318f283cf72 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:03.945544 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1018/2012] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:01:03.949635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17addc-f355-4790-971f-9318f283cf72 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:03.961452 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17addc-f355-4790-971f-9318f283cf72 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:03.967544 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 995/2013] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:03 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:01:03.970384 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbf12e-1623-435d-8a2e-656fc4b3cdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:03.970572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6627dc-08ca-47b7-8658-4aee49e9a07b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:03.971925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbf12e-1623-435d-8a2e-656fc4b3cdea admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.972219 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbf12e-1623-435d-8a2e-656fc4b3cdea admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.972504 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbf12e-1623-435d-8a2e-656fc4b3cdea admin admin] PATH_INFO: `/v3/projects/0e69357f07c14e4ea1f9c50d9f73c868/users/ae01fc6f989246bca134390feeaee01b/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.982297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6627dc-08ca-47b7-8658-4aee49e9a07b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:03.990098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499a9c4-f3e7-45bf-898e-292317660d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:03.991098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499a9c4-f3e7-45bf-898e-292317660d04 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:03.994628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499a9c4-f3e7-45bf-898e-292317660d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:03.994749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbf12e-1623-435d-8a2e-656fc4b3cdea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e69357f07c14e4ea1f9c50d9f73c868, user_id=ae01fc6f989246bca134390feeaee01b, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:03.994844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499a9c4-f3e7-45bf-898e-292317660d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:03.994844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499a9c4-f3e7-45bf-898e-292317660d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:03.994844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499a9c4-f3e7-45bf-898e-292317660d04 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:03.995049 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbf12e-1623-435d-8a2e-656fc4b3cdea admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:04.009702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 996/2014] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:04.011144 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499a9c4-f3e7-45bf-898e-292317660d04 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:04.023429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499a9c4-f3e7-45bf-898e-292317660d04 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:04.027562 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972fc29-4c44-4a9d-9db4-cc8e8cc5aca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:04.028235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972fc29-4c44-4a9d-9db4-cc8e8cc5aca1 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:04.028524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972fc29-4c44-4a9d-9db4-cc8e8cc5aca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:04.028807 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972fc29-4c44-4a9d-9db4-cc8e8cc5aca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:04.029567 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972fc29-4c44-4a9d-9db4-cc8e8cc5aca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:04.031232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972fc29-4c44-4a9d-9db4-cc8e8cc5aca1 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:04.045182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 997/2015] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:01:04.046412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972fc29-4c44-4a9d-9db4-cc8e8cc5aca1 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:04.063661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972fc29-4c44-4a9d-9db4-cc8e8cc5aca1 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:04.069208 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d90a5-aecf-4538-ad94-c583b5da5d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:04.070224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d90a5-aecf-4538-ad94-c583b5da5d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:04.070512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d90a5-aecf-4538-ad94-c583b5da5d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:04.070794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d90a5-aecf-4538-ad94-c583b5da5d49 admin admin] PATH_INFO: `/v3/projects/c2c50e12893a4030acb9f3af0351bf71/users/c41fd9b3860546168ce3f78ff5da32d5/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:04.086230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d90a5-aecf-4538-ad94-c583b5da5d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c50e12893a4030acb9f3af0351bf71, user_id=c41fd9b3860546168ce3f78ff5da32d5, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:04.089115 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d90a5-aecf-4538-ad94-c583b5da5d49 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:04.115365 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1019/2016] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:03 2022] PUT /identity/v3/projects/0e69357f07c14e4ea1f9c50d9f73c868/users/ae01fc6f989246bca134390feeaee01b/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:01:04.126084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9f22-7f9f-4678-b8da-84670ecc5905 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:04.126371 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9f22-7f9f-4678-b8da-84670ecc5905 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:04.126653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9f22-7f9f-4678-b8da-84670ecc5905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:04.169224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 998/2017] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:04 2022] PUT /identity/v3/projects/c2c50e12893a4030acb9f3af0351bf71/users/c41fd9b3860546168ce3f78ff5da32d5/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:04.169685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-fd9e9f22-7f9f-4678-b8da-84670ecc5905 None None] MFA Rules not processed for user `ae01fc6f989246bca134390feeaee01b`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:04.171150 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-fd9e9f22-7f9f-4678-b8da-84670ecc5905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:04.180791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ee2b0-6cc9-4849-9d45-3a09cbfd2ea8 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:04.181395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ee2b0-6cc9-4849-9d45-3a09cbfd2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:04.181757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ee2b0-6cc9-4849-9d45-3a09cbfd2ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:04.216729 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-af6ee2b0-6cc9-4849-9d45-3a09cbfd2ea8 None None] MFA Rules not processed for user `c41fd9b3860546168ce3f78ff5da32d5`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:04.217925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-af6ee2b0-6cc9-4849-9d45-3a09cbfd2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:04.259437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1020/2018] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:04.264834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e9f22-7f9f-4678-b8da-84670ecc5905 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:04.313295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 999/2019] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:04.322483 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ee2b0-6cc9-4849-9d45-3a09cbfd2ea8 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:04.323852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-af6ee2b0-6cc9-4849-9d45-3a09cbfd2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:04.353200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e9f22-7f9f-4678-b8da-84670ecc5905 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:04.358089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fb780-424e-4082-89e5-2208b65635c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:04.358748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fb780-424e-4082-89e5-2208b65635c2 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:04.359089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fb780-424e-4082-89e5-2208b65635c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:04.359379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fb780-424e-4082-89e5-2208b65635c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:04.360601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fb780-424e-4082-89e5-2208b65635c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:04.362107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fb780-424e-4082-89e5-2208b65635c2 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:04.388200 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ee2b0-6cc9-4849-9d45-3a09cbfd2ea8 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:04.393140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6b601-f809-4147-8735-14bdd7097344 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a22cd803304a19a58bfbe17addb11f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:04.393513 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6b601-f809-4147-8735-14bdd7097344 service glance] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:04.393809 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6b601-f809-4147-8735-14bdd7097344 service glance] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:04.394077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6b601-f809-4147-8735-14bdd7097344 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:04.403596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6b601-f809-4147-8735-14bdd7097344 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:04.405057 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6b601-f809-4147-8735-14bdd7097344 service glance] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:04.414653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1000/2020] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:01:04.480095 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1021/2021] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:04 2022] POST /identity/v3/projects => generated 365 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:04.484698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6b601-f809-4147-8735-14bdd7097344 service glance] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:04.499989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6b601-f809-4147-8735-14bdd7097344 service glance] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:04.581447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290193e-b148-48a2-9419-5595ee8b933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:04.584377 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290193e-b148-48a2-9419-5595ee8b933f admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:04.584377 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290193e-b148-48a2-9419-5595ee8b933f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:04.584377 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290193e-b148-48a2-9419-5595ee8b933f admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:04.584377 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290193e-b148-48a2-9419-5595ee8b933f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:04.585464 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290193e-b148-48a2-9419-5595ee8b933f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:04.613781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:04.684444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1001/2022] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:04 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:04.690647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fb780-424e-4082-89e5-2208b65635c2 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:04.709510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fb780-424e-4082-89e5-2208b65635c2 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:04.716285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9050fd2-b29f-4dd2-8e60-6ebfc4441506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:04.716285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9050fd2-b29f-4dd2-8e60-6ebfc4441506 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:04.716285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9050fd2-b29f-4dd2-8e60-6ebfc4441506 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:04.716285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9050fd2-b29f-4dd2-8e60-6ebfc4441506 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:04.716741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9050fd2-b29f-4dd2-8e60-6ebfc4441506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:04.718948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9050fd2-b29f-4dd2-8e60-6ebfc4441506 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:04.730512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1022/2023] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:04.734589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290193e-b148-48a2-9419-5595ee8b933f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:04.745336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290193e-b148-48a2-9419-5595ee8b933f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:04.750320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0831b-8e9d-49d6-a5c4-bae053187587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:04.751210 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0831b-8e9d-49d6-a5c4-bae053187587 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:04.751488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0831b-8e9d-49d6-a5c4-bae053187587 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:04.752403 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0831b-8e9d-49d6-a5c4-bae053187587 admin admin] PATH_INFO: `/v3/projects/917dfc740c54485da4158ddd2af39119/users/bc3e39d7e6a0400585b639596266d2a6/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:04.767398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0831b-8e9d-49d6-a5c4-bae053187587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917dfc740c54485da4158ddd2af39119, user_id=bc3e39d7e6a0400585b639596266d2a6, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:04.772913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0831b-8e9d-49d6-a5c4-bae053187587 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:04.874346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1002/2024] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:04 2022] PUT /identity/v3/projects/917dfc740c54485da4158ddd2af39119/users/bc3e39d7e6a0400585b639596266d2a6/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:04.878924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9050fd2-b29f-4dd2-8e60-6ebfc4441506 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:04.889333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9050fd2-b29f-4dd2-8e60-6ebfc4441506 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:04.949121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc235f-a131-4c65-aa1c-ad89cea87fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:04.949812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc235f-a131-4c65-aa1c-ad89cea87fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:04.950351 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc235f-a131-4c65-aa1c-ad89cea87fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:04.950351 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc235f-a131-4c65-aa1c-ad89cea87fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:04.951055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc235f-a131-4c65-aa1c-ad89cea87fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:04.952639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc235f-a131-4c65-aa1c-ad89cea87fb8 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:04.962460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1023/2025] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:01:04.966910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0831b-8e9d-49d6-a5c4-bae053187587 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:04.977355 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0831b-8e9d-49d6-a5c4-bae053187587 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:04.983528 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e162d8-18be-4309-9ee7-ee77aff1d14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:04.984430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e162d8-18be-4309-9ee7-ee77aff1d14c admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:04.984714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e162d8-18be-4309-9ee7-ee77aff1d14c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:04.984996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e162d8-18be-4309-9ee7-ee77aff1d14c admin admin] PATH_INFO: `/v3/projects/917dfc740c54485da4158ddd2af39119/users/bc3e39d7e6a0400585b639596266d2a6/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:04.987590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e162d8-18be-4309-9ee7-ee77aff1d14c admin admin] RBAC: Authorizing `identity:create_grant(project_id=917dfc740c54485da4158ddd2af39119, user_id=bc3e39d7e6a0400585b639596266d2a6, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:04.990273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e162d8-18be-4309-9ee7-ee77aff1d14c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:05.001049 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1003/2026] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:04 2022] PUT /identity/v3/projects/917dfc740c54485da4158ddd2af39119/users/bc3e39d7e6a0400585b639596266d2a6/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:05.013349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbb171-dc95-4268-b89f-8396a2b01fa6 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:05.013673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbb171-dc95-4268-b89f-8396a2b01fa6 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:05.013954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbb171-dc95-4268-b89f-8396a2b01fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:05.041128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-18bbb171-dc95-4268-b89f-8396a2b01fa6 None None] MFA Rules not processed for user `bc3e39d7e6a0400585b639596266d2a6`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:05.042401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-18bbb171-dc95-4268-b89f-8396a2b01fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:05.123672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1024/2027] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:05.132147 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e162d8-18be-4309-9ee7-ee77aff1d14c admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:05.134026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-36e162d8-18be-4309-9ee7-ee77aff1d14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:05.194389 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e162d8-18be-4309-9ee7-ee77aff1d14c admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:05.198307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca99d8b-1761-41b1-9b22-701de1699b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:05.199061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca99d8b-1761-41b1-9b22-701de1699b15 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:05.199327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca99d8b-1761-41b1-9b22-701de1699b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:05.199613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca99d8b-1761-41b1-9b22-701de1699b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:05.210707 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca99d8b-1761-41b1-9b22-701de1699b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:05.212307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca99d8b-1761-41b1-9b22-701de1699b15 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:05.237972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1004/2028] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:05.341125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:05.469913 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbb171-dc95-4268-b89f-8396a2b01fa6 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:05.480321 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbb171-dc95-4268-b89f-8396a2b01fa6 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:05.483930 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c93005-f12d-4abf-a661-3803fadec69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:05.485571 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c93005-f12d-4abf-a661-3803fadec69f service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:05.485571 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c93005-f12d-4abf-a661-3803fadec69f service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:05.485571 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c93005-f12d-4abf-a661-3803fadec69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:05.547031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c93005-f12d-4abf-a661-3803fadec69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:05.548507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c93005-f12d-4abf-a661-3803fadec69f service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:05.557604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1025/2029] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:06.038755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:06.578325 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:06.784558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:07.094777 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:07.186249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:07.326862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:07.821217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:08.249242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:08.481027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:09.026357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:09.157715 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:09.283839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:09.500886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:09.869898 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:10.243301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:10.308584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca99d8b-1761-41b1-9b22-701de1699b15 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:10.318564 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca99d8b-1761-41b1-9b22-701de1699b15 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:10.322378 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cf31f-8ec7-47ec-84c0-469419e682ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:10.323053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cf31f-8ec7-47ec-84c0-469419e682ab service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:10.323337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cf31f-8ec7-47ec-84c0-469419e682ab service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:10.323612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cf31f-8ec7-47ec-84c0-469419e682ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:10.325431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-201cf31f-8ec7-47ec-84c0-469419e682ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:10.399694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cf31f-8ec7-47ec-84c0-469419e682ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:10.401227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cf31f-8ec7-47ec-84c0-469419e682ab service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:10.411908 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1005/2030] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:10.460757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:10.517856 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:10.717522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:10.757569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:10.889325 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:11.054677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:11.140384 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:11.226011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:11.407392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:11.460410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:12.192225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:12.724087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:14.655640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c93005-f12d-4abf-a661-3803fadec69f service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:14.729556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c93005-f12d-4abf-a661-3803fadec69f service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:14.734205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:14.735086 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:14.738854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:14.738854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] PATH_INFO: `/v3/users/ae01fc6f989246bca134390feeaee01b` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:14.738854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae01fc6f989246bca134390feeaee01b)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:14.739461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:14.755471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:14.945964 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae01fc6f989246bca134390feeaee01b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:15.023457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae01fc6f989246bca134390feeaee01b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:15.034799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae01fc6f989246bca134390feeaee01b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:15.035904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae01fc6f989246bca134390feeaee01b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:15.036793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae01fc6f989246bca134390feeaee01b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:15.056536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1026/2031] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:14 2022] DELETE /identity/v3/users/ae01fc6f989246bca134390feeaee01b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:15.061165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d898b1-7e41-4d69-984b-9eefef8024a7 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:15.061666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d898b1-7e41-4d69-984b-9eefef8024a7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:15.061755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d898b1-7e41-4d69-984b-9eefef8024a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:15.069060 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:15.080302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-57d898b1-7e41-4d69-984b-9eefef8024a7 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:15.082193 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-57d898b1-7e41-4d69-984b-9eefef8024a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:15.145316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1006/2032] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:15.154982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:15.156400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:15.220000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00bf32-a2f0-42bf-a8be-5501a0cf4c45 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:15.224458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6256a27-25ac-4451-a4ba-6a4fdef59ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:15.225118 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6256a27-25ac-4451-a4ba-6a4fdef59ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:15.225427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6256a27-25ac-4451-a4ba-6a4fdef59ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:15.225712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6256a27-25ac-4451-a4ba-6a4fdef59ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:15.235700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6256a27-25ac-4451-a4ba-6a4fdef59ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:15.237176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6256a27-25ac-4451-a4ba-6a4fdef59ba9 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:15.248839 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1027/2033] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:15.755319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d898b1-7e41-4d69-984b-9eefef8024a7 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:15.756822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-57d898b1-7e41-4d69-984b-9eefef8024a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:15.770126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d898b1-7e41-4d69-984b-9eefef8024a7 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:15.782904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:15.783880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:15.784708 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:15.785157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] PATH_INFO: `/v3/projects/0e69357f07c14e4ea1f9c50d9f73c868` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:15.786876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e69357f07c14e4ea1f9c50d9f73c868)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:15.788999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:15.916327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e69357f07c14e4ea1f9c50d9f73c868', 'request_id': 'req-bad6e74d-8f58-4371-8669-f307653caa32'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:15.989487 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e69357f07c14e4ea1f9c50d9f73c868', 'request_id': 'req-bad6e74d-8f58-4371-8669-f307653caa32'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:15.995960 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e69357f07c14e4ea1f9c50d9f73c868', 'request_id': 'req-bad6e74d-8f58-4371-8669-f307653caa32'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:16.010100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] The token cache is being invalidate because project 0e69357f07c14e4ea1f9c50d9f73c868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:16.010397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:16.011107 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:16.012694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1007/2034] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:15 2022] DELETE /identity/v3/projects/0e69357f07c14e4ea1f9c50d9f73c868 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:16.016941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6256a27-25ac-4451-a4ba-6a4fdef59ba9 service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:16.027094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6256a27-25ac-4451-a4ba-6a4fdef59ba9 service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:16.087593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b55e1-68db-4a76-a40a-bae770f58af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:16.088620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b55e1-68db-4a76-a40a-bae770f58af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:16.088946 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b55e1-68db-4a76-a40a-bae770f58af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:16.089290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b55e1-68db-4a76-a40a-bae770f58af5 admin admin] PATH_INFO: `/v3/users/bc3e39d7e6a0400585b639596266d2a6` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:16.091063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b55e1-68db-4a76-a40a-bae770f58af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc3e39d7e6a0400585b639596266d2a6)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:16.093563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b55e1-68db-4a76-a40a-bae770f58af5 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:16.315690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:16.330007 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d76b55e1-68db-4a76-a40a-bae770f58af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc3e39d7e6a0400585b639596266d2a6'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:16.448800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d76b55e1-68db-4a76-a40a-bae770f58af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc3e39d7e6a0400585b639596266d2a6'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:16.457741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d76b55e1-68db-4a76-a40a-bae770f58af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc3e39d7e6a0400585b639596266d2a6'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:16.458634 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d76b55e1-68db-4a76-a40a-bae770f58af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc3e39d7e6a0400585b639596266d2a6'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:16.459362 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d76b55e1-68db-4a76-a40a-bae770f58af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc3e39d7e6a0400585b639596266d2a6'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:16.482523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1028/2035] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:16 2022] DELETE /identity/v3/users/bc3e39d7e6a0400585b639596266d2a6 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:16.982382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:16.984628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:17.026663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6e74d-8f58-4371-8669-f307653caa32 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:17.099784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13265b6c-5aa3-480c-a663-5904a37ff952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:17.100614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13265b6c-5aa3-480c-a663-5904a37ff952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:17.100896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13265b6c-5aa3-480c-a663-5904a37ff952 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:17.101175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13265b6c-5aa3-480c-a663-5904a37ff952 admin admin] PATH_INFO: `/v3/projects/917dfc740c54485da4158ddd2af39119` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:17.102501 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13265b6c-5aa3-480c-a663-5904a37ff952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=917dfc740c54485da4158ddd2af39119)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:17.104457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13265b6c-5aa3-480c-a663-5904a37ff952 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:17.197451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:17.210543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-13265b6c-5aa3-480c-a663-5904a37ff952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917dfc740c54485da4158ddd2af39119', 'request_id': 'req-13265b6c-5aa3-480c-a663-5904a37ff952'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:17.274973 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-13265b6c-5aa3-480c-a663-5904a37ff952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917dfc740c54485da4158ddd2af39119', 'request_id': 'req-13265b6c-5aa3-480c-a663-5904a37ff952'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:17.281276 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-13265b6c-5aa3-480c-a663-5904a37ff952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917dfc740c54485da4158ddd2af39119', 'request_id': 'req-13265b6c-5aa3-480c-a663-5904a37ff952'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:17.293598 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-13265b6c-5aa3-480c-a663-5904a37ff952 admin admin] The token cache is being invalidate because project 917dfc740c54485da4158ddd2af39119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:17.293887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-13265b6c-5aa3-480c-a663-5904a37ff952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:17.294525 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-13265b6c-5aa3-480c-a663-5904a37ff952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:17.296067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1008/2036] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:16 2022] DELETE /identity/v3/projects/917dfc740c54485da4158ddd2af39119 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:17.303199 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cb420-5802-47ee-baad-4cc5aa1fa86b None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:17.303687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cb420-5802-47ee-baad-4cc5aa1fa86b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:17.303778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cb420-5802-47ee-baad-4cc5aa1fa86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:17.334167 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b65cb420-5802-47ee-baad-4cc5aa1fa86b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:17.335346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b65cb420-5802-47ee-baad-4cc5aa1fa86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:17.396727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1029/2037] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:17.404370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26c72-9848-4275-b7e0-56d720132638 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:17.404662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26c72-9848-4275-b7e0-56d720132638 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:17.404941 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26c72-9848-4275-b7e0-56d720132638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:17.423256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b5d26c72-9848-4275-b7e0-56d720132638 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:17.424459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b5d26c72-9848-4275-b7e0-56d720132638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:17.433155 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1009/2038] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:17.436974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cb420-5802-47ee-baad-4cc5aa1fa86b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:17.447767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cb420-5802-47ee-baad-4cc5aa1fa86b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:17.452530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20e1a-b0e5-44d7-b74c-f249e37e3856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:17.453018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20e1a-b0e5-44d7-b74c-f249e37e3856 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:17.453301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20e1a-b0e5-44d7-b74c-f249e37e3856 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:17.453611 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20e1a-b0e5-44d7-b74c-f249e37e3856 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:17.454342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef20e1a-b0e5-44d7-b74c-f249e37e3856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:01:17.454667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef20e1a-b0e5-44d7-b74c-f249e37e3856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:17.456742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef20e1a-b0e5-44d7-b74c-f249e37e3856 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:17.470490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1030/2039] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:01:17.478918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d26c72-9848-4275-b7e0-56d720132638 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:17.496872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d26c72-9848-4275-b7e0-56d720132638 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:17.501627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee9d92-6042-47fd-99f0-bd8e4246404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:17.502340 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee9d92-6042-47fd-99f0-bd8e4246404c admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:17.502626 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee9d92-6042-47fd-99f0-bd8e4246404c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:17.503526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee9d92-6042-47fd-99f0-bd8e4246404c admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:17.504258 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee9d92-6042-47fd-99f0-bd8e4246404c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:17.506222 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee9d92-6042-47fd-99f0-bd8e4246404c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:17.610668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1010/2040] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:17 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:17.615428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20e1a-b0e5-44d7-b74c-f249e37e3856 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:17.625690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20e1a-b0e5-44d7-b74c-f249e37e3856 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:17.686993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b5e7b-38eb-47c6-b76f-1c2de51f06b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:17.687664 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b5e7b-38eb-47c6-b76f-1c2de51f06b7 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:17.687950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b5e7b-38eb-47c6-b76f-1c2de51f06b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:17.688228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b5e7b-38eb-47c6-b76f-1c2de51f06b7 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:17.688943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b5e7b-38eb-47c6-b76f-1c2de51f06b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:17.691487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b5e7b-38eb-47c6-b76f-1c2de51f06b7 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:17.791999 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1031/2041] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:17 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:17.796049 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee9d92-6042-47fd-99f0-bd8e4246404c admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:17.806546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee9d92-6042-47fd-99f0-bd8e4246404c admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:17.811151 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009aae67-4040-4980-80ec-c8f92f06960e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:17.811805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aae67-4040-4980-80ec-c8f92f06960e admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:17.812094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aae67-4040-4980-80ec-c8f92f06960e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:17.812372 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aae67-4040-4980-80ec-c8f92f06960e admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:17.813112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009aae67-4040-4980-80ec-c8f92f06960e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:17.814829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009aae67-4040-4980-80ec-c8f92f06960e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:17.827158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1011/2042] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:17.832572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b5e7b-38eb-47c6-b76f-1c2de51f06b7 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:17.849400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b5e7b-38eb-47c6-b76f-1c2de51f06b7 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:17.853983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483f717-2c5e-4969-b7de-7ca78a2fd41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:17.855034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483f717-2c5e-4969-b7de-7ca78a2fd41a admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:17.855034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483f717-2c5e-4969-b7de-7ca78a2fd41a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:17.855241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483f717-2c5e-4969-b7de-7ca78a2fd41a admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:17.855895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483f717-2c5e-4969-b7de-7ca78a2fd41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:17.857562 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483f717-2c5e-4969-b7de-7ca78a2fd41a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:17.874183 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1032/2043] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:17.878855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009aae67-4040-4980-80ec-c8f92f06960e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:17.888990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009aae67-4040-4980-80ec-c8f92f06960e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:17.894785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3206631-1beb-46a2-b8dd-bb9a42e0374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:17.895798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206631-1beb-46a2-b8dd-bb9a42e0374f admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:17.896191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206631-1beb-46a2-b8dd-bb9a42e0374f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:17.896575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206631-1beb-46a2-b8dd-bb9a42e0374f admin admin] PATH_INFO: `/v3/projects/0c583b08fcae4f96b40e8308454ce553/users/41fb99cb08cd46639578db3781a239aa/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:17.912027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3206631-1beb-46a2-b8dd-bb9a42e0374f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c583b08fcae4f96b40e8308454ce553, user_id=41fb99cb08cd46639578db3781a239aa, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:17.914842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3206631-1beb-46a2-b8dd-bb9a42e0374f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:18.012516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1012/2044] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:17 2022] PUT /identity/v3/projects/0c583b08fcae4f96b40e8308454ce553/users/41fb99cb08cd46639578db3781a239aa/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:01:18.022546 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bb914-4832-454e-a0e9-f72b465a266e None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:18.022911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bb914-4832-454e-a0e9-f72b465a266e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:18.023450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bb914-4832-454e-a0e9-f72b465a266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:18.042594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:18.052427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-e94bb914-4832-454e-a0e9-f72b465a266e None None] MFA Rules not processed for user `41fb99cb08cd46639578db3781a239aa`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:18.053667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e94bb914-4832-454e-a0e9-f72b465a266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:18.130614 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1033/2045] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:18.138119 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3206631-1beb-46a2-b8dd-bb9a42e0374f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:18.224794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3206631-1beb-46a2-b8dd-bb9a42e0374f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:18.229539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ad168-f182-4a6a-ab53-47181fc5aff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:18.230204 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ad168-f182-4a6a-ab53-47181fc5aff9 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:18.230487 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ad168-f182-4a6a-ab53-47181fc5aff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:18.230771 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ad168-f182-4a6a-ab53-47181fc5aff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:18.231462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ad168-f182-4a6a-ab53-47181fc5aff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:18.233453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ad168-f182-4a6a-ab53-47181fc5aff9 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:18.325306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1013/2046] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:18 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:18.329195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bb914-4832-454e-a0e9-f72b465a266e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:18.339901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bb914-4832-454e-a0e9-f72b465a266e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:18.399118 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef0fe8-5ccf-4694-927f-00335dca4e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:18.400088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef0fe8-5ccf-4694-927f-00335dca4e77 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:18.400537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef0fe8-5ccf-4694-927f-00335dca4e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:18.400811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef0fe8-5ccf-4694-927f-00335dca4e77 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:18.401548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef0fe8-5ccf-4694-927f-00335dca4e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:18.403631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef0fe8-5ccf-4694-927f-00335dca4e77 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:18.472096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1034/2047] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:18 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:18.476119 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ad168-f182-4a6a-ab53-47181fc5aff9 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:18.487055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ad168-f182-4a6a-ab53-47181fc5aff9 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:18.492784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39c879-ecd7-47e9-a083-485312f09446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:18.493730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c879-ecd7-47e9-a083-485312f09446 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:18.494169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c879-ecd7-47e9-a083-485312f09446 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:18.494661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c879-ecd7-47e9-a083-485312f09446 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:18.495649 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39c879-ecd7-47e9-a083-485312f09446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:18.497925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39c879-ecd7-47e9-a083-485312f09446 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:18.511663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1014/2048] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:18.516544 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef0fe8-5ccf-4694-927f-00335dca4e77 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:18.527376 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef0fe8-5ccf-4694-927f-00335dca4e77 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:18.532253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429442c1-e8a2-4a96-a3b0-934529969554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:18.534001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429442c1-e8a2-4a96-a3b0-934529969554 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:18.534001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429442c1-e8a2-4a96-a3b0-934529969554 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:18.534001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429442c1-e8a2-4a96-a3b0-934529969554 admin admin] PATH_INFO: `/v3/projects/8c26db66638049b99543be6feded0011/users/fd584f937b614ecb9a1fc095afcf1252/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:18.551476 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429442c1-e8a2-4a96-a3b0-934529969554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c26db66638049b99543be6feded0011, user_id=fd584f937b614ecb9a1fc095afcf1252, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:18.554291 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429442c1-e8a2-4a96-a3b0-934529969554 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:18.689194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1035/2049] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:18 2022] PUT /identity/v3/projects/8c26db66638049b99543be6feded0011/users/fd584f937b614ecb9a1fc095afcf1252/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:18.693744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39c879-ecd7-47e9-a083-485312f09446 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:18.703977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39c879-ecd7-47e9-a083-485312f09446 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:18.730359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:18.764281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4059e91-b981-415d-a3aa-b15f9767d195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:18.764956 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059e91-b981-415d-a3aa-b15f9767d195 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:18.765241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059e91-b981-415d-a3aa-b15f9767d195 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:18.765554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059e91-b981-415d-a3aa-b15f9767d195 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:18.766279 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4059e91-b981-415d-a3aa-b15f9767d195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:18.768006 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4059e91-b981-415d-a3aa-b15f9767d195 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:18.778727 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1015/2050] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:18.783051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429442c1-e8a2-4a96-a3b0-934529969554 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:18.794348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429442c1-e8a2-4a96-a3b0-934529969554 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:18.798982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d1104-dfd7-4832-b593-41695f6af9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:18.799819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d1104-dfd7-4832-b593-41695f6af9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:18.800099 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d1104-dfd7-4832-b593-41695f6af9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:18.800398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d1104-dfd7-4832-b593-41695f6af9eb admin admin] PATH_INFO: `/v3/projects/8c26db66638049b99543be6feded0011/users/fd584f937b614ecb9a1fc095afcf1252/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:18.802486 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d1104-dfd7-4832-b593-41695f6af9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c26db66638049b99543be6feded0011, user_id=fd584f937b614ecb9a1fc095afcf1252, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:18.805165 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d1104-dfd7-4832-b593-41695f6af9eb admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:18.816104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1036/2051] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:18 2022] PUT /identity/v3/projects/8c26db66638049b99543be6feded0011/users/fd584f937b614ecb9a1fc095afcf1252/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:18.827512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4717ed7-d27f-4340-9202-9c41bf3a3fad None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:18.827836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4717ed7-d27f-4340-9202-9c41bf3a3fad None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:18.831584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4717ed7-d27f-4340-9202-9c41bf3a3fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:18.858040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d4717ed7-d27f-4340-9202-9c41bf3a3fad None None] MFA Rules not processed for user `fd584f937b614ecb9a1fc095afcf1252`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:18.859436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d4717ed7-d27f-4340-9202-9c41bf3a3fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:18.939910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1016/2052] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:18.946340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d1104-dfd7-4832-b593-41695f6af9eb admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:18.953624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-218d1104-dfd7-4832-b593-41695f6af9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:19.011429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d1104-dfd7-4832-b593-41695f6af9eb admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:19.014992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bba1a-8532-4223-83f9-c14408fe118a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:19.015640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bba1a-8532-4223-83f9-c14408fe118a service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:19.016015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bba1a-8532-4223-83f9-c14408fe118a service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:19.016283 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bba1a-8532-4223-83f9-c14408fe118a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:19.022333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:19.026468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bba1a-8532-4223-83f9-c14408fe118a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:19.027910 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bba1a-8532-4223-83f9-c14408fe118a service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:19.037627 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1037/2053] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:19.065857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4717ed7-d27f-4340-9202-9c41bf3a3fad None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:19.132815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4717ed7-d27f-4340-9202-9c41bf3a3fad None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:19.137513 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:19.138392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:19.138675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:19.138954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] PATH_INFO: `/v3/users/41fb99cb08cd46639578db3781a239aa` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:19.140160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41fb99cb08cd46639578db3781a239aa)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:19.142163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:19.311995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41fb99cb08cd46639578db3781a239aa'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:19.316765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:19.380236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41fb99cb08cd46639578db3781a239aa'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:19.380882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41fb99cb08cd46639578db3781a239aa'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:19.389081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41fb99cb08cd46639578db3781a239aa'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:19.389827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41fb99cb08cd46639578db3781a239aa'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:19.410462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1017/2054] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:19 2022] DELETE /identity/v3/users/41fb99cb08cd46639578db3781a239aa => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:19.415901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69e66-5bb3-4875-9c87-166ff8bb0d16 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:19.416807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69e66-5bb3-4875-9c87-166ff8bb0d16 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:19.416807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69e66-5bb3-4875-9c87-166ff8bb0d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:19.446743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-e2a69e66-5bb3-4875-9c87-166ff8bb0d16 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:19.446743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e2a69e66-5bb3-4875-9c87-166ff8bb0d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:19.501910 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1038/2055] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:19.512296 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:19.513917 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:19.579249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ca0f1-dc17-4b22-910c-076b9ea6c521 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:19.580491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6062584-8479-4e41-a8d3-78e9ec1fa606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:19.582345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6062584-8479-4e41-a8d3-78e9ec1fa606 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:19.582746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6062584-8479-4e41-a8d3-78e9ec1fa606 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:19.584006 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6062584-8479-4e41-a8d3-78e9ec1fa606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:19.629159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6062584-8479-4e41-a8d3-78e9ec1fa606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:19.629159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6062584-8479-4e41-a8d3-78e9ec1fa606 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:19.629159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1018/2056] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:20.062266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a69e66-5bb3-4875-9c87-166ff8bb0d16 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:20.063588 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e2a69e66-5bb3-4875-9c87-166ff8bb0d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:20.077236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a69e66-5bb3-4875-9c87-166ff8bb0d16 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:20.084225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:20.089181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:20.089181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:20.089181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] PATH_INFO: `/v3/projects/0c583b08fcae4f96b40e8308454ce553` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:20.089181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c583b08fcae4f96b40e8308454ce553)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:20.089181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:20.248615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c583b08fcae4f96b40e8308454ce553', 'request_id': 'req-9f2a32f4-a4ba-438b-a21c-623f507bef6b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:20.337701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c583b08fcae4f96b40e8308454ce553', 'request_id': 'req-9f2a32f4-a4ba-438b-a21c-623f507bef6b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:20.344170 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c583b08fcae4f96b40e8308454ce553', 'request_id': 'req-9f2a32f4-a4ba-438b-a21c-623f507bef6b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:20.355938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] The token cache is being invalidate because project 0c583b08fcae4f96b40e8308454ce553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:20.357507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:20.358642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:20.360533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1039/2057] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:20 2022] DELETE /identity/v3/projects/0c583b08fcae4f96b40e8308454ce553 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:20.365127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6062584-8479-4e41-a8d3-78e9ec1fa606 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:20.375375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6062584-8479-4e41-a8d3-78e9ec1fa606 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:20.439903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf24aee-36ae-40ec-822f-68737d946c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:20.440794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf24aee-36ae-40ec-822f-68737d946c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:20.441672 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf24aee-36ae-40ec-822f-68737d946c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:20.442006 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf24aee-36ae-40ec-822f-68737d946c8f admin admin] PATH_INFO: `/v3/users/fd584f937b614ecb9a1fc095afcf1252` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:20.443243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf24aee-36ae-40ec-822f-68737d946c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd584f937b614ecb9a1fc095afcf1252)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:20.445356 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf24aee-36ae-40ec-822f-68737d946c8f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:20.697294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-5cf24aee-36ae-40ec-822f-68737d946c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd584f937b614ecb9a1fc095afcf1252'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:20.803005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-5cf24aee-36ae-40ec-822f-68737d946c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd584f937b614ecb9a1fc095afcf1252'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:20.803877 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-5cf24aee-36ae-40ec-822f-68737d946c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd584f937b614ecb9a1fc095afcf1252'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:20.813908 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-5cf24aee-36ae-40ec-822f-68737d946c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd584f937b614ecb9a1fc095afcf1252'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:20.814701 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-5cf24aee-36ae-40ec-822f-68737d946c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd584f937b614ecb9a1fc095afcf1252'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:20.826032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:20.832834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1019/2058] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:20 2022] DELETE /identity/v3/users/fd584f937b614ecb9a1fc095afcf1252 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:21.261703 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:21.263272 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:21.278436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a32f4-a4ba-438b-a21c-623f507bef6b admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:21.343490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:21.344287 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:21.344568 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:21.344845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550 admin admin] PATH_INFO: `/v3/projects/8c26db66638049b99543be6feded0011` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:21.346080 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c26db66638049b99543be6feded0011)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:21.348693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:21.374935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:21.471670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c26db66638049b99543be6feded0011', 'request_id': 'req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:21.572631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c26db66638049b99543be6feded0011', 'request_id': 'req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:21.579537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c26db66638049b99543be6feded0011', 'request_id': 'req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:21.595368 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550 admin admin] The token cache is being invalidate because project 8c26db66638049b99543be6feded0011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:21.595836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:21.596488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0a7dccb0-bdac-4684-9e84-0ccd0c11e550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:21.598692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1040/2059] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:21 2022] DELETE /identity/v3/projects/8c26db66638049b99543be6feded0011 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:21.603688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06cd49-5491-4945-8e56-17ce4c656dac None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:21.604181 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06cd49-5491-4945-8e56-17ce4c656dac None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:21.604282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06cd49-5491-4945-8e56-17ce4c656dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:21.624870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-eb06cd49-5491-4945-8e56-17ce4c656dac None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:21.626138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-eb06cd49-5491-4945-8e56-17ce4c656dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:21.699379 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1020/2060] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:21.709167 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827471d7-9ffa-4a85-ad05-e0abb150470e None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:21.709690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827471d7-9ffa-4a85-ad05-e0abb150470e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:21.709886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827471d7-9ffa-4a85-ad05-e0abb150470e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:21.732516 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-827471d7-9ffa-4a85-ad05-e0abb150470e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:21.733818 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-827471d7-9ffa-4a85-ad05-e0abb150470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:21.750026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1041/2061] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:21.755010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06cd49-5491-4945-8e56-17ce4c656dac None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:21.769895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06cd49-5491-4945-8e56-17ce4c656dac None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:21.775254 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ecece-7d05-4435-b259-31181d916f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:21.775917 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ecece-7d05-4435-b259-31181d916f80 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:21.776243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ecece-7d05-4435-b259-31181d916f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:21.776523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ecece-7d05-4435-b259-31181d916f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:21.777253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ecece-7d05-4435-b259-31181d916f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:01:21.777648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ecece-7d05-4435-b259-31181d916f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:21.783196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ecece-7d05-4435-b259-31181d916f80 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:21.792158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1021/2062] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:01:21.796494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827471d7-9ffa-4a85-ad05-e0abb150470e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:21.806895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827471d7-9ffa-4a85-ad05-e0abb150470e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:21.811721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34e136-5161-4d99-aeb1-df84018a3207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:21.812380 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34e136-5161-4d99-aeb1-df84018a3207 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:21.812671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34e136-5161-4d99-aeb1-df84018a3207 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:21.812947 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34e136-5161-4d99-aeb1-df84018a3207 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:21.813727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34e136-5161-4d99-aeb1-df84018a3207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:21.815677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34e136-5161-4d99-aeb1-df84018a3207 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:21.980736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1042/2063] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:21 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:01:21.984679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ecece-7d05-4435-b259-31181d916f80 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:21.994756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ecece-7d05-4435-b259-31181d916f80 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:22.052554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e71bc-f6a4-42bd-9122-777682f2f40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:22.053231 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e71bc-f6a4-42bd-9122-777682f2f40e admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:22.053554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e71bc-f6a4-42bd-9122-777682f2f40e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:22.053832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e71bc-f6a4-42bd-9122-777682f2f40e admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:22.054575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e71bc-f6a4-42bd-9122-777682f2f40e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:22.056521 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e71bc-f6a4-42bd-9122-777682f2f40e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:22.161936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1022/2064] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:21 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:22.167176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34e136-5161-4d99-aeb1-df84018a3207 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:22.177523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34e136-5161-4d99-aeb1-df84018a3207 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:22.182233 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40abc3-82a6-4224-91bb-21db22e07b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:22.182885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40abc3-82a6-4224-91bb-21db22e07b9e admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:22.183168 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40abc3-82a6-4224-91bb-21db22e07b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:22.183441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40abc3-82a6-4224-91bb-21db22e07b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:22.184162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40abc3-82a6-4224-91bb-21db22e07b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:22.185797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40abc3-82a6-4224-91bb-21db22e07b9e admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:22.198072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1043/2065] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:01:22.203006 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e71bc-f6a4-42bd-9122-777682f2f40e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:22.213563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e71bc-f6a4-42bd-9122-777682f2f40e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:22.218166 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45447f-7d51-49e0-8222-d1064eb374e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:22.218835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45447f-7d51-49e0-8222-d1064eb374e7 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:22.219213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45447f-7d51-49e0-8222-d1064eb374e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:22.219381 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45447f-7d51-49e0-8222-d1064eb374e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:22.220108 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45447f-7d51-49e0-8222-d1064eb374e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:22.221730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45447f-7d51-49e0-8222-d1064eb374e7 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:22.232198 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1023/2066] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:22.236214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40abc3-82a6-4224-91bb-21db22e07b9e admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:22.246732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40abc3-82a6-4224-91bb-21db22e07b9e admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:22.251677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593634d4-f383-464a-81bf-09050d9225b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:22.252648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593634d4-f383-464a-81bf-09050d9225b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:22.252966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593634d4-f383-464a-81bf-09050d9225b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:22.253229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593634d4-f383-464a-81bf-09050d9225b5 admin admin] PATH_INFO: `/v3/projects/a0a860373ad64a01aee5d9c91dcd5bd5/users/031e62a7e8024c908976d5913ddc552a/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:22.270670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593634d4-f383-464a-81bf-09050d9225b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a860373ad64a01aee5d9c91dcd5bd5, user_id=031e62a7e8024c908976d5913ddc552a, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:22.273429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593634d4-f383-464a-81bf-09050d9225b5 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:22.367037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1044/2067] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:22 2022] PUT /identity/v3/projects/a0a860373ad64a01aee5d9c91dcd5bd5/users/031e62a7e8024c908976d5913ddc552a/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:22.377608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e012062-fb7a-4643-89cb-c1d605604bbd None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:22.377898 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e012062-fb7a-4643-89cb-c1d605604bbd None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:22.378195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e012062-fb7a-4643-89cb-c1d605604bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:22.409113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-9e012062-fb7a-4643-89cb-c1d605604bbd None None] MFA Rules not processed for user `031e62a7e8024c908976d5913ddc552a`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:22.410446 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-9e012062-fb7a-4643-89cb-c1d605604bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:22.455996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:22.478914 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1024/2068] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:22.488425 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593634d4-f383-464a-81bf-09050d9225b5 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:22.548210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593634d4-f383-464a-81bf-09050d9225b5 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:22.553649 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d992e56-5dfc-46e9-9584-135a3f4cfad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:22.554324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d992e56-5dfc-46e9-9584-135a3f4cfad4 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:22.554612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d992e56-5dfc-46e9-9584-135a3f4cfad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:22.554891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d992e56-5dfc-46e9-9584-135a3f4cfad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:22.555628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d992e56-5dfc-46e9-9584-135a3f4cfad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:22.557636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d992e56-5dfc-46e9-9584-135a3f4cfad4 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:22.647762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1045/2069] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:22 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:22.652088 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e012062-fb7a-4643-89cb-c1d605604bbd None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:22.662874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e012062-fb7a-4643-89cb-c1d605604bbd None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:22.721102 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209ad32-6d48-4293-a930-4a436a2b318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:22.721841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ad32-6d48-4293-a930-4a436a2b318e admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:22.722134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ad32-6d48-4293-a930-4a436a2b318e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:22.722485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ad32-6d48-4293-a930-4a436a2b318e admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:22.723221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209ad32-6d48-4293-a930-4a436a2b318e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:22.725345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209ad32-6d48-4293-a930-4a436a2b318e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:22.849992 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1025/2070] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:22 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:22.853959 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d992e56-5dfc-46e9-9584-135a3f4cfad4 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:22.864394 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d992e56-5dfc-46e9-9584-135a3f4cfad4 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:22.871005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c98e5-598f-4e71-810c-3ae8c3fb5b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:22.871950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c98e5-598f-4e71-810c-3ae8c3fb5b79 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:22.872231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c98e5-598f-4e71-810c-3ae8c3fb5b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:22.872508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c98e5-598f-4e71-810c-3ae8c3fb5b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:22.873362 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c98e5-598f-4e71-810c-3ae8c3fb5b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:22.877159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c98e5-598f-4e71-810c-3ae8c3fb5b79 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:22.887803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1046/2071] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:22.892148 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209ad32-6d48-4293-a930-4a436a2b318e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:22.903127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209ad32-6d48-4293-a930-4a436a2b318e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:22.908175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041d92-64d9-4211-bc35-b8514e077149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:22.908964 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041d92-64d9-4211-bc35-b8514e077149 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:22.909325 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041d92-64d9-4211-bc35-b8514e077149 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:22.909694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041d92-64d9-4211-bc35-b8514e077149 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:22.911077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7041d92-64d9-4211-bc35-b8514e077149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:22.912887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7041d92-64d9-4211-bc35-b8514e077149 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:22.926730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1026/2072] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:22.931724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c98e5-598f-4e71-810c-3ae8c3fb5b79 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:22.943332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c98e5-598f-4e71-810c-3ae8c3fb5b79 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:22.948897 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e3c1a-092a-421b-8e78-9ee023347eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:22.951990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e3c1a-092a-421b-8e78-9ee023347eae admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:22.951990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e3c1a-092a-421b-8e78-9ee023347eae admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:22.951990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e3c1a-092a-421b-8e78-9ee023347eae admin admin] PATH_INFO: `/v3/projects/47baa22848bb4846a8a02095d9caf2a5/users/99566b18e779488d882d295fc105fd7a/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:22.966666 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e3c1a-092a-421b-8e78-9ee023347eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=47baa22848bb4846a8a02095d9caf2a5, user_id=99566b18e779488d882d295fc105fd7a, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:22.969459 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e3c1a-092a-421b-8e78-9ee023347eae admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:22.971990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:23.101444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1047/2073] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:22 2022] PUT /identity/v3/projects/47baa22848bb4846a8a02095d9caf2a5/users/99566b18e779488d882d295fc105fd7a/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:23.117117 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2d2b-8bb2-4bb2-8332-4b00f3cdccdd None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:23.117437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2d2b-8bb2-4bb2-8332-4b00f3cdccdd None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:23.117722 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee2d2b-8bb2-4bb2-8332-4b00f3cdccdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:23.146874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-8cee2d2b-8bb2-4bb2-8332-4b00f3cdccdd None None] MFA Rules not processed for user `99566b18e779488d882d295fc105fd7a`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:23.148434 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8cee2d2b-8bb2-4bb2-8332-4b00f3cdccdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:23.214586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1027/2074] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:23.219203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e3c1a-092a-421b-8e78-9ee023347eae admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:23.284176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e3c1a-092a-421b-8e78-9ee023347eae admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:23.288799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b102aa-1c03-4c3c-8a8b-343de8be3bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:23.289490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b102aa-1c03-4c3c-8a8b-343de8be3bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:23.289778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b102aa-1c03-4c3c-8a8b-343de8be3bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:23.290055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b102aa-1c03-4c3c-8a8b-343de8be3bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:23.290736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b102aa-1c03-4c3c-8a8b-343de8be3bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:23.292642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b102aa-1c03-4c3c-8a8b-343de8be3bc2 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:23.418013 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1048/2075] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:23 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:23.421969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee2d2b-8bb2-4bb2-8332-4b00f3cdccdd None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:23.433169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee2d2b-8bb2-4bb2-8332-4b00f3cdccdd None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:23.484806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:23.493179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f497d6-2c93-4827-9932-b4514c62a7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:23.493990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f497d6-2c93-4827-9932-b4514c62a7ef admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:23.494370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f497d6-2c93-4827-9932-b4514c62a7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:23.494648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f497d6-2c93-4827-9932-b4514c62a7ef admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:23.495712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f497d6-2c93-4827-9932-b4514c62a7ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:23.498455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f497d6-2c93-4827-9932-b4514c62a7ef admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:23.604919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1028/2076] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:23 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:01:23.605818 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b102aa-1c03-4c3c-8a8b-343de8be3bc2 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:23.616669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b102aa-1c03-4c3c-8a8b-343de8be3bc2 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:23.621750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ddfcb-a5aa-49e1-b714-e4722182e6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:23.622407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ddfcb-a5aa-49e1-b714-e4722182e6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:23.622689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ddfcb-a5aa-49e1-b714-e4722182e6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:23.622961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ddfcb-a5aa-49e1-b714-e4722182e6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:23.623755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ddfcb-a5aa-49e1-b714-e4722182e6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:23.625361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ddfcb-a5aa-49e1-b714-e4722182e6c8 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:23.636123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1049/2077] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:23.642539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f497d6-2c93-4827-9932-b4514c62a7ef admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:23.651255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f497d6-2c93-4827-9932-b4514c62a7ef admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:23.655804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d9f7-8da0-45a9-a38c-bc6a21022b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:23.656673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d9f7-8da0-45a9-a38c-bc6a21022b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:23.656967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d9f7-8da0-45a9-a38c-bc6a21022b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:23.657240 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d9f7-8da0-45a9-a38c-bc6a21022b39 admin admin] PATH_INFO: `/v3/projects/1d1e6ae345cc496c9ab2121827e5b366/users/2dfd0f78de3b430eab850c23829efcb7/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:23.673356 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d9f7-8da0-45a9-a38c-bc6a21022b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1e6ae345cc496c9ab2121827e5b366, user_id=2dfd0f78de3b430eab850c23829efcb7, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:23.676098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d9f7-8da0-45a9-a38c-bc6a21022b39 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:23.780419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1029/2078] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:23 2022] PUT /identity/v3/projects/1d1e6ae345cc496c9ab2121827e5b366/users/2dfd0f78de3b430eab850c23829efcb7/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:23.784532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ddfcb-a5aa-49e1-b714-e4722182e6c8 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:23.795225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ddfcb-a5aa-49e1-b714-e4722182e6c8 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:23.856297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99121256-1426-48f4-aff8-d0526e618136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:23.856879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99121256-1426-48f4-aff8-d0526e618136 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:23.857160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99121256-1426-48f4-aff8-d0526e618136 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:23.857464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99121256-1426-48f4-aff8-d0526e618136 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:23.858224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99121256-1426-48f4-aff8-d0526e618136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:23.859811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99121256-1426-48f4-aff8-d0526e618136 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:23.869566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1050/2079] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:23.874272 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d9f7-8da0-45a9-a38c-bc6a21022b39 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:23.885489 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d9f7-8da0-45a9-a38c-bc6a21022b39 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:23.890208 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5c7b4-829b-4b09-a505-739803feeb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:23.891089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5c7b4-829b-4b09-a505-739803feeb78 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:23.891375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5c7b4-829b-4b09-a505-739803feeb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:23.891660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5c7b4-829b-4b09-a505-739803feeb78 admin admin] PATH_INFO: `/v3/projects/1d1e6ae345cc496c9ab2121827e5b366/users/2dfd0f78de3b430eab850c23829efcb7/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:23.893653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5c7b4-829b-4b09-a505-739803feeb78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1e6ae345cc496c9ab2121827e5b366, user_id=2dfd0f78de3b430eab850c23829efcb7, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:23.896927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5c7b4-829b-4b09-a505-739803feeb78 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:23.907960 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1030/2080] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:23 2022] PUT /identity/v3/projects/1d1e6ae345cc496c9ab2121827e5b366/users/2dfd0f78de3b430eab850c23829efcb7/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:23.918200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0970-c6df-4586-a0d2-5ccb8e47c305 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:23.918493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0970-c6df-4586-a0d2-5ccb8e47c305 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:23.918831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0970-c6df-4586-a0d2-5ccb8e47c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:23.947347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-9e0a0970-c6df-4586-a0d2-5ccb8e47c305 None None] MFA Rules not processed for user `2dfd0f78de3b430eab850c23829efcb7`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:23.948793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-9e0a0970-c6df-4586-a0d2-5ccb8e47c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:24.006891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:24.032131 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1051/2081] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:24.049144 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5c7b4-829b-4b09-a505-739803feeb78 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:24.051714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e5a5c7b4-829b-4b09-a505-739803feeb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:24.114512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5c7b4-829b-4b09-a505-739803feeb78 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:24.116009 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3f767-75f5-41b5-97f8-c8de4d1c2363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:24.116650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3f767-75f5-41b5-97f8-c8de4d1c2363 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:24.116930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3f767-75f5-41b5-97f8-c8de4d1c2363 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:24.117206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3f767-75f5-41b5-97f8-c8de4d1c2363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:24.126810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3f767-75f5-41b5-97f8-c8de4d1c2363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:24.128233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3f767-75f5-41b5-97f8-c8de4d1c2363 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:24.139095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1031/2082] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:24.262888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a0970-c6df-4586-a0d2-5ccb8e47c305 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:24.264381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-9e0a0970-c6df-4586-a0d2-5ccb8e47c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:24.276601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a0970-c6df-4586-a0d2-5ccb8e47c305 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:24.280223 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de0995-b151-47ce-a889-9863784ee8e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:24.280871 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de0995-b151-47ce-a889-9863784ee8e5 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:24.281148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de0995-b151-47ce-a889-9863784ee8e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:24.281454 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de0995-b151-47ce-a889-9863784ee8e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:24.340573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de0995-b151-47ce-a889-9863784ee8e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:24.342053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de0995-b151-47ce-a889-9863784ee8e5 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:24.351420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1052/2083] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:28.601898 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3f767-75f5-41b5-97f8-c8de4d1c2363 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:28.667418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3f767-75f5-41b5-97f8-c8de4d1c2363 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:28.671956 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dacd7-df15-48c8-8c76-a0f83afa94d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:28.672911 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dacd7-df15-48c8-8c76-a0f83afa94d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:28.673191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dacd7-df15-48c8-8c76-a0f83afa94d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:28.673504 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dacd7-df15-48c8-8c76-a0f83afa94d2 admin admin] PATH_INFO: `/v3/users/031e62a7e8024c908976d5913ddc552a` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:28.674699 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dacd7-df15-48c8-8c76-a0f83afa94d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=031e62a7e8024c908976d5913ddc552a)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:28.676642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dacd7-df15-48c8-8c76-a0f83afa94d2 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:28.757903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de0995-b151-47ce-a889-9863784ee8e5 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:28.759440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-70de0995-b151-47ce-a889-9863784ee8e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:28.774221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de0995-b151-47ce-a889-9863784ee8e5 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:28.779124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7b56-fd93-48b8-8776-543322bb259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:28.780082 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7b56-fd93-48b8-8776-543322bb259c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:28.780433 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7b56-fd93-48b8-8776-543322bb259c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:28.780807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7b56-fd93-48b8-8776-543322bb259c admin admin] PATH_INFO: `/v3/users/8159af055be549d796217dd68cb624d5` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:28.782122 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c7b56-fd93-48b8-8776-543322bb259c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8159af055be549d796217dd68cb624d5)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:28.784156 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c7b56-fd93-48b8-8776-543322bb259c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:28.885118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f34dacd7-df15-48c8-8c76-a0f83afa94d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031e62a7e8024c908976d5913ddc552a'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:28.888953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:28.945818 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f34dacd7-df15-48c8-8c76-a0f83afa94d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031e62a7e8024c908976d5913ddc552a'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:28.947112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f34dacd7-df15-48c8-8c76-a0f83afa94d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031e62a7e8024c908976d5913ddc552a'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:28.954825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f34dacd7-df15-48c8-8c76-a0f83afa94d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031e62a7e8024c908976d5913ddc552a'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:28.955550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f34dacd7-df15-48c8-8c76-a0f83afa94d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031e62a7e8024c908976d5913ddc552a'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:28.973451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1032/2084] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:28 2022] DELETE /identity/v3/users/031e62a7e8024c908976d5913ddc552a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:28.977860 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5253-2d80-4e8f-a34d-111a4dcdb5d4 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:28.978245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5253-2d80-4e8f-a34d-111a4dcdb5d4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:28.978468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5253-2d80-4e8f-a34d-111a4dcdb5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:28.996692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-6dde5253-2d80-4e8f-a34d-111a4dcdb5d4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:28.999408 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6dde5253-2d80-4e8f-a34d-111a4dcdb5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:29.037635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-047c7b56-fd93-48b8-8776-543322bb259c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8159af055be549d796217dd68cb624d5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:29.063085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1033/2085] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:29.073931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5253-2d80-4e8f-a34d-111a4dcdb5d4 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:29.075366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6dde5253-2d80-4e8f-a34d-111a4dcdb5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:29.137670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5253-2d80-4e8f-a34d-111a4dcdb5d4 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:29.140173 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-047c7b56-fd93-48b8-8776-543322bb259c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8159af055be549d796217dd68cb624d5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:29.141953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f01b5-ac0f-4b15-947c-853257063cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:29.142793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f01b5-ac0f-4b15-947c-853257063cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:29.143010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f01b5-ac0f-4b15-947c-853257063cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:29.143290 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f01b5-ac0f-4b15-947c-853257063cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:29.151558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-047c7b56-fd93-48b8-8776-543322bb259c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8159af055be549d796217dd68cb624d5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:29.152509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-047c7b56-fd93-48b8-8776-543322bb259c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8159af055be549d796217dd68cb624d5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:29.153253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-047c7b56-fd93-48b8-8776-543322bb259c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8159af055be549d796217dd68cb624d5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:29.171373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f01b5-ac0f-4b15-947c-853257063cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:29.172847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f01b5-ac0f-4b15-947c-853257063cd2 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:29.181657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1053/2086] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:28 2022] DELETE /identity/v3/users/8159af055be549d796217dd68cb624d5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:01:29.184529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1034/2087] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:01:29.186632 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdbb32-9b23-4457-b27c-3057afb7f515 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:29.187147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdbb32-9b23-4457-b27c-3057afb7f515 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:29.187391 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdbb32-9b23-4457-b27c-3057afb7f515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:29.205280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-05bdbb32-9b23-4457-b27c-3057afb7f515 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:29.206637 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-05bdbb32-9b23-4457-b27c-3057afb7f515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:29.287903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:29.294882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1054/2088] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:29.306784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f01b5-ac0f-4b15-947c-853257063cd2 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:29.315643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f01b5-ac0f-4b15-947c-853257063cd2 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:29.365248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f217f44-77a8-4a5a-9fb6-0ce553f5a36d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:29.365909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f217f44-77a8-4a5a-9fb6-0ce553f5a36d service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:29.366188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f217f44-77a8-4a5a-9fb6-0ce553f5a36d service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:29.366459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f217f44-77a8-4a5a-9fb6-0ce553f5a36d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:29.375850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f217f44-77a8-4a5a-9fb6-0ce553f5a36d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:29.377207 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f217f44-77a8-4a5a-9fb6-0ce553f5a36d service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:29.386938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1035/2089] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:29.686233 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdbb32-9b23-4457-b27c-3057afb7f515 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:29.687784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-05bdbb32-9b23-4457-b27c-3057afb7f515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:29.699599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdbb32-9b23-4457-b27c-3057afb7f515 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:29.704791 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:29.705777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:29.706109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:29.709883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] PATH_INFO: `/v3/projects/a0a860373ad64a01aee5d9c91dcd5bd5` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:29.709883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a860373ad64a01aee5d9c91dcd5bd5)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:29.709883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:29.891591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f217f44-77a8-4a5a-9fb6-0ce553f5a36d service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:29.896511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a860373ad64a01aee5d9c91dcd5bd5', 'request_id': 'req-67ce4c56-abc4-4289-98b9-d8a019c46974'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:29.899045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0f217f44-77a8-4a5a-9fb6-0ce553f5a36d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:29.919601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f217f44-77a8-4a5a-9fb6-0ce553f5a36d service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:29.937295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:29.987033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583b6dc-148c-43ec-804b-ec101f4ddeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:29.987900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583b6dc-148c-43ec-804b-ec101f4ddeff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:29.988188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583b6dc-148c-43ec-804b-ec101f4ddeff admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:29.988498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583b6dc-148c-43ec-804b-ec101f4ddeff admin admin] PATH_INFO: `/v3/projects/65e7c5e2059e4ea5a35d0b2cc3d849f2` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:29.989720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583b6dc-148c-43ec-804b-ec101f4ddeff admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e7c5e2059e4ea5a35d0b2cc3d849f2)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:29.991055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a860373ad64a01aee5d9c91dcd5bd5', 'request_id': 'req-67ce4c56-abc4-4289-98b9-d8a019c46974'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:29.991647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583b6dc-148c-43ec-804b-ec101f4ddeff admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:29.998150 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a860373ad64a01aee5d9c91dcd5bd5', 'request_id': 'req-67ce4c56-abc4-4289-98b9-d8a019c46974'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:30.010744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] The token cache is being invalidate because project a0a860373ad64a01aee5d9c91dcd5bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:30.011296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:30.011954 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:30.013541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1055/2090] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:29 2022] DELETE /identity/v3/projects/a0a860373ad64a01aee5d9c91dcd5bd5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:30.018145 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:30.019595 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:30.036937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce4c56-abc4-4289-98b9-d8a019c46974 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:30.042810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:30.043735 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:30.044024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:30.044824 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] PATH_INFO: `/v3/users/99566b18e779488d882d295fc105fd7a` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:30.045607 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99566b18e779488d882d295fc105fd7a)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:30.047786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:30.128643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d583b6dc-148c-43ec-804b-ec101f4ddeff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e7c5e2059e4ea5a35d0b2cc3d849f2', 'request_id': 'req-d583b6dc-148c-43ec-804b-ec101f4ddeff'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:30.190794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d583b6dc-148c-43ec-804b-ec101f4ddeff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e7c5e2059e4ea5a35d0b2cc3d849f2', 'request_id': 'req-d583b6dc-148c-43ec-804b-ec101f4ddeff'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:30.197301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d583b6dc-148c-43ec-804b-ec101f4ddeff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e7c5e2059e4ea5a35d0b2cc3d849f2', 'request_id': 'req-d583b6dc-148c-43ec-804b-ec101f4ddeff'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:30.208707 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d583b6dc-148c-43ec-804b-ec101f4ddeff admin admin] The token cache is being invalidate because project 65e7c5e2059e4ea5a35d0b2cc3d849f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:30.208994 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d583b6dc-148c-43ec-804b-ec101f4ddeff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:30.209660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d583b6dc-148c-43ec-804b-ec101f4ddeff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:30.211226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1036/2091] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:29 2022] DELETE /identity/v3/projects/65e7c5e2059e4ea5a35d0b2cc3d849f2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:01:30.215800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea0541-4ca6-479b-b4b7-b153720019c0 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:30.216121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea0541-4ca6-479b-b4b7-b153720019c0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:30.216367 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea0541-4ca6-479b-b4b7-b153720019c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:30.235834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b5ea0541-4ca6-479b-b4b7-b153720019c0 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:30.237057 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b5ea0541-4ca6-479b-b4b7-b153720019c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:30.241778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99566b18e779488d882d295fc105fd7a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:30.300853 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1037/2092] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:30.309681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c18f51-2cd4-492d-8990-aedcde3c9cf0 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:30.310109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c18f51-2cd4-492d-8990-aedcde3c9cf0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:30.310397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c18f51-2cd4-492d-8990-aedcde3c9cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:30.329155 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-65c18f51-2cd4-492d-8990-aedcde3c9cf0 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:30.330526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-65c18f51-2cd4-492d-8990-aedcde3c9cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:30.339167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1038/2093] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:30.343441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c18f51-2cd4-492d-8990-aedcde3c9cf0 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:30.350876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99566b18e779488d882d295fc105fd7a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:30.356617 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c18f51-2cd4-492d-8990-aedcde3c9cf0 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:30.358556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99566b18e779488d882d295fc105fd7a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:30.359331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99566b18e779488d882d295fc105fd7a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:30.360866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99566b18e779488d882d295fc105fd7a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:30.362077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aadfdd-36d7-41ab-ae06-7cf84cf9aae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:30.362745 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aadfdd-36d7-41ab-ae06-7cf84cf9aae6 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:30.363200 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aadfdd-36d7-41ab-ae06-7cf84cf9aae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:30.363497 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aadfdd-36d7-41ab-ae06-7cf84cf9aae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:30.364616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aadfdd-36d7-41ab-ae06-7cf84cf9aae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:01:30.364985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aadfdd-36d7-41ab-ae06-7cf84cf9aae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:30.367004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aadfdd-36d7-41ab-ae06-7cf84cf9aae6 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:30.379151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1056/2094] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:30 2022] DELETE /identity/v3/users/99566b18e779488d882d295fc105fd7a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:30.379490 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1039/2095] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:01:30.383887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:30.385246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:30.448710 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:30.453722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b34cd1-2ac8-4d11-9f78-10c89b2afbd8 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:30.459318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dabfe3-5a20-4b69-add7-90106d6ec466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:30.465088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dabfe3-5a20-4b69-add7-90106d6ec466 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:30.465088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dabfe3-5a20-4b69-add7-90106d6ec466 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:30.465088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dabfe3-5a20-4b69-add7-90106d6ec466 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:30.465088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dabfe3-5a20-4b69-add7-90106d6ec466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:30.465088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dabfe3-5a20-4b69-add7-90106d6ec466 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:30.559528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1057/2096] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:30 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:30.563771 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aadfdd-36d7-41ab-ae06-7cf84cf9aae6 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:30.574812 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aadfdd-36d7-41ab-ae06-7cf84cf9aae6 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:30.646108 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d073a9-49c4-46f0-873a-ff50761f2ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:30.646791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d073a9-49c4-46f0-873a-ff50761f2ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:30.647076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d073a9-49c4-46f0-873a-ff50761f2ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:30.647359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d073a9-49c4-46f0-873a-ff50761f2ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:30.648054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d073a9-49c4-46f0-873a-ff50761f2ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:30.650283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d073a9-49c4-46f0-873a-ff50761f2ee9 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:30.688659 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:30.751627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1040/2097] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:30 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:30.755765 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dabfe3-5a20-4b69-add7-90106d6ec466 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:30.766295 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dabfe3-5a20-4b69-add7-90106d6ec466 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:30.770929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b619b86-4d5a-4da8-a51e-05f9220b3e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:30.771595 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b619b86-4d5a-4da8-a51e-05f9220b3e11 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:30.771982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b619b86-4d5a-4da8-a51e-05f9220b3e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:30.772350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b619b86-4d5a-4da8-a51e-05f9220b3e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:30.773341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b619b86-4d5a-4da8-a51e-05f9220b3e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:30.775678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b619b86-4d5a-4da8-a51e-05f9220b3e11 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:30.787200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1058/2098] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:30.791246 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d073a9-49c4-46f0-873a-ff50761f2ee9 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:30.802272 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d073a9-49c4-46f0-873a-ff50761f2ee9 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:30.806937 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef30a6-ff01-4f50-94b8-78fed720c665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:30.807590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef30a6-ff01-4f50-94b8-78fed720c665 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:30.807876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef30a6-ff01-4f50-94b8-78fed720c665 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:30.808179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef30a6-ff01-4f50-94b8-78fed720c665 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:30.808904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef30a6-ff01-4f50-94b8-78fed720c665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:30.811243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef30a6-ff01-4f50-94b8-78fed720c665 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:30.821211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1041/2099] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:01:30.825550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b619b86-4d5a-4da8-a51e-05f9220b3e11 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:30.837116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b619b86-4d5a-4da8-a51e-05f9220b3e11 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:30.844922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1d863-8eca-40fb-92e1-340e0ac9c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:30.846104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1d863-8eca-40fb-92e1-340e0ac9c08b admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:30.846233 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1d863-8eca-40fb-92e1-340e0ac9c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:30.846605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1d863-8eca-40fb-92e1-340e0ac9c08b admin admin] PATH_INFO: `/v3/projects/947a63d342c343d59fc13afd711d48b3/users/e67bb84c85374a16b3365de958ae4424/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:30.849538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef30a6-ff01-4f50-94b8-78fed720c665 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:30.852122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-87ef30a6-ff01-4f50-94b8-78fed720c665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:30.870892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef30a6-ff01-4f50-94b8-78fed720c665 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:30.882712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1d863-8eca-40fb-92e1-340e0ac9c08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=947a63d342c343d59fc13afd711d48b3, user_id=e67bb84c85374a16b3365de958ae4424, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:30.885419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1d863-8eca-40fb-92e1-340e0ac9c08b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:30.888124 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:30.889041 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:30.889420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:30.889763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] PATH_INFO: `/v3/projects/47baa22848bb4846a8a02095d9caf2a5` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:30.891054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=47baa22848bb4846a8a02095d9caf2a5)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:30.893235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:30.998157 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1059/2100] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:30 2022] PUT /identity/v3/projects/947a63d342c343d59fc13afd711d48b3/users/e67bb84c85374a16b3365de958ae4424/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:31.009767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d2edd-3935-4aa0-95b7-36f4edf1f047 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:31.009965 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d2edd-3935-4aa0-95b7-36f4edf1f047 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:31.010214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d2edd-3935-4aa0-95b7-36f4edf1f047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:31.012953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47baa22848bb4846a8a02095d9caf2a5', 'request_id': 'req-7562e68d-c467-4c2f-bb4c-24be5de089ce'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:31.039190 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-ce6d2edd-3935-4aa0-95b7-36f4edf1f047 None None] MFA Rules not processed for user `e67bb84c85374a16b3365de958ae4424`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:31.042638 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ce6d2edd-3935-4aa0-95b7-36f4edf1f047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:31.100198 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47baa22848bb4846a8a02095d9caf2a5', 'request_id': 'req-7562e68d-c467-4c2f-bb4c-24be5de089ce'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:31.110390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47baa22848bb4846a8a02095d9caf2a5', 'request_id': 'req-7562e68d-c467-4c2f-bb4c-24be5de089ce'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:31.115707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1060/2101] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:31.125214 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] The token cache is being invalidate because project 47baa22848bb4846a8a02095d9caf2a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:31.125798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:31.126931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:31.129849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1042/2102] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:30 2022] DELETE /identity/v3/projects/47baa22848bb4846a8a02095d9caf2a5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:01:31.132493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d2edd-3935-4aa0-95b7-36f4edf1f047 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:31.135744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:31.135883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ce6d2edd-3935-4aa0-95b7-36f4edf1f047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:31.137612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:31.206123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d2edd-3935-4aa0-95b7-36f4edf1f047 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:31.210891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610dcb0-35ef-49fe-92ab-dd8c9862b9fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:31.211877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610dcb0-35ef-49fe-92ab-dd8c9862b9fe service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:31.212375 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610dcb0-35ef-49fe-92ab-dd8c9862b9fe service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:31.213137 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610dcb0-35ef-49fe-92ab-dd8c9862b9fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:31.215529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2610dcb0-35ef-49fe-92ab-dd8c9862b9fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:31.219055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562e68d-c467-4c2f-bb4c-24be5de089ce admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:31.221834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7038-9a69-4110-adc5-10e6cfbac55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:31.222935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7038-9a69-4110-adc5-10e6cfbac55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:31.223632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7038-9a69-4110-adc5-10e6cfbac55c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:31.224088 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7038-9a69-4110-adc5-10e6cfbac55c admin admin] PATH_INFO: `/v3/users/2dfd0f78de3b430eab850c23829efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:31.226637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7038-9a69-4110-adc5-10e6cfbac55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dfd0f78de3b430eab850c23829efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:31.230722 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7038-9a69-4110-adc5-10e6cfbac55c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:31.231692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610dcb0-35ef-49fe-92ab-dd8c9862b9fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:31.233711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610dcb0-35ef-49fe-92ab-dd8c9862b9fe service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:31.246640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1061/2103] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:31.424470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:31.438852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c57f7038-9a69-4110-adc5-10e6cfbac55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dfd0f78de3b430eab850c23829efcb7'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:31.531367 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c57f7038-9a69-4110-adc5-10e6cfbac55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dfd0f78de3b430eab850c23829efcb7'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:31.532094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c57f7038-9a69-4110-adc5-10e6cfbac55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dfd0f78de3b430eab850c23829efcb7'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:31.540685 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c57f7038-9a69-4110-adc5-10e6cfbac55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dfd0f78de3b430eab850c23829efcb7'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:31.541457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-c57f7038-9a69-4110-adc5-10e6cfbac55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dfd0f78de3b430eab850c23829efcb7'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:31.560648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1043/2104] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:31 2022] DELETE /identity/v3/users/2dfd0f78de3b430eab850c23829efcb7 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:01:32.118128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610dcb0-35ef-49fe-92ab-dd8c9862b9fe service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:32.130866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610dcb0-35ef-49fe-92ab-dd8c9862b9fe service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:32.178223 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:32.204718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c7579-a84e-439b-b374-040f89e2ae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:32.205701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c7579-a84e-439b-b374-040f89e2ae2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:32.205986 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c7579-a84e-439b-b374-040f89e2ae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:32.206306 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c7579-a84e-439b-b374-040f89e2ae2d admin admin] PATH_INFO: `/v3/projects/1d1e6ae345cc496c9ab2121827e5b366` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:32.208061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c7579-a84e-439b-b374-040f89e2ae2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1e6ae345cc496c9ab2121827e5b366)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:32.210022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c7579-a84e-439b-b374-040f89e2ae2d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:32.330681 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-492c7579-a84e-439b-b374-040f89e2ae2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1e6ae345cc496c9ab2121827e5b366', 'request_id': 'req-492c7579-a84e-439b-b374-040f89e2ae2d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:32.415295 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-492c7579-a84e-439b-b374-040f89e2ae2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1e6ae345cc496c9ab2121827e5b366', 'request_id': 'req-492c7579-a84e-439b-b374-040f89e2ae2d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:32.422643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-492c7579-a84e-439b-b374-040f89e2ae2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1e6ae345cc496c9ab2121827e5b366', 'request_id': 'req-492c7579-a84e-439b-b374-040f89e2ae2d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:32.435282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-492c7579-a84e-439b-b374-040f89e2ae2d admin admin] The token cache is being invalidate because project 1d1e6ae345cc496c9ab2121827e5b366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:32.435667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-492c7579-a84e-439b-b374-040f89e2ae2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:32.436769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-492c7579-a84e-439b-b374-040f89e2ae2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:32.439114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1062/2105] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:32 2022] DELETE /identity/v3/projects/1d1e6ae345cc496c9ab2121827e5b366 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:32.445278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3089d-ec93-49ff-8110-1b738da2586e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:32.445798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3089d-ec93-49ff-8110-1b738da2586e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:32.445889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3089d-ec93-49ff-8110-1b738da2586e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:32.465349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-5ba3089d-ec93-49ff-8110-1b738da2586e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:32.466637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5ba3089d-ec93-49ff-8110-1b738da2586e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:32.530513 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1044/2106] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:32.541009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8ccf-c1dc-4e8d-aff3-40bf48410624 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:32.541230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8ccf-c1dc-4e8d-aff3-40bf48410624 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:32.541555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8ccf-c1dc-4e8d-aff3-40bf48410624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:32.560624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-d1ac8ccf-c1dc-4e8d-aff3-40bf48410624 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:32.561880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d1ac8ccf-c1dc-4e8d-aff3-40bf48410624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:32.570270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1063/2107] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:32.574669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3089d-ec93-49ff-8110-1b738da2586e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:32.585310 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3089d-ec93-49ff-8110-1b738da2586e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:32.590277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02b3e7-18af-442d-80c5-bfd861da2d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:32.590934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02b3e7-18af-442d-80c5-bfd861da2d47 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:32.591217 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02b3e7-18af-442d-80c5-bfd861da2d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:32.591488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02b3e7-18af-442d-80c5-bfd861da2d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:32.592216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02b3e7-18af-442d-80c5-bfd861da2d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:01:32.592523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02b3e7-18af-442d-80c5-bfd861da2d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:32.594194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02b3e7-18af-442d-80c5-bfd861da2d47 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:32.607065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1045/2108] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:01:32.611692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac8ccf-c1dc-4e8d-aff3-40bf48410624 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:32.625562 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac8ccf-c1dc-4e8d-aff3-40bf48410624 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:32.630689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb0a5b-9e84-477e-9075-3e3a6cb2d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:32.631438 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb0a5b-9e84-477e-9075-3e3a6cb2d775 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:32.631766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb0a5b-9e84-477e-9075-3e3a6cb2d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:32.631995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb0a5b-9e84-477e-9075-3e3a6cb2d775 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:32.632690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb0a5b-9e84-477e-9075-3e3a6cb2d775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:32.634672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb0a5b-9e84-477e-9075-3e3a6cb2d775 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:32.785668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1064/2109] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:32 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:01:32.790010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02b3e7-18af-442d-80c5-bfd861da2d47 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:32.800340 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02b3e7-18af-442d-80c5-bfd861da2d47 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:32.865093 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173024e-2989-4280-8f3b-9740563b6d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:32.865910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173024e-2989-4280-8f3b-9740563b6d82 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:32.866278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173024e-2989-4280-8f3b-9740563b6d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:32.866616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173024e-2989-4280-8f3b-9740563b6d82 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:32.871719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173024e-2989-4280-8f3b-9740563b6d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:32.871719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173024e-2989-4280-8f3b-9740563b6d82 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:33.003463 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1046/2110] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:32 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:01:33.008409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb0a5b-9e84-477e-9075-3e3a6cb2d775 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:33.019390 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb0a5b-9e84-477e-9075-3e3a6cb2d775 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:33.024463 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7de5e-8ecb-49fa-8e7e-937c0638feed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:33.025124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7de5e-8ecb-49fa-8e7e-937c0638feed admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:33.025428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7de5e-8ecb-49fa-8e7e-937c0638feed admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:33.025703 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7de5e-8ecb-49fa-8e7e-937c0638feed admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:33.026426 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7de5e-8ecb-49fa-8e7e-937c0638feed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:33.028016 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7de5e-8ecb-49fa-8e7e-937c0638feed admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:33.039721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1065/2111] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:33.044414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173024e-2989-4280-8f3b-9740563b6d82 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:33.055730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173024e-2989-4280-8f3b-9740563b6d82 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:33.061075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e028c58-a866-4e18-93e5-6f65d88a4375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:33.061782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e028c58-a866-4e18-93e5-6f65d88a4375 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:33.062069 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e028c58-a866-4e18-93e5-6f65d88a4375 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:33.062344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e028c58-a866-4e18-93e5-6f65d88a4375 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:33.063081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e028c58-a866-4e18-93e5-6f65d88a4375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:33.064728 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e028c58-a866-4e18-93e5-6f65d88a4375 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:33.075833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1047/2112] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:33.080081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7de5e-8ecb-49fa-8e7e-937c0638feed admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:33.090509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7de5e-8ecb-49fa-8e7e-937c0638feed admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:33.095080 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a3d83-f494-461d-a37e-245b80c4fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:33.095962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a3d83-f494-461d-a37e-245b80c4fc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:33.096245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a3d83-f494-461d-a37e-245b80c4fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:33.096525 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a3d83-f494-461d-a37e-245b80c4fc1e admin admin] PATH_INFO: `/v3/projects/b85bc105b95e4a67a15532aa023c0fa5/users/07fc373b8ca84a0ab10cb95edd750227/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:33.112600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a3d83-f494-461d-a37e-245b80c4fc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85bc105b95e4a67a15532aa023c0fa5, user_id=07fc373b8ca84a0ab10cb95edd750227, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:33.115866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a3d83-f494-461d-a37e-245b80c4fc1e admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:33.215706 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1066/2113] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:33 2022] PUT /identity/v3/projects/b85bc105b95e4a67a15532aa023c0fa5/users/07fc373b8ca84a0ab10cb95edd750227/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:33.233242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17772c-a99b-4c8e-8892-0efe4a26028f None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:33.233242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17772c-a99b-4c8e-8892-0efe4a26028f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:33.233242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17772c-a99b-4c8e-8892-0efe4a26028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:33.263748 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:33.266970 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7e17772c-a99b-4c8e-8892-0efe4a26028f None None] MFA Rules not processed for user `07fc373b8ca84a0ab10cb95edd750227`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:33.268532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7e17772c-a99b-4c8e-8892-0efe4a26028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:33.339682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1048/2114] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:33.460320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a3d83-f494-461d-a37e-245b80c4fc1e admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:33.462162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-fb4a3d83-f494-461d-a37e-245b80c4fc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:33.529811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a3d83-f494-461d-a37e-245b80c4fc1e admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:33.533660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950d4d8-4a54-474b-8d65-0e86f08542a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:33.534349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d4d8-4a54-474b-8d65-0e86f08542a2 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:33.534637 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d4d8-4a54-474b-8d65-0e86f08542a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:33.534946 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d4d8-4a54-474b-8d65-0e86f08542a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:33.544969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950d4d8-4a54-474b-8d65-0e86f08542a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:33.546553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950d4d8-4a54-474b-8d65-0e86f08542a2 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:33.556878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1067/2115] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:35.857587 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37d92f-6d9f-4430-b658-362e30c6e44f None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:35.858131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37d92f-6d9f-4430-b658-362e30c6e44f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:35.858131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37d92f-6d9f-4430-b658-362e30c6e44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:35.879614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ca37d92f-6d9f-4430-b658-362e30c6e44f None None] MFA Rules not processed for user `07fc373b8ca84a0ab10cb95edd750227`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:35.881097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ca37d92f-6d9f-4430-b658-362e30c6e44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:35.889855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1049/2116] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:36.541013 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950d4d8-4a54-474b-8d65-0e86f08542a2 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:36.543029 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d950d4d8-4a54-474b-8d65-0e86f08542a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:36.555174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:36.623694 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950d4d8-4a54-474b-8d65-0e86f08542a2 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:36.628996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:36.630048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:36.630562 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:36.634109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] PATH_INFO: `/v3/users/fb62ab13dbaf404ebb0a30cfd1053f42` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:36.634109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb62ab13dbaf404ebb0a30cfd1053f42)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:36.634457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:36.851343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb62ab13dbaf404ebb0a30cfd1053f42'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:36.962279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb62ab13dbaf404ebb0a30cfd1053f42'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:36.974099 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb62ab13dbaf404ebb0a30cfd1053f42'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:36.975811 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb62ab13dbaf404ebb0a30cfd1053f42'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:36.976460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb62ab13dbaf404ebb0a30cfd1053f42'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:36.999613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1068/2117] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:36 2022] DELETE /identity/v3/users/fb62ab13dbaf404ebb0a30cfd1053f42 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:37.490177 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37d92f-6d9f-4430-b658-362e30c6e44f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:37.508510 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37d92f-6d9f-4430-b658-362e30c6e44f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:37.627874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:37.632654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:37.632999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:37.633511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] PATH_INFO: `/v3/projects/3aee17c3b800432e8b8e7f10041c038b` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:37.641362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aee17c3b800432e8b8e7f10041c038b)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:37.641362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:37.791853 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aee17c3b800432e8b8e7f10041c038b', 'request_id': 'req-68aaa260-9e01-4d49-a3bd-73453b3aae79'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:37.916781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aee17c3b800432e8b8e7f10041c038b', 'request_id': 'req-68aaa260-9e01-4d49-a3bd-73453b3aae79'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:37.924954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aee17c3b800432e8b8e7f10041c038b', 'request_id': 'req-68aaa260-9e01-4d49-a3bd-73453b3aae79'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:37.937525 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] The token cache is being invalidate because project 3aee17c3b800432e8b8e7f10041c038b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:37.937818 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:37.938494 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:37.940968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1050/2118] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:37 2022] DELETE /identity/v3/projects/3aee17c3b800432e8b8e7f10041c038b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:37.945280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:37.951859 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:37.961498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564dec9-c0e6-4845-8c00-393ca3750805 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:38.025502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd3ae0-682f-4552-a30b-f708532415bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:38.026532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd3ae0-682f-4552-a30b-f708532415bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:38.027031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd3ae0-682f-4552-a30b-f708532415bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:38.027659 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd3ae0-682f-4552-a30b-f708532415bb admin admin] PATH_INFO: `/v3/users/632970735da349ea97fad171b5b431dc` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:38.029689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd3ae0-682f-4552-a30b-f708532415bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=632970735da349ea97fad171b5b431dc)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:38.031656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd3ae0-682f-4552-a30b-f708532415bb admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:38.136365 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:38.262014 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-b5bd3ae0-682f-4552-a30b-f708532415bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '632970735da349ea97fad171b5b431dc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:38.352007 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-b5bd3ae0-682f-4552-a30b-f708532415bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '632970735da349ea97fad171b5b431dc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:38.362506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-b5bd3ae0-682f-4552-a30b-f708532415bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '632970735da349ea97fad171b5b431dc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:38.363288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-b5bd3ae0-682f-4552-a30b-f708532415bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '632970735da349ea97fad171b5b431dc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:38.363923 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-b5bd3ae0-682f-4552-a30b-f708532415bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '632970735da349ea97fad171b5b431dc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:38.385550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1069/2119] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:37 2022] DELETE /identity/v3/users/632970735da349ea97fad171b5b431dc => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:38.659327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:38.661866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:38.682227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaa260-9e01-4d49-a3bd-73453b3aae79 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:38.722151 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:38.781020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6c97a-8490-47fc-9fd6-d67063ab374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:38.782016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6c97a-8490-47fc-9fd6-d67063ab374d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:38.782304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6c97a-8490-47fc-9fd6-d67063ab374d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:38.782582 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6c97a-8490-47fc-9fd6-d67063ab374d admin admin] PATH_INFO: `/v3/projects/9e99212d3cc649eeb8b27c7473502914` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:38.783811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6c97a-8490-47fc-9fd6-d67063ab374d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e99212d3cc649eeb8b27c7473502914)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:38.786670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6c97a-8490-47fc-9fd6-d67063ab374d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:39.056961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-84d6c97a-8490-47fc-9fd6-d67063ab374d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e99212d3cc649eeb8b27c7473502914', 'request_id': 'req-84d6c97a-8490-47fc-9fd6-d67063ab374d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:39.172418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-84d6c97a-8490-47fc-9fd6-d67063ab374d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e99212d3cc649eeb8b27c7473502914', 'request_id': 'req-84d6c97a-8490-47fc-9fd6-d67063ab374d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:39.179857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-84d6c97a-8490-47fc-9fd6-d67063ab374d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e99212d3cc649eeb8b27c7473502914', 'request_id': 'req-84d6c97a-8490-47fc-9fd6-d67063ab374d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:39.196736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-84d6c97a-8490-47fc-9fd6-d67063ab374d admin admin] The token cache is being invalidate because project 9e99212d3cc649eeb8b27c7473502914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:39.197184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-84d6c97a-8490-47fc-9fd6-d67063ab374d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:39.198430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-84d6c97a-8490-47fc-9fd6-d67063ab374d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:39.200298 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1051/2120] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:38 2022] DELETE /identity/v3/projects/9e99212d3cc649eeb8b27c7473502914 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:39.205287 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46365a8-cc03-4279-9876-0e1c44e22409 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:39.205991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46365a8-cc03-4279-9876-0e1c44e22409 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:39.205991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46365a8-cc03-4279-9876-0e1c44e22409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:39.238397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-f46365a8-cc03-4279-9876-0e1c44e22409 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:39.239979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-f46365a8-cc03-4279-9876-0e1c44e22409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:39.330586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1070/2121] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:39.337106 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33248748-18ca-477d-8cf8-271130d4f3ba None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:39.337609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33248748-18ca-477d-8cf8-271130d4f3ba None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:39.337974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33248748-18ca-477d-8cf8-271130d4f3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:39.358921 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-33248748-18ca-477d-8cf8-271130d4f3ba None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:39.360412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-33248748-18ca-477d-8cf8-271130d4f3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:39.371801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1052/2122] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:39.375392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46365a8-cc03-4279-9876-0e1c44e22409 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:39.400930 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46365a8-cc03-4279-9876-0e1c44e22409 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:39.404610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fca3d2-79db-4edb-8eca-961371b6a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:39.405495 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca3d2-79db-4edb-8eca-961371b6a7bd admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:39.406127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca3d2-79db-4edb-8eca-961371b6a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:39.406358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca3d2-79db-4edb-8eca-961371b6a7bd admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:39.407248 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fca3d2-79db-4edb-8eca-961371b6a7bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:01:39.407896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fca3d2-79db-4edb-8eca-961371b6a7bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:39.412716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fca3d2-79db-4edb-8eca-961371b6a7bd admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:39.429211 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1071/2123] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:01:39.432719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33248748-18ca-477d-8cf8-271130d4f3ba None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:39.443183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33248748-18ca-477d-8cf8-271130d4f3ba None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:39.448663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae268e7a-8efb-40a3-a1b3-4b1af6609460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:39.449359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae268e7a-8efb-40a3-a1b3-4b1af6609460 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:39.449676 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae268e7a-8efb-40a3-a1b3-4b1af6609460 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:39.452345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae268e7a-8efb-40a3-a1b3-4b1af6609460 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:39.452345 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae268e7a-8efb-40a3-a1b3-4b1af6609460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:39.453200 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae268e7a-8efb-40a3-a1b3-4b1af6609460 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:39.564785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1053/2124] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:39 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:39.568338 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fca3d2-79db-4edb-8eca-961371b6a7bd admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:39.579947 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fca3d2-79db-4edb-8eca-961371b6a7bd admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:39.658784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9880a7-bea2-4cee-add0-782e5bb0d277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:39.659456 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9880a7-bea2-4cee-add0-782e5bb0d277 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:39.659774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9880a7-bea2-4cee-add0-782e5bb0d277 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:39.660591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9880a7-bea2-4cee-add0-782e5bb0d277 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:39.661507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9880a7-bea2-4cee-add0-782e5bb0d277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:39.663320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9880a7-bea2-4cee-add0-782e5bb0d277 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:39.759203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1072/2125] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:39 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:39.760546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae268e7a-8efb-40a3-a1b3-4b1af6609460 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:39.771840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae268e7a-8efb-40a3-a1b3-4b1af6609460 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:39.780608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd31d39-7ec5-47ba-8540-178dd8c1e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:39.781481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd31d39-7ec5-47ba-8540-178dd8c1e847 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:39.791195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd31d39-7ec5-47ba-8540-178dd8c1e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:39.791195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd31d39-7ec5-47ba-8540-178dd8c1e847 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:39.791195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd31d39-7ec5-47ba-8540-178dd8c1e847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:39.791195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd31d39-7ec5-47ba-8540-178dd8c1e847 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:39.799410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1054/2126] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:01:39.804057 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9880a7-bea2-4cee-add0-782e5bb0d277 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:39.814633 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9880a7-bea2-4cee-add0-782e5bb0d277 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:39.820856 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97446f0f-956c-4350-adf8-9077ec964bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:39.822460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97446f0f-956c-4350-adf8-9077ec964bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:39.822460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97446f0f-956c-4350-adf8-9077ec964bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:39.822460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97446f0f-956c-4350-adf8-9077ec964bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:39.823002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97446f0f-956c-4350-adf8-9077ec964bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:39.824738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97446f0f-956c-4350-adf8-9077ec964bd1 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:39.836788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1073/2127] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:01:39.841102 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd31d39-7ec5-47ba-8540-178dd8c1e847 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:39.852938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd31d39-7ec5-47ba-8540-178dd8c1e847 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:39.858583 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890a2d0-e537-4b04-89d6-c6f2ddd5aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:39.859829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890a2d0-e537-4b04-89d6-c6f2ddd5aab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:39.860205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890a2d0-e537-4b04-89d6-c6f2ddd5aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:39.860720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890a2d0-e537-4b04-89d6-c6f2ddd5aab7 admin admin] PATH_INFO: `/v3/projects/04b9d7ea3dc543d1a7b87f267e5e3803/users/27fb0dc000894bb78c6fceb46ea537d5/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:39.884717 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890a2d0-e537-4b04-89d6-c6f2ddd5aab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b9d7ea3dc543d1a7b87f267e5e3803, user_id=27fb0dc000894bb78c6fceb46ea537d5, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:39.887230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890a2d0-e537-4b04-89d6-c6f2ddd5aab7 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:40.021887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1055/2128] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:39 2022] PUT /identity/v3/projects/04b9d7ea3dc543d1a7b87f267e5e3803/users/27fb0dc000894bb78c6fceb46ea537d5/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:40.024136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3b15f-437f-4c4a-829f-0bbbe27c8dfe None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:40.024431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3b15f-437f-4c4a-829f-0bbbe27c8dfe None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:40.024715 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3b15f-437f-4c4a-829f-0bbbe27c8dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:40.047681 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:40.062186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-73b3b15f-437f-4c4a-829f-0bbbe27c8dfe None None] MFA Rules not processed for user `27fb0dc000894bb78c6fceb46ea537d5`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:40.064661 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-73b3b15f-437f-4c4a-829f-0bbbe27c8dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:40.189423 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1074/2129] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:40.200826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890a2d0-e537-4b04-89d6-c6f2ddd5aab7 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:40.202851 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1890a2d0-e537-4b04-89d6-c6f2ddd5aab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:40.308296 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:40.340997 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890a2d0-e537-4b04-89d6-c6f2ddd5aab7 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:40.345051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7935e-f294-4fe1-854e-ba8f7658007e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:40.345724 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7935e-f294-4fe1-854e-ba8f7658007e service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:40.345972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7935e-f294-4fe1-854e-ba8f7658007e service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:40.346254 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7935e-f294-4fe1-854e-ba8f7658007e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:40.356879 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7935e-f294-4fe1-854e-ba8f7658007e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:40.358429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7935e-f294-4fe1-854e-ba8f7658007e service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:40.381787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1056/2130] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:44.503014 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3b15f-437f-4c4a-829f-0bbbe27c8dfe None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:44.504659 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-73b3b15f-437f-4c4a-829f-0bbbe27c8dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:44.584577 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3b15f-437f-4c4a-829f-0bbbe27c8dfe None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:44.589665 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:44.590605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:44.590949 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:44.591230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] PATH_INFO: `/v3/users/e67bb84c85374a16b3365de958ae4424` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:44.592480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67bb84c85374a16b3365de958ae4424)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:44.594809 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:44.806985 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67bb84c85374a16b3365de958ae4424'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:44.857692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67bb84c85374a16b3365de958ae4424'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:44.869750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67bb84c85374a16b3365de958ae4424'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:44.870734 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67bb84c85374a16b3365de958ae4424'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:44.871624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67bb84c85374a16b3365de958ae4424'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:44.891832 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1075/2131] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:44 2022] DELETE /identity/v3/users/e67bb84c85374a16b3365de958ae4424 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:44.896324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4bb0c-924d-415b-bc8a-57771da1d9e1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:44.896770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4bb0c-924d-415b-bc8a-57771da1d9e1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:44.897014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4bb0c-924d-415b-bc8a-57771da1d9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:44.921075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-69c4bb0c-924d-415b-bc8a-57771da1d9e1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:44.922356 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-69c4bb0c-924d-415b-bc8a-57771da1d9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:44.987372 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1057/2132] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:44.997994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:44.999713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:45.025674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:45.071367 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cc94f-92e0-4e3f-916d-428fb1e7066d admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:45.075153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf3b64-74fe-4ed5-9605-fb716bb77eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:45.075855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf3b64-74fe-4ed5-9605-fb716bb77eea service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:45.076142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf3b64-74fe-4ed5-9605-fb716bb77eea service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:45.076415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf3b64-74fe-4ed5-9605-fb716bb77eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:45.089408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf3b64-74fe-4ed5-9605-fb716bb77eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:45.093798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf3b64-74fe-4ed5-9605-fb716bb77eea service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:45.101751 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1076/2133] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:45.491170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4bb0c-924d-415b-bc8a-57771da1d9e1 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:45.492578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-69c4bb0c-924d-415b-bc8a-57771da1d9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:45.506142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4bb0c-924d-415b-bc8a-57771da1d9e1 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:45.511667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c8907-f444-463b-b4f0-3e8338bfadfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:45.513035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8907-f444-463b-b4f0-3e8338bfadfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:45.513035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8907-f444-463b-b4f0-3e8338bfadfd admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:45.513241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8907-f444-463b-b4f0-3e8338bfadfd admin admin] PATH_INFO: `/v3/users/c41fd9b3860546168ce3f78ff5da32d5` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:45.514996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c8907-f444-463b-b4f0-3e8338bfadfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41fd9b3860546168ce3f78ff5da32d5)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:45.516930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c8907-f444-463b-b4f0-3e8338bfadfd admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:45.640710 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf3b64-74fe-4ed5-9605-fb716bb77eea service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:45.644494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c2bf3b64-74fe-4ed5-9605-fb716bb77eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:45.667733 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf3b64-74fe-4ed5-9605-fb716bb77eea service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:45.688412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:45.689288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:45.689598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:45.689874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3 admin admin] PATH_INFO: `/v3/projects/947a63d342c343d59fc13afd711d48b3` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:45.691182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=947a63d342c343d59fc13afd711d48b3)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:45.693162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:45.736799 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6b6c8907-f444-463b-b4f0-3e8338bfadfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41fd9b3860546168ce3f78ff5da32d5'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:45.848720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6b6c8907-f444-463b-b4f0-3e8338bfadfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41fd9b3860546168ce3f78ff5da32d5'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:45.853434 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6b6c8907-f444-463b-b4f0-3e8338bfadfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41fd9b3860546168ce3f78ff5da32d5'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:45.864100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6b6c8907-f444-463b-b4f0-3e8338bfadfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41fd9b3860546168ce3f78ff5da32d5'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:45.864964 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6b6c8907-f444-463b-b4f0-3e8338bfadfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41fd9b3860546168ce3f78ff5da32d5'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:45.880354 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947a63d342c343d59fc13afd711d48b3', 'request_id': 'req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:45.893505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1058/2134] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:45 2022] DELETE /identity/v3/users/c41fd9b3860546168ce3f78ff5da32d5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:45.898748 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa09bf-150a-49fe-9084-728f86ad0b39 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:45.899407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa09bf-150a-49fe-9084-728f86ad0b39 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:45.899407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa09bf-150a-49fe-9084-728f86ad0b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:45.919065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d0fa09bf-150a-49fe-9084-728f86ad0b39 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:45.920328 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d0fa09bf-150a-49fe-9084-728f86ad0b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:45.972000 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:45.988436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1059/2135] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:46.005820 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa09bf-150a-49fe-9084-728f86ad0b39 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:46.007841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d0fa09bf-150a-49fe-9084-728f86ad0b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:46.008208 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947a63d342c343d59fc13afd711d48b3', 'request_id': 'req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:46.020076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947a63d342c343d59fc13afd711d48b3', 'request_id': 'req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:46.041669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3 admin admin] The token cache is being invalidate because project 947a63d342c343d59fc13afd711d48b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:46.041966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:46.042751 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c2edcd5f-8ef6-4ff6-afb4-3e40605f06d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:46.045351 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1077/2136] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:45 2022] DELETE /identity/v3/projects/947a63d342c343d59fc13afd711d48b3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:46.050308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299714d8-752a-4bb2-bc57-3f1b4f91d683 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:46.051148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299714d8-752a-4bb2-bc57-3f1b4f91d683 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:46.051449 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299714d8-752a-4bb2-bc57-3f1b4f91d683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:46.076010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-299714d8-752a-4bb2-bc57-3f1b4f91d683 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:46.077454 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-299714d8-752a-4bb2-bc57-3f1b4f91d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:46.097960 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1078/2137] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:46.099440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b898b70-a671-46d9-879f-839ebc3cddc7 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:46.099732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b898b70-a671-46d9-879f-839ebc3cddc7 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:46.100010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b898b70-a671-46d9-879f-839ebc3cddc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:46.123004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-7b898b70-a671-46d9-879f-839ebc3cddc7 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:46.124680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7b898b70-a671-46d9-879f-839ebc3cddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:46.133439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa09bf-150a-49fe-9084-728f86ad0b39 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:46.137615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776f20-dd90-48f3-9707-64d68a499e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:46.138277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776f20-dd90-48f3-9707-64d68a499e11 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:46.138558 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776f20-dd90-48f3-9707-64d68a499e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:46.138887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776f20-dd90-48f3-9707-64d68a499e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:46.140757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c2776f20-dd90-48f3-9707-64d68a499e11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:46.148141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1079/2138] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:46.154196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b898b70-a671-46d9-879f-839ebc3cddc7 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:46.169996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b898b70-a671-46d9-879f-839ebc3cddc7 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:46.170498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2776f20-dd90-48f3-9707-64d68a499e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:46.173010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2776f20-dd90-48f3-9707-64d68a499e11 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:46.174995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c5c7a-e09e-4a6e-92e3-ee9d35608df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:46.175720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5c7a-e09e-4a6e-92e3-ee9d35608df1 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:46.176002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5c7a-e09e-4a6e-92e3-ee9d35608df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:46.176274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5c7a-e09e-4a6e-92e3-ee9d35608df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:46.177004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c5c7a-e09e-4a6e-92e3-ee9d35608df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:01:46.177310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c5c7a-e09e-4a6e-92e3-ee9d35608df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:46.179133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c5c7a-e09e-4a6e-92e3-ee9d35608df1 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:46.196684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1060/2139] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:01:46.200929 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776f20-dd90-48f3-9707-64d68a499e11 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:46.201105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1080/2140] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:01:46.216913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776f20-dd90-48f3-9707-64d68a499e11 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:46.235125 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420af3f3-de5b-4fd7-aadc-5f5e60ca8665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:46.235734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af3f3-de5b-4fd7-aadc-5f5e60ca8665 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:46.236017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af3f3-de5b-4fd7-aadc-5f5e60ca8665 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:46.236293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af3f3-de5b-4fd7-aadc-5f5e60ca8665 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:46.237005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420af3f3-de5b-4fd7-aadc-5f5e60ca8665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:46.240195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420af3f3-de5b-4fd7-aadc-5f5e60ca8665 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:46.394876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1061/2141] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:46 2022] POST /identity/v3/projects => generated 391 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:01:46.399949 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c5c7a-e09e-4a6e-92e3-ee9d35608df1 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:46.413010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c5c7a-e09e-4a6e-92e3-ee9d35608df1 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:46.501670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7703239-4d30-4d98-848b-d39977fba7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:46.502375 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7703239-4d30-4d98-848b-d39977fba7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:46.502707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7703239-4d30-4d98-848b-d39977fba7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:46.503593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7703239-4d30-4d98-848b-d39977fba7b8 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:46.504316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7703239-4d30-4d98-848b-d39977fba7b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:46.507620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7703239-4d30-4d98-848b-d39977fba7b8 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:46.634220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1081/2142] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:46 2022] POST /identity/v3/users => generated 296 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:46.690591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420af3f3-de5b-4fd7-aadc-5f5e60ca8665 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:46.702273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420af3f3-de5b-4fd7-aadc-5f5e60ca8665 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:46.708081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d550be-55fc-47cd-b024-5b74223ae3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:46.708830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d550be-55fc-47cd-b024-5b74223ae3fe admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:46.709121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d550be-55fc-47cd-b024-5b74223ae3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:46.709484 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d550be-55fc-47cd-b024-5b74223ae3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:46.710271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d550be-55fc-47cd-b024-5b74223ae3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:46.711930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d550be-55fc-47cd-b024-5b74223ae3fe admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:46.725425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1062/2143] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:46.729520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7703239-4d30-4d98-848b-d39977fba7b8 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:46.749481 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7703239-4d30-4d98-848b-d39977fba7b8 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:46.758973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1161e-65af-4539-955d-24be4a7d34d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:46.758973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1161e-65af-4539-955d-24be4a7d34d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:46.759401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1161e-65af-4539-955d-24be4a7d34d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:46.759603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1161e-65af-4539-955d-24be4a7d34d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:46.760420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1161e-65af-4539-955d-24be4a7d34d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:46.763000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1161e-65af-4539-955d-24be4a7d34d1 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:46.765363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:46.786207 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1082/2144] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:46.787626 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d550be-55fc-47cd-b024-5b74223ae3fe admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:46.802133 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d550be-55fc-47cd-b024-5b74223ae3fe admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:46.808324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283931c-2941-44ae-94af-d261910af20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:46.809879 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283931c-2941-44ae-94af-d261910af20b admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:46.814883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283931c-2941-44ae-94af-d261910af20b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:46.815264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283931c-2941-44ae-94af-d261910af20b admin admin] PATH_INFO: `/v3/projects/abe1e4d85d79446fb4841925d0c62467/users/13a2f010923d40e2a0df9fcfbdb9d98b/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:46.841123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283931c-2941-44ae-94af-d261910af20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe1e4d85d79446fb4841925d0c62467, user_id=13a2f010923d40e2a0df9fcfbdb9d98b, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:46.844638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283931c-2941-44ae-94af-d261910af20b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:46.981648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1063/2145] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:46 2022] PUT /identity/v3/projects/abe1e4d85d79446fb4841925d0c62467/users/13a2f010923d40e2a0df9fcfbdb9d98b/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:46.992397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cedcd2-e31a-4c97-b18b-369414be3966 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:46.992689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cedcd2-e31a-4c97-b18b-369414be3966 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:46.992980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cedcd2-e31a-4c97-b18b-369414be3966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:47.020895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-49cedcd2-e31a-4c97-b18b-369414be3966 None None] MFA Rules not processed for user `13a2f010923d40e2a0df9fcfbdb9d98b`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:47.022143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-49cedcd2-e31a-4c97-b18b-369414be3966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:47.099426 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1083/2146] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:47.115320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283931c-2941-44ae-94af-d261910af20b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:47.120162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c283931c-2941-44ae-94af-d261910af20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:47.184307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cedcd2-e31a-4c97-b18b-369414be3966 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:47.185968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-49cedcd2-e31a-4c97-b18b-369414be3966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:47.269963 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283931c-2941-44ae-94af-d261910af20b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:47.280895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9af981-a028-4ed2-8fb1-60b28f205cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:47.281854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9af981-a028-4ed2-8fb1-60b28f205cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:47.282138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9af981-a028-4ed2-8fb1-60b28f205cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:47.282413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9af981-a028-4ed2-8fb1-60b28f205cbb admin admin] PATH_INFO: `/v3/projects/c2c50e12893a4030acb9f3af0351bf71` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:47.283910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9af981-a028-4ed2-8fb1-60b28f205cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c50e12893a4030acb9f3af0351bf71)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:47.286414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9af981-a028-4ed2-8fb1-60b28f205cbb admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:47.314722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cedcd2-e31a-4c97-b18b-369414be3966 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:47.319691 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073f9e5-29c0-4ae9-8fda-c9bd3d0846b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:47.320578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f9e5-29c0-4ae9-8fda-c9bd3d0846b9 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:47.321011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f9e5-29c0-4ae9-8fda-c9bd3d0846b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:47.322382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f9e5-29c0-4ae9-8fda-c9bd3d0846b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:47.336639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073f9e5-29c0-4ae9-8fda-c9bd3d0846b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:47.338962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073f9e5-29c0-4ae9-8fda-c9bd3d0846b9 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:47.351455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1084/2147] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:01:47.407056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:47.424081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-5a9af981-a028-4ed2-8fb1-60b28f205cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c50e12893a4030acb9f3af0351bf71', 'request_id': 'req-5a9af981-a028-4ed2-8fb1-60b28f205cbb'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:47.511020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-5a9af981-a028-4ed2-8fb1-60b28f205cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c50e12893a4030acb9f3af0351bf71', 'request_id': 'req-5a9af981-a028-4ed2-8fb1-60b28f205cbb'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:47.518764 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-5a9af981-a028-4ed2-8fb1-60b28f205cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c50e12893a4030acb9f3af0351bf71', 'request_id': 'req-5a9af981-a028-4ed2-8fb1-60b28f205cbb'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:47.541121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-5a9af981-a028-4ed2-8fb1-60b28f205cbb admin admin] The token cache is being invalidate because project c2c50e12893a4030acb9f3af0351bf71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:47.541503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-5a9af981-a028-4ed2-8fb1-60b28f205cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:47.542177 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-5a9af981-a028-4ed2-8fb1-60b28f205cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:47.544156 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1064/2148] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:47 2022] DELETE /identity/v3/projects/c2c50e12893a4030acb9f3af0351bf71 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:47.549244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f65f60-4653-4f58-8c89-4f352e3cbada None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:47.549629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f65f60-4653-4f58-8c89-4f352e3cbada None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:47.549908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f65f60-4653-4f58-8c89-4f352e3cbada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:47.568727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-c9f65f60-4653-4f58-8c89-4f352e3cbada None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:47.569960 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c9f65f60-4653-4f58-8c89-4f352e3cbada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:47.649107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1085/2149] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:47.649337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f0b1-7c54-483a-aecf-61ef8295b917 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:47.650700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f0b1-7c54-483a-aecf-61ef8295b917 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:47.651085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f0b1-7c54-483a-aecf-61ef8295b917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:47.674497 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2bb0f0b1-7c54-483a-aecf-61ef8295b917 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:47.676481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2bb0f0b1-7c54-483a-aecf-61ef8295b917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:47.687792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1065/2150] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:47.693317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f65f60-4653-4f58-8c89-4f352e3cbada None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:47.713644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f65f60-4653-4f58-8c89-4f352e3cbada None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:47.718617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdc2d6-d1c1-444e-98f0-6e06b790074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:47.719391 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdc2d6-d1c1-444e-98f0-6e06b790074d admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:47.719809 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdc2d6-d1c1-444e-98f0-6e06b790074d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:47.720236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdc2d6-d1c1-444e-98f0-6e06b790074d admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:47.721534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdc2d6-d1c1-444e-98f0-6e06b790074d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:01:47.721965 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdc2d6-d1c1-444e-98f0-6e06b790074d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:47.725345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdc2d6-d1c1-444e-98f0-6e06b790074d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:47.750610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1086/2151] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:01:47.751544 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0f0b1-7c54-483a-aecf-61ef8295b917 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:47.770090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0f0b1-7c54-483a-aecf-61ef8295b917 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:47.776665 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272eecf-4b1d-4c92-8b8f-108e1eb8b5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:47.777782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272eecf-4b1d-4c92-8b8f-108e1eb8b5bc admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:47.778241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272eecf-4b1d-4c92-8b8f-108e1eb8b5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:47.778719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272eecf-4b1d-4c92-8b8f-108e1eb8b5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:47.779568 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272eecf-4b1d-4c92-8b8f-108e1eb8b5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:47.782498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272eecf-4b1d-4c92-8b8f-108e1eb8b5bc admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:47.883737 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdc2d6-d1c1-444e-98f0-6e06b790074d admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:47.886430 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3cbdc2d6-d1c1-444e-98f0-6e06b790074d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:47.903836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdc2d6-d1c1-444e-98f0-6e06b790074d admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:47.908796 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87101233-840d-4636-9008-17a5c7beb601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:47.909746 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87101233-840d-4636-9008-17a5c7beb601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:47.910032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87101233-840d-4636-9008-17a5c7beb601 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:47.910313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87101233-840d-4636-9008-17a5c7beb601 admin admin] PATH_INFO: `/v3/users/27fb0dc000894bb78c6fceb46ea537d5` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:47.911529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87101233-840d-4636-9008-17a5c7beb601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27fb0dc000894bb78c6fceb46ea537d5)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:47.913626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87101233-840d-4636-9008-17a5c7beb601 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:47.922291 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1066/2152] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:47 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:01:47.926841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272eecf-4b1d-4c92-8b8f-108e1eb8b5bc admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:48.012821 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272eecf-4b1d-4c92-8b8f-108e1eb8b5bc admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:48.018404 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98926295-2f66-48a6-90c0-30c3698a52b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:48.019181 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98926295-2f66-48a6-90c0-30c3698a52b7 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:48.020011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98926295-2f66-48a6-90c0-30c3698a52b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:48.020474 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98926295-2f66-48a6-90c0-30c3698a52b7 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:48.021183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98926295-2f66-48a6-90c0-30c3698a52b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:48.024885 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98926295-2f66-48a6-90c0-30c3698a52b7 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:48.121929 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1067/2153] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:47 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:01:48.125826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98926295-2f66-48a6-90c0-30c3698a52b7 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:48.131457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-87101233-840d-4636-9008-17a5c7beb601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27fb0dc000894bb78c6fceb46ea537d5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:48.139682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98926295-2f66-48a6-90c0-30c3698a52b7 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:48.144852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0eb749-f5a8-4858-bf9a-b3276315f0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:48.147646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0eb749-f5a8-4858-bf9a-b3276315f0fc admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:48.147646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0eb749-f5a8-4858-bf9a-b3276315f0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:48.147646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0eb749-f5a8-4858-bf9a-b3276315f0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:48.147646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0eb749-f5a8-4858-bf9a-b3276315f0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:48.148468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0eb749-f5a8-4858-bf9a-b3276315f0fc admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:48.158609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1068/2154] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:01:48.162533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0eb749-f5a8-4858-bf9a-b3276315f0fc admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:48.172412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0eb749-f5a8-4858-bf9a-b3276315f0fc admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:48.177846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6bebb-47d9-4c25-b322-79549d22280f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:48.178679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6bebb-47d9-4c25-b322-79549d22280f admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:48.179032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6bebb-47d9-4c25-b322-79549d22280f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:48.179383 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6bebb-47d9-4c25-b322-79549d22280f admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:48.180205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6bebb-47d9-4c25-b322-79549d22280f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:48.181905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6bebb-47d9-4c25-b322-79549d22280f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:48.197542 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-87101233-840d-4636-9008-17a5c7beb601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27fb0dc000894bb78c6fceb46ea537d5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:48.197667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1069/2155] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:01:48.198268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6bebb-47d9-4c25-b322-79549d22280f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:48.204784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-87101233-840d-4636-9008-17a5c7beb601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27fb0dc000894bb78c6fceb46ea537d5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:48.205850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-87101233-840d-4636-9008-17a5c7beb601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27fb0dc000894bb78c6fceb46ea537d5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:48.207347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-87101233-840d-4636-9008-17a5c7beb601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27fb0dc000894bb78c6fceb46ea537d5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:48.209093 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6bebb-47d9-4c25-b322-79549d22280f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:48.213945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281bc61-56f1-436f-9a42-1637a0805d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:48.214849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281bc61-56f1-436f-9a42-1637a0805d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:48.215173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281bc61-56f1-436f-9a42-1637a0805d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:48.215416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281bc61-56f1-436f-9a42-1637a0805d9a admin admin] PATH_INFO: `/v3/projects/839a0de431ff4d3cad357e7ddb7ef7a6/users/7a9db25a40744940bd07701cc57afeba/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:48.231511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1087/2156] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:47 2022] DELETE /identity/v3/users/27fb0dc000894bb78c6fceb46ea537d5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:48.232643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281bc61-56f1-436f-9a42-1637a0805d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=839a0de431ff4d3cad357e7ddb7ef7a6, user_id=7a9db25a40744940bd07701cc57afeba, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:48.234918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281bc61-56f1-436f-9a42-1637a0805d9a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:48.236392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fa2ab-0ff7-4a70-bba8-192fafee075c None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:48.237141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fa2ab-0ff7-4a70-bba8-192fafee075c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:48.237515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fa2ab-0ff7-4a70-bba8-192fafee075c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:48.260172 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-514fa2ab-0ff7-4a70-bba8-192fafee075c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:48.262196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-514fa2ab-0ff7-4a70-bba8-192fafee075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:48.345062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1070/2157] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:48 2022] PUT /identity/v3/projects/839a0de431ff4d3cad357e7ddb7ef7a6/users/7a9db25a40744940bd07701cc57afeba/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:01:48.350850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1d470-2142-4cbe-b91a-2cfc4deb411d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:48.351306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1d470-2142-4cbe-b91a-2cfc4deb411d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:48.351737 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1d470-2142-4cbe-b91a-2cfc4deb411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:48.379603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-fdb1d470-2142-4cbe-b91a-2cfc4deb411d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:48.381069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1088/2158] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:48.381353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fdb1d470-2142-4cbe-b91a-2cfc4deb411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:48.386966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fa2ab-0ff7-4a70-bba8-192fafee075c None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:48.390031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-514fa2ab-0ff7-4a70-bba8-192fafee075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:48.451053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1071/2159] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:48.462984 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1d470-2142-4cbe-b91a-2cfc4deb411d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:48.466458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fdb1d470-2142-4cbe-b91a-2cfc4deb411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:48.501717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fa2ab-0ff7-4a70-bba8-192fafee075c None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:48.548356 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1d470-2142-4cbe-b91a-2cfc4deb411d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:48.557008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878c017-2a24-4336-bbac-57aac23326d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:48.557891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878c017-2a24-4336-bbac-57aac23326d1 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:48.558188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878c017-2a24-4336-bbac-57aac23326d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:48.558466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878c017-2a24-4336-bbac-57aac23326d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:48.570364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878c017-2a24-4336-bbac-57aac23326d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:48.571144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9780fd-e76c-4ac6-8f51-db76c5c3f119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:48.571791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878c017-2a24-4336-bbac-57aac23326d1 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:48.571933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9780fd-e76c-4ac6-8f51-db76c5c3f119 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:48.572209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9780fd-e76c-4ac6-8f51-db76c5c3f119 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:48.572480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9780fd-e76c-4ac6-8f51-db76c5c3f119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:48.585742 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1072/2160] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:01:48.603895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9780fd-e76c-4ac6-8f51-db76c5c3f119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:48.605413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9780fd-e76c-4ac6-8f51-db76c5c3f119 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:48.623347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1089/2161] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:01:48.949996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:49.082545 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15bb62-eb6e-4059-bf68-25baa7ad2e88 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:49.083829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15bb62-eb6e-4059-bf68-25baa7ad2e88 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:49.084409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15bb62-eb6e-4059-bf68-25baa7ad2e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:49.108151 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-0f15bb62-eb6e-4059-bf68-25baa7ad2e88 None None] MFA Rules not processed for user `3c5b1c6778f74c0d8db93e3a29935480`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:49.109439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0f15bb62-eb6e-4059-bf68-25baa7ad2e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:49.176985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1073/2162] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:49.232443 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9780fd-e76c-4ac6-8f51-db76c5c3f119 service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:49.234181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7e9780fd-e76c-4ac6-8f51-db76c5c3f119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:49.248760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9780fd-e76c-4ac6-8f51-db76c5c3f119 service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:49.258896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f002c0-819a-45f6-9163-3e4807f03582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:49.259779 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f002c0-819a-45f6-9163-3e4807f03582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:49.260059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f002c0-819a-45f6-9163-3e4807f03582 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:49.260332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f002c0-819a-45f6-9163-3e4807f03582 admin admin] PATH_INFO: `/v3/projects/04b9d7ea3dc543d1a7b87f267e5e3803` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:49.263517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f002c0-819a-45f6-9163-3e4807f03582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b9d7ea3dc543d1a7b87f267e5e3803)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:49.267020 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f002c0-819a-45f6-9163-3e4807f03582 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:49.433947 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-05f002c0-819a-45f6-9163-3e4807f03582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b9d7ea3dc543d1a7b87f267e5e3803', 'request_id': 'req-05f002c0-819a-45f6-9163-3e4807f03582'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:49.505876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-05f002c0-819a-45f6-9163-3e4807f03582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b9d7ea3dc543d1a7b87f267e5e3803', 'request_id': 'req-05f002c0-819a-45f6-9163-3e4807f03582'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:49.513300 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-05f002c0-819a-45f6-9163-3e4807f03582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b9d7ea3dc543d1a7b87f267e5e3803', 'request_id': 'req-05f002c0-819a-45f6-9163-3e4807f03582'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:49.527009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-05f002c0-819a-45f6-9163-3e4807f03582 admin admin] The token cache is being invalidate because project 04b9d7ea3dc543d1a7b87f267e5e3803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:49.527308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-05f002c0-819a-45f6-9163-3e4807f03582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:49.528031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-05f002c0-819a-45f6-9163-3e4807f03582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:49.533241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1090/2163] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:49 2022] DELETE /identity/v3/projects/04b9d7ea3dc543d1a7b87f267e5e3803 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:49.534543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170709b-03c3-4b43-91ae-813836283243 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:49.535286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170709b-03c3-4b43-91ae-813836283243 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:49.535614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170709b-03c3-4b43-91ae-813836283243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:49.554838 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-8170709b-03c3-4b43-91ae-813836283243 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:49.556063 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8170709b-03c3-4b43-91ae-813836283243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:49.624925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1074/2164] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:49.633357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f429f-2801-4bd9-a06b-ffb45dc159d2 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:49.633722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f429f-2801-4bd9-a06b-ffb45dc159d2 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:49.633952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f429f-2801-4bd9-a06b-ffb45dc159d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:49.653934 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6e4f429f-2801-4bd9-a06b-ffb45dc159d2 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:49.654714 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6e4f429f-2801-4bd9-a06b-ffb45dc159d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:49.668390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170709b-03c3-4b43-91ae-813836283243 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:49.668916 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1091/2165] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:49.679054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170709b-03c3-4b43-91ae-813836283243 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:49.684147 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843cfc1-1a30-4c92-8130-b94917e8fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:49.684814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843cfc1-1a30-4c92-8130-b94917e8fa6d admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:49.685166 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843cfc1-1a30-4c92-8130-b94917e8fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:49.685526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843cfc1-1a30-4c92-8130-b94917e8fa6d admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:49.686313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843cfc1-1a30-4c92-8130-b94917e8fa6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:01:49.686625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843cfc1-1a30-4c92-8130-b94917e8fa6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:49.688288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843cfc1-1a30-4c92-8130-b94917e8fa6d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:49.703770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1075/2166] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:01:49.705869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f429f-2801-4bd9-a06b-ffb45dc159d2 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:49.717626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f429f-2801-4bd9-a06b-ffb45dc159d2 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:49.723280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261a320-e4c8-4b62-a6b5-342e87f25386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:49.724027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261a320-e4c8-4b62-a6b5-342e87f25386 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:49.724401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261a320-e4c8-4b62-a6b5-342e87f25386 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:49.724755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261a320-e4c8-4b62-a6b5-342e87f25386 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:49.725526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261a320-e4c8-4b62-a6b5-342e87f25386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:49.727434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261a320-e4c8-4b62-a6b5-342e87f25386 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:49.845067 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1092/2167] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:49 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:49.850128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843cfc1-1a30-4c92-8130-b94917e8fa6d admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:49.860907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843cfc1-1a30-4c92-8130-b94917e8fa6d admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:49.919608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:49.933341 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6fdd-39cb-41bb-9ca1-38128b96c619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:49.934384 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6fdd-39cb-41bb-9ca1-38128b96c619 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:49.936147 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6fdd-39cb-41bb-9ca1-38128b96c619 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:49.936437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6fdd-39cb-41bb-9ca1-38128b96c619 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:49.937144 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d6fdd-39cb-41bb-9ca1-38128b96c619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:49.939226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d6fdd-39cb-41bb-9ca1-38128b96c619 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:50.043102 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1076/2168] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:49 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:50.044691 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261a320-e4c8-4b62-a6b5-342e87f25386 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:50.059656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261a320-e4c8-4b62-a6b5-342e87f25386 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:50.068346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b45635-5b49-49e4-9a05-e0bcb46c9eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:50.069161 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b45635-5b49-49e4-9a05-e0bcb46c9eaa admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:50.069482 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b45635-5b49-49e4-9a05-e0bcb46c9eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:50.069727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b45635-5b49-49e4-9a05-e0bcb46c9eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:50.070466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b45635-5b49-49e4-9a05-e0bcb46c9eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:50.078607 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b45635-5b49-49e4-9a05-e0bcb46c9eaa admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:50.093710 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1093/2169] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:50.097910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6fdd-39cb-41bb-9ca1-38128b96c619 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:50.108121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6fdd-39cb-41bb-9ca1-38128b96c619 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:50.115261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db32f8a-74a2-4bea-aadf-22ee42ca0636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:50.115261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db32f8a-74a2-4bea-aadf-22ee42ca0636 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:50.115261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db32f8a-74a2-4bea-aadf-22ee42ca0636 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:50.115261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db32f8a-74a2-4bea-aadf-22ee42ca0636 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:50.115893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db32f8a-74a2-4bea-aadf-22ee42ca0636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:50.117266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db32f8a-74a2-4bea-aadf-22ee42ca0636 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:50.131059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1077/2170] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:50.135335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b45635-5b49-49e4-9a05-e0bcb46c9eaa admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:50.162389 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b45635-5b49-49e4-9a05-e0bcb46c9eaa admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:50.171509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b52667-7336-4ee3-8717-7f338e1c0d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:50.172786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b52667-7336-4ee3-8717-7f338e1c0d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:50.173144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b52667-7336-4ee3-8717-7f338e1c0d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:50.173537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b52667-7336-4ee3-8717-7f338e1c0d09 admin admin] PATH_INFO: `/v3/projects/7cee7a08c342406a958d5b5907f40f1e/users/d2ceb097102a4c609cd4b72dc27129c8/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:50.193641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b52667-7336-4ee3-8717-7f338e1c0d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cee7a08c342406a958d5b5907f40f1e, user_id=d2ceb097102a4c609cd4b72dc27129c8, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:50.198412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b52667-7336-4ee3-8717-7f338e1c0d09 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:50.232781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ca1ad-4598-4c93-a975-a9c2db4d16a7 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:50.233075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ca1ad-4598-4c93-a975-a9c2db4d16a7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:50.235774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ca1ad-4598-4c93-a975-a9c2db4d16a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:50.263517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-367ca1ad-4598-4c93-a975-a9c2db4d16a7 None None] MFA Rules not processed for user `7a9db25a40744940bd07701cc57afeba`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:50.265242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-367ca1ad-4598-4c93-a975-a9c2db4d16a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:50.295902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1094/2171] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:50 2022] PUT /identity/v3/projects/7cee7a08c342406a958d5b5907f40f1e/users/d2ceb097102a4c609cd4b72dc27129c8/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:50.307210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7de1e-3a54-4342-bf4e-8addeb08104d None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:50.307769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7de1e-3a54-4342-bf4e-8addeb08104d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:50.308280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7de1e-3a54-4342-bf4e-8addeb08104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:50.355475 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4aa7de1e-3a54-4342-bf4e-8addeb08104d None None] MFA Rules not processed for user `d2ceb097102a4c609cd4b72dc27129c8`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:50.357883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4aa7de1e-3a54-4342-bf4e-8addeb08104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:50.391577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1078/2172] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:50.407541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ca1ad-4598-4c93-a975-a9c2db4d16a7 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:50.410609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-367ca1ad-4598-4c93-a975-a9c2db4d16a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:50.597861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1095/2173] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:50.598932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ca1ad-4598-4c93-a975-a9c2db4d16a7 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:50.598932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67099a-cce8-4e70-9676-3229d8754a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:50.598932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67099a-cce8-4e70-9676-3229d8754a16 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:50.598932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67099a-cce8-4e70-9676-3229d8754a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:50.599378 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67099a-cce8-4e70-9676-3229d8754a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:50.599378 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67099a-cce8-4e70-9676-3229d8754a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:50.599378 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67099a-cce8-4e70-9676-3229d8754a16 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:50.603207 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1079/2174] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:01:50.610937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7de1e-3a54-4342-bf4e-8addeb08104d None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:50.693526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7de1e-3a54-4342-bf4e-8addeb08104d None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:50.698429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca2b65-d615-4400-b549-ddd40fca9658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:50.699097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca2b65-d615-4400-b549-ddd40fca9658 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:50.699428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca2b65-d615-4400-b549-ddd40fca9658 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:50.699705 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca2b65-d615-4400-b549-ddd40fca9658 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:50.700393 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca2b65-d615-4400-b549-ddd40fca9658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:50.702416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca2b65-d615-4400-b549-ddd40fca9658 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:50.918978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1096/2175] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:50 2022] POST /identity/v3/projects => generated 373 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:01:50.922699 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67099a-cce8-4e70-9676-3229d8754a16 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:50.944219 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67099a-cce8-4e70-9676-3229d8754a16 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:51.002955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acb747-9d47-43f7-87f4-f08d26791504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:51.003648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb747-9d47-43f7-87f4-f08d26791504 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:51.003934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb747-9d47-43f7-87f4-f08d26791504 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:51.004209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb747-9d47-43f7-87f4-f08d26791504 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:51.004896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acb747-9d47-43f7-87f4-f08d26791504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:51.006915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acb747-9d47-43f7-87f4-f08d26791504 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:51.202489 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:51.210544 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1080/2176] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:50 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:51.214069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca2b65-d615-4400-b549-ddd40fca9658 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:51.225022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca2b65-d615-4400-b549-ddd40fca9658 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:51.230282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591c88c-75d7-42c9-91aa-17482c12a72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:51.231516 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591c88c-75d7-42c9-91aa-17482c12a72e admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:51.231813 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591c88c-75d7-42c9-91aa-17482c12a72e admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:51.232094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591c88c-75d7-42c9-91aa-17482c12a72e admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:51.232838 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591c88c-75d7-42c9-91aa-17482c12a72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:51.235068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591c88c-75d7-42c9-91aa-17482c12a72e admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:51.251722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1097/2177] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:51.252779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acb747-9d47-43f7-87f4-f08d26791504 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:51.263753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acb747-9d47-43f7-87f4-f08d26791504 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:51.274452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1236d-0e53-46ea-b203-c90be3a60e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:51.279493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1236d-0e53-46ea-b203-c90be3a60e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:51.279493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1236d-0e53-46ea-b203-c90be3a60e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:51.279493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1236d-0e53-46ea-b203-c90be3a60e4e admin admin] PATH_INFO: `/v3/projects/e1b341082ab142089a119713cf53fb41/users/9a61c2c30e9142b29a1727659b220834/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:51.295123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1236d-0e53-46ea-b203-c90be3a60e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b341082ab142089a119713cf53fb41, user_id=9a61c2c30e9142b29a1727659b220834, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:51.319400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1236d-0e53-46ea-b203-c90be3a60e4e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:51.405841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1081/2178] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:51 2022] PUT /identity/v3/projects/e1b341082ab142089a119713cf53fb41/users/9a61c2c30e9142b29a1727659b220834/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:51.410477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591c88c-75d7-42c9-91aa-17482c12a72e admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:51.420326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591c88c-75d7-42c9-91aa-17482c12a72e admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:51.477029 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd602b93-f9d9-48b7-91d0-db987fc4dc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:51.477610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd602b93-f9d9-48b7-91d0-db987fc4dc6c admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:51.477891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd602b93-f9d9-48b7-91d0-db987fc4dc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:51.478161 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd602b93-f9d9-48b7-91d0-db987fc4dc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:51.478903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd602b93-f9d9-48b7-91d0-db987fc4dc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:51.480488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd602b93-f9d9-48b7-91d0-db987fc4dc6c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:51.490814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1098/2179] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:51.494827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1236d-0e53-46ea-b203-c90be3a60e4e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:51.506744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1236d-0e53-46ea-b203-c90be3a60e4e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:51.512596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1629a-48dd-4788-9819-4f697aaf93d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:51.513594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1629a-48dd-4788-9819-4f697aaf93d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:51.519995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1629a-48dd-4788-9819-4f697aaf93d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:51.519995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1629a-48dd-4788-9819-4f697aaf93d2 admin admin] PATH_INFO: `/v3/projects/e1b341082ab142089a119713cf53fb41/users/9a61c2c30e9142b29a1727659b220834/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:51.519995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1629a-48dd-4788-9819-4f697aaf93d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b341082ab142089a119713cf53fb41, user_id=9a61c2c30e9142b29a1727659b220834, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:51.519995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1629a-48dd-4788-9819-4f697aaf93d2 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:51.530867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1082/2180] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:51 2022] PUT /identity/v3/projects/e1b341082ab142089a119713cf53fb41/users/9a61c2c30e9142b29a1727659b220834/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:51.541268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf60a0-d598-4a4a-b4fb-a84b97fb1e84 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:51.541599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf60a0-d598-4a4a-b4fb-a84b97fb1e84 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:51.541884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf60a0-d598-4a4a-b4fb-a84b97fb1e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:51.574188 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-9bdf60a0-d598-4a4a-b4fb-a84b97fb1e84 None None] MFA Rules not processed for user `9a61c2c30e9142b29a1727659b220834`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:51.578033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-9bdf60a0-d598-4a4a-b4fb-a84b97fb1e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:51.697131 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1099/2181] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:51.710897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1629a-48dd-4788-9819-4f697aaf93d2 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:51.790479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1629a-48dd-4788-9819-4f697aaf93d2 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:51.794619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d11241-b19f-43c4-81ff-29f5993510c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:51.795989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d11241-b19f-43c4-81ff-29f5993510c1 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:51.795989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d11241-b19f-43c4-81ff-29f5993510c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:51.795989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d11241-b19f-43c4-81ff-29f5993510c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:51.872941 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d11241-b19f-43c4-81ff-29f5993510c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:51.876387 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d11241-b19f-43c4-81ff-29f5993510c1 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:51.884039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1083/2182] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:52.681864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516559a-08d2-4ab0-a258-f7bf13164ac3 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:52.687848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516559a-08d2-4ab0-a258-f7bf13164ac3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:52.688646 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516559a-08d2-4ab0-a258-f7bf13164ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:52.705970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-0516559a-08d2-4ab0-a258-f7bf13164ac3 None None] MFA Rules not processed for user `7a9db25a40744940bd07701cc57afeba`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:52.707665 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0516559a-08d2-4ab0-a258-f7bf13164ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:52.762282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1100/2183] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:53.345036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:54.449310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:54.551647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:55.066349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d11241-b19f-43c4-81ff-29f5993510c1 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:55.177168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d11241-b19f-43c4-81ff-29f5993510c1 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:55.182152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:55.184470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:55.184912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:55.185355 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] PATH_INFO: `/v3/users/d2ceb097102a4c609cd4b72dc27129c8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:55.186998 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ceb097102a4c609cd4b72dc27129c8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:55.189505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:55.413167 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ceb097102a4c609cd4b72dc27129c8'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:55.499407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ceb097102a4c609cd4b72dc27129c8'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:55.501320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ceb097102a4c609cd4b72dc27129c8'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:55.511052 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ceb097102a4c609cd4b72dc27129c8'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:55.513063 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ceb097102a4c609cd4b72dc27129c8'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:55.541207 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1084/2184] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:55 2022] DELETE /identity/v3/users/d2ceb097102a4c609cd4b72dc27129c8 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:55.547014 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dd2ef-ecad-4ec6-910c-03824fcebfe6 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:55.550671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dd2ef-ecad-4ec6-910c-03824fcebfe6 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:55.550671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dd2ef-ecad-4ec6-910c-03824fcebfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:55.570796 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-381dd2ef-ecad-4ec6-910c-03824fcebfe6 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:55.573219 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-381dd2ef-ecad-4ec6-910c-03824fcebfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:55.670895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1101/2185] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:55.678342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:55.680809 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:55.790073 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ff48e-8a84-43a6-add8-a166fffef268 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:55.812482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bafa5-5813-41d9-a04d-944738c7d861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:55.813655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bafa5-5813-41d9-a04d-944738c7d861 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:55.817687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bafa5-5813-41d9-a04d-944738c7d861 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:55.818362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bafa5-5813-41d9-a04d-944738c7d861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:55.863335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bafa5-5813-41d9-a04d-944738c7d861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:55.867179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bafa5-5813-41d9-a04d-944738c7d861 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:55.895038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1085/2186] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:56.391827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:56.774713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dd2ef-ecad-4ec6-910c-03824fcebfe6 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:56.776981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-381dd2ef-ecad-4ec6-910c-03824fcebfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:56.790348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dd2ef-ecad-4ec6-910c-03824fcebfe6 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:56.795815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea55a6-a28e-4204-88b6-414851bf5b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:56.797042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea55a6-a28e-4204-88b6-414851bf5b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:56.797579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea55a6-a28e-4204-88b6-414851bf5b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:56.798056 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea55a6-a28e-4204-88b6-414851bf5b4f admin admin] PATH_INFO: `/v3/projects/7cee7a08c342406a958d5b5907f40f1e` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:56.800381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea55a6-a28e-4204-88b6-414851bf5b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cee7a08c342406a958d5b5907f40f1e)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:56.802456 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea55a6-a28e-4204-88b6-414851bf5b4f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:57.008143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dcea55a6-a28e-4204-88b6-414851bf5b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cee7a08c342406a958d5b5907f40f1e', 'request_id': 'req-dcea55a6-a28e-4204-88b6-414851bf5b4f'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:57.202027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dcea55a6-a28e-4204-88b6-414851bf5b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cee7a08c342406a958d5b5907f40f1e', 'request_id': 'req-dcea55a6-a28e-4204-88b6-414851bf5b4f'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:57.210477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dcea55a6-a28e-4204-88b6-414851bf5b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cee7a08c342406a958d5b5907f40f1e', 'request_id': 'req-dcea55a6-a28e-4204-88b6-414851bf5b4f'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:57.235422 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dcea55a6-a28e-4204-88b6-414851bf5b4f admin admin] The token cache is being invalidate because project 7cee7a08c342406a958d5b5907f40f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:57.235718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dcea55a6-a28e-4204-88b6-414851bf5b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:57.238629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dcea55a6-a28e-4204-88b6-414851bf5b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:57.242841 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1102/2187] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:56 2022] DELETE /identity/v3/projects/7cee7a08c342406a958d5b5907f40f1e => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:57.247730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bafa5-5813-41d9-a04d-944738c7d861 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:57.261342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bafa5-5813-41d9-a04d-944738c7d861 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:57.394766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337476-344a-405b-88a5-701f3742215b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:57.394999 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:57.395819 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337476-344a-405b-88a5-701f3742215b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:57.396143 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337476-344a-405b-88a5-701f3742215b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:57.396410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337476-344a-405b-88a5-701f3742215b admin admin] PATH_INFO: `/v3/users/9a61c2c30e9142b29a1727659b220834` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:57.398670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94337476-344a-405b-88a5-701f3742215b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a61c2c30e9142b29a1727659b220834)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:57.401629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94337476-344a-405b-88a5-701f3742215b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:57.651343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-94337476-344a-405b-88a5-701f3742215b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a61c2c30e9142b29a1727659b220834'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:57.687636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f5edc-b814-41a8-8ca2-27a5725f7795 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:57.687636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f5edc-b814-41a8-8ca2-27a5725f7795 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:57.687636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f5edc-b814-41a8-8ca2-27a5725f7795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:57.765799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-0b1f5edc-b814-41a8-8ca2-27a5725f7795 None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:57.767189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0b1f5edc-b814-41a8-8ca2-27a5725f7795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:57.767572 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-94337476-344a-405b-88a5-701f3742215b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a61c2c30e9142b29a1727659b220834'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:57.768210 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-94337476-344a-405b-88a5-701f3742215b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a61c2c30e9142b29a1727659b220834'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:57.778968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-94337476-344a-405b-88a5-701f3742215b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a61c2c30e9142b29a1727659b220834'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:57.778968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-94337476-344a-405b-88a5-701f3742215b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a61c2c30e9142b29a1727659b220834'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:57.824609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1086/2188] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:01:57 2022] DELETE /identity/v3/users/9a61c2c30e9142b29a1727659b220834 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:57.883340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1103/2189] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 21:01:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 31 21:01:57.960035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337476-344a-405b-88a5-701f3742215b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:57.961482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-94337476-344a-405b-88a5-701f3742215b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:58.102383 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337476-344a-405b-88a5-701f3742215b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:58.109007 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c62fe-920f-4c88-b9d8-52980e3027e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:58.109816 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c62fe-920f-4c88-b9d8-52980e3027e7 service swift] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:58.110106 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c62fe-920f-4c88-b9d8-52980e3027e7 service swift] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:58.110436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c62fe-920f-4c88-b9d8-52980e3027e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:58.182613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:58.187362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c62fe-920f-4c88-b9d8-52980e3027e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:58.188414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c62fe-920f-4c88-b9d8-52980e3027e7 service swift] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:58.198888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1087/2190] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:01:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:01:58.714859 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f5edc-b814-41a8-8ca2-27a5725f7795 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:58.717141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0b1f5edc-b814-41a8-8ca2-27a5725f7795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:58.738894 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f5edc-b814-41a8-8ca2-27a5725f7795 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:58.802476 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011722c8-ff4d-4f59-9ef1-d671103db65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:58.803392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011722c8-ff4d-4f59-9ef1-d671103db65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:58.803746 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011722c8-ff4d-4f59-9ef1-d671103db65a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:58.804091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011722c8-ff4d-4f59-9ef1-d671103db65a admin admin] PATH_INFO: `/v3/projects/e1b341082ab142089a119713cf53fb41` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:58.805536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011722c8-ff4d-4f59-9ef1-d671103db65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b341082ab142089a119713cf53fb41)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:58.807559 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011722c8-ff4d-4f59-9ef1-d671103db65a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:58.922000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:58.925724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-011722c8-ff4d-4f59-9ef1-d671103db65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b341082ab142089a119713cf53fb41', 'request_id': 'req-011722c8-ff4d-4f59-9ef1-d671103db65a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:59.008068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-011722c8-ff4d-4f59-9ef1-d671103db65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b341082ab142089a119713cf53fb41', 'request_id': 'req-011722c8-ff4d-4f59-9ef1-d671103db65a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:59.016343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-011722c8-ff4d-4f59-9ef1-d671103db65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b341082ab142089a119713cf53fb41', 'request_id': 'req-011722c8-ff4d-4f59-9ef1-d671103db65a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:59.036312 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-011722c8-ff4d-4f59-9ef1-d671103db65a admin admin] The token cache is being invalidate because project e1b341082ab142089a119713cf53fb41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:01:59.036613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-011722c8-ff4d-4f59-9ef1-d671103db65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:59.037285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-011722c8-ff4d-4f59-9ef1-d671103db65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:01:59.044188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29216fd0-a00a-4100-b1e0-3b6357075059 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:59.044671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1104/2191] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:01:58 2022] DELETE /identity/v3/projects/e1b341082ab142089a119713cf53fb41 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:59.044784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29216fd0-a00a-4100-b1e0-3b6357075059 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:59.044784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29216fd0-a00a-4100-b1e0-3b6357075059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:59.075369 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-29216fd0-a00a-4100-b1e0-3b6357075059 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:59.076593 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-29216fd0-a00a-4100-b1e0-3b6357075059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:59.160782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092f95a-a41b-4034-88f5-249549102d19 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:59.161205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092f95a-a41b-4034-88f5-249549102d19 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:59.161808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092f95a-a41b-4034-88f5-249549102d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:59.162497 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1088/2192] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:59.190175 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-c092f95a-a41b-4034-88f5-249549102d19 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:59.192044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c092f95a-a41b-4034-88f5-249549102d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:59.201363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1105/2193] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:59.205469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29216fd0-a00a-4100-b1e0-3b6357075059 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:59.220319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29216fd0-a00a-4100-b1e0-3b6357075059 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:59.220319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e86aa2-5d5a-4385-a4b5-5d96c2c6838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:59.220733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e86aa2-5d5a-4385-a4b5-5d96c2c6838e admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:59.221012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e86aa2-5d5a-4385-a4b5-5d96c2c6838e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:59.221490 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e86aa2-5d5a-4385-a4b5-5d96c2c6838e admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:59.222766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e86aa2-5d5a-4385-a4b5-5d96c2c6838e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:01:59.223075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e86aa2-5d5a-4385-a4b5-5d96c2c6838e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:59.224677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e86aa2-5d5a-4385-a4b5-5d96c2c6838e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:59.236527 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1089/2194] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:01:59.241361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092f95a-a41b-4034-88f5-249549102d19 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:59.250720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092f95a-a41b-4034-88f5-249549102d19 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:59.256063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8b42b-f7f6-44d3-945d-0ebfb5fe81e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:59.256716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8b42b-f7f6-44d3-945d-0ebfb5fe81e7 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:59.256995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8b42b-f7f6-44d3-945d-0ebfb5fe81e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:59.257267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8b42b-f7f6-44d3-945d-0ebfb5fe81e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:59.257999 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8b42b-f7f6-44d3-945d-0ebfb5fe81e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:59.259965 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8b42b-f7f6-44d3-945d-0ebfb5fe81e7 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:59.299062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec9c82-e1ab-47e4-afc8-5703a91b8247 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:59.299354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec9c82-e1ab-47e4-afc8-5703a91b8247 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:59.299630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec9c82-e1ab-47e4-afc8-5703a91b8247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:59.318351 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d2ec9c82-e1ab-47e4-afc8-5703a91b8247 None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:59.319550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d2ec9c82-e1ab-47e4-afc8-5703a91b8247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:59.389599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1106/2195] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:01:59 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:59.395897 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8b42b-f7f6-44d3-945d-0ebfb5fe81e7 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:59.442839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1090/2196] 10.222.0.39 () {58 vars in 967 bytes} [Tue May 31 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:59.443941 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec9c82-e1ab-47e4-afc8-5703a91b8247 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:59.445557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d2ec9c82-e1ab-47e4-afc8-5703a91b8247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:59.493918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8b42b-f7f6-44d3-945d-0ebfb5fe81e7 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:59.500048 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f568b9-f8fe-4c5f-8d2f-849be5f93d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:59.500987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f568b9-f8fe-4c5f-8d2f-849be5f93d3c admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:59.501267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f568b9-f8fe-4c5f-8d2f-849be5f93d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:59.501766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f568b9-f8fe-4c5f-8d2f-849be5f93d3c admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:59.502724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f568b9-f8fe-4c5f-8d2f-849be5f93d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:59.506216 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f568b9-f8fe-4c5f-8d2f-849be5f93d3c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:59.544631 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec9c82-e1ab-47e4-afc8-5703a91b8247 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:59.603457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1107/2197] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:01:59 2022] POST /identity/v3/users => generated 286 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:01:59.609445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f568b9-f8fe-4c5f-8d2f-849be5f93d3c admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:59.621413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45066a-12c4-4f42-a0dc-32a8f0fc8984 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:59.621707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f568b9-f8fe-4c5f-8d2f-849be5f93d3c admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:59.622331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45066a-12c4-4f42-a0dc-32a8f0fc8984 service swift] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:59.622712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45066a-12c4-4f42-a0dc-32a8f0fc8984 service swift] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:59.623078 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45066a-12c4-4f42-a0dc-32a8f0fc8984 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:59.627918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855ef4e-aa1f-4bde-be17-d4252ff308d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:59.629464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855ef4e-aa1f-4bde-be17-d4252ff308d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:59.629894 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855ef4e-aa1f-4bde-be17-d4252ff308d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:59.630339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855ef4e-aa1f-4bde-be17-d4252ff308d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:59.634810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855ef4e-aa1f-4bde-be17-d4252ff308d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:59.634810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855ef4e-aa1f-4bde-be17-d4252ff308d9 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:59.647481 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1108/2198] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:59.648832 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855ef4e-aa1f-4bde-be17-d4252ff308d9 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:59.661235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855ef4e-aa1f-4bde-be17-d4252ff308d9 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:59.666691 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1bbce-12ff-4a97-882d-d8020aa1e4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:59.667361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1bbce-12ff-4a97-882d-d8020aa1e4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:59.667642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1bbce-12ff-4a97-882d-d8020aa1e4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:59.667917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1bbce-12ff-4a97-882d-d8020aa1e4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:59.668648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1bbce-12ff-4a97-882d-d8020aa1e4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:59.670276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1bbce-12ff-4a97-882d-d8020aa1e4a5 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:59.699015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1109/2199] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:01:59.702969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1bbce-12ff-4a97-882d-d8020aa1e4a5 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:59.707696 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45066a-12c4-4f42-a0dc-32a8f0fc8984 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:59.709238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45066a-12c4-4f42-a0dc-32a8f0fc8984 service swift] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:59.718563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1091/2200] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:01:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:01:59.718899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1bbce-12ff-4a97-882d-d8020aa1e4a5 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:59.733681 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2c6f0-0e8f-4b7b-a20e-f086c9a2c133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:59.734768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2c6f0-0e8f-4b7b-a20e-f086c9a2c133 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:59.735400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2c6f0-0e8f-4b7b-a20e-f086c9a2c133 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:59.735777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2c6f0-0e8f-4b7b-a20e-f086c9a2c133 admin admin] PATH_INFO: `/v3/projects/bbef91d51368407281682cc29323b797/users/495585254d5049359ba2c06f0a56bd0d/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:59.753740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2c6f0-0e8f-4b7b-a20e-f086c9a2c133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbef91d51368407281682cc29323b797, user_id=495585254d5049359ba2c06f0a56bd0d, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:59.756644 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2c6f0-0e8f-4b7b-a20e-f086c9a2c133 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:59.891323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1110/2201] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:01:59 2022] PUT /identity/v3/projects/bbef91d51368407281682cc29323b797/users/495585254d5049359ba2c06f0a56bd0d/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:01:59.904749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfd96d-79fa-4c6a-9647-2b4b1a4543d5 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:59.904986 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfd96d-79fa-4c6a-9647-2b4b1a4543d5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:59.905267 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfd96d-79fa-4c6a-9647-2b4b1a4543d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:59.934514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-95cfd96d-79fa-4c6a-9647-2b4b1a4543d5 None None] MFA Rules not processed for user `495585254d5049359ba2c06f0a56bd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:59.935771 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-95cfd96d-79fa-4c6a-9647-2b4b1a4543d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:00.003616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1092/2202] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:00.015153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2c6f0-0e8f-4b7b-a20e-f086c9a2c133 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:00.016975 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-f8b2c6f0-0e8f-4b7b-a20e-f086c9a2c133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:00.097515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2c6f0-0e8f-4b7b-a20e-f086c9a2c133 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:00.101165 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266efc86-aed0-44f3-a9bb-3486ecf9560b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a22cd803304a19a58bfbe17addb11f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:00.101846 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266efc86-aed0-44f3-a9bb-3486ecf9560b service glance] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:00.102133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266efc86-aed0-44f3-a9bb-3486ecf9560b service glance] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:00.102409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266efc86-aed0-44f3-a9bb-3486ecf9560b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:00.110766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266efc86-aed0-44f3-a9bb-3486ecf9560b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:00.112200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266efc86-aed0-44f3-a9bb-3486ecf9560b service glance] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:00.121310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1111/2203] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:02:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:02:00.453415 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfd96d-79fa-4c6a-9647-2b4b1a4543d5 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:00.456971 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-95cfd96d-79fa-4c6a-9647-2b4b1a4543d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:00.476222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bda29-6402-4963-a3d4-3320e13a6303 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:00.476515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bda29-6402-4963-a3d4-3320e13a6303 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:00.476795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bda29-6402-4963-a3d4-3320e13a6303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:00.496993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-906bda29-6402-4963-a3d4-3320e13a6303 None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:00.499247 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-906bda29-6402-4963-a3d4-3320e13a6303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:00.552153 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfd96d-79fa-4c6a-9647-2b4b1a4543d5 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:00.557050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:00.557982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:00.558435 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:00.558868 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] PATH_INFO: `/v3/users/13a2f010923d40e2a0df9fcfbdb9d98b` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:00.560356 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a2f010923d40e2a0df9fcfbdb9d98b)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:00.562353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:00.599382 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1112/2204] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 21:02:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:02:00.612305 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bda29-6402-4963-a3d4-3320e13a6303 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:00.615744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:00.714226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bda29-6402-4963-a3d4-3320e13a6303 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:00.720130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b0f37-5de7-4b98-bc04-2e6e845c2c62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:00.720878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b0f37-5de7-4b98-bc04-2e6e845c2c62 service swift] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:00.721217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b0f37-5de7-4b98-bc04-2e6e845c2c62 service swift] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:00.721664 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b0f37-5de7-4b98-bc04-2e6e845c2c62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:00.737182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b0f37-5de7-4b98-bc04-2e6e845c2c62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:00.739309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b0f37-5de7-4b98-bc04-2e6e845c2c62 service swift] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:00.750000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1113/2205] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:02:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 31 21:02:00.777947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a2f010923d40e2a0df9fcfbdb9d98b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:00.880417 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a2f010923d40e2a0df9fcfbdb9d98b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:00.881216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a2f010923d40e2a0df9fcfbdb9d98b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:00.904788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a2f010923d40e2a0df9fcfbdb9d98b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:00.906666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a2f010923d40e2a0df9fcfbdb9d98b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:00.953276 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1093/2206] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:02:00 2022] DELETE /identity/v3/users/13a2f010923d40e2a0df9fcfbdb9d98b => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:02:00.957448 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5dbd7-289e-4ee5-8f1f-9c75bfcfbfbc None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:00.958374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5dbd7-289e-4ee5-8f1f-9c75bfcfbfbc None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:00.959231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5dbd7-289e-4ee5-8f1f-9c75bfcfbfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:01.022749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-41d5dbd7-289e-4ee5-8f1f-9c75bfcfbfbc None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:01.024079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-41d5dbd7-289e-4ee5-8f1f-9c75bfcfbfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:01.127983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1114/2207] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:02:01.139767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:01.142570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:01.233164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005a924-c76d-434d-8843-c812dd410fa2 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:01.236988 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd877f-33fa-4e67-b114-53492787421f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:01.237704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd877f-33fa-4e67-b114-53492787421f service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:01.238032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd877f-33fa-4e67-b114-53492787421f service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:01.238271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd877f-33fa-4e67-b114-53492787421f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:01.249294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd877f-33fa-4e67-b114-53492787421f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:01.250790 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd877f-33fa-4e67-b114-53492787421f service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:01.261942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1094/2208] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:02:01.422589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:01.434326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d30d5-06b4-4fc1-a2d6-a6f88c8723a9 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:01.434719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d30d5-06b4-4fc1-a2d6-a6f88c8723a9 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:01.435218 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d30d5-06b4-4fc1-a2d6-a6f88c8723a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:01.454827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-cf1d30d5-06b4-4fc1-a2d6-a6f88c8723a9 None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:01.455618 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-cf1d30d5-06b4-4fc1-a2d6-a6f88c8723a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:01.543123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1115/2209] 10.222.0.39 () {58 vars in 967 bytes} [Tue May 31 21:02:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:01.557709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd877f-33fa-4e67-b114-53492787421f service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:01.559777 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-edcd877f-33fa-4e67-b114-53492787421f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:01.645136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd877f-33fa-4e67-b114-53492787421f service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:01.662960 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95974f4-386b-4b22-8cea-0444a3b522ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:01.663646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95974f4-386b-4b22-8cea-0444a3b522ec service swift] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:01.663937 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95974f4-386b-4b22-8cea-0444a3b522ec service swift] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:01.664211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95974f4-386b-4b22-8cea-0444a3b522ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:01.676622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95974f4-386b-4b22-8cea-0444a3b522ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:01.678330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95974f4-386b-4b22-8cea-0444a3b522ec service swift] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:01.688039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1095/2210] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:02:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:02:01.741231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d30d5-06b4-4fc1-a2d6-a6f88c8723a9 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:01.742722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-cf1d30d5-06b4-4fc1-a2d6-a6f88c8723a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:01.759859 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d30d5-06b4-4fc1-a2d6-a6f88c8723a9 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:01.769168 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:01.769168 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:01.769168 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:01.769168 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] PATH_INFO: `/v3/projects/abe1e4d85d79446fb4841925d0c62467` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:01.769821 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe1e4d85d79446fb4841925d0c62467)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:01.770903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:01.880065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe1e4d85d79446fb4841925d0c62467', 'request_id': 'req-33a37fae-7322-43de-b21b-e299be5b1170'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:02.033731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe1e4d85d79446fb4841925d0c62467', 'request_id': 'req-33a37fae-7322-43de-b21b-e299be5b1170'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:02.040208 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe1e4d85d79446fb4841925d0c62467', 'request_id': 'req-33a37fae-7322-43de-b21b-e299be5b1170'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:02.051603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] The token cache is being invalidate because project abe1e4d85d79446fb4841925d0c62467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:02:02.051892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:02.052543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:02.054196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1116/2211] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:02:01 2022] DELETE /identity/v3/projects/abe1e4d85d79446fb4841925d0c62467 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:02:03.093557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:03.472265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:03.522665 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:04.259888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:04.571879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:04.691831 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2efe5f-0bfa-429a-8719-27b05df6352e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:04.691831 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2efe5f-0bfa-429a-8719-27b05df6352e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:04.691831 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2efe5f-0bfa-429a-8719-27b05df6352e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:04.712086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-4a2efe5f-0bfa-429a-8719-27b05df6352e None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:04.713718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4a2efe5f-0bfa-429a-8719-27b05df6352e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:04.739476 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:04.741312 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:04.847326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1096/2212] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:04.872438 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a37fae-7322-43de-b21b-e299be5b1170 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:04.874749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2efe5f-0bfa-429a-8719-27b05df6352e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:04.876397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4a2efe5f-0bfa-429a-8719-27b05df6352e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:04.889471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:04.890381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:04.890672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:04.890953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] PATH_INFO: `/v3/users/07fc373b8ca84a0ab10cb95edd750227` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:04.892732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07fc373b8ca84a0ab10cb95edd750227)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:04.895392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:05.023795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2efe5f-0bfa-429a-8719-27b05df6352e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:05.033279 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c52c1e-f34c-44c6-aaf7-0cec1cc4f60a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:05.035455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c52c1e-f34c-44c6-aaf7-0cec1cc4f60a service swift] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:05.040169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c52c1e-f34c-44c6-aaf7-0cec1cc4f60a service swift] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:05.040836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c52c1e-f34c-44c6-aaf7-0cec1cc4f60a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:05.067086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c52c1e-f34c-44c6-aaf7-0cec1cc4f60a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:05.069804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c52c1e-f34c-44c6-aaf7-0cec1cc4f60a service swift] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:05.083392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1097/2213] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:02:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:02:05.205027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07fc373b8ca84a0ab10cb95edd750227'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:05.276835 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07fc373b8ca84a0ab10cb95edd750227'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:05.292839 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07fc373b8ca84a0ab10cb95edd750227'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:05.294575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07fc373b8ca84a0ab10cb95edd750227'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:05.298346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07fc373b8ca84a0ab10cb95edd750227'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:05.314510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:05.344229 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1117/2214] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:02:04 2022] DELETE /identity/v3/users/07fc373b8ca84a0ab10cb95edd750227 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:02:05.349173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3eae6-570c-4f13-834a-deac47d9888b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:05.349741 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3eae6-570c-4f13-834a-deac47d9888b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:05.349741 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3eae6-570c-4f13-834a-deac47d9888b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:05.407136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7fc3eae6-570c-4f13-834a-deac47d9888b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:05.408397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7fc3eae6-570c-4f13-834a-deac47d9888b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:05.587645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1098/2215] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:02:05.592494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:05.594196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:05.679115 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428eed41-ef7a-48dc-8eb1-c73fbe1f9e57 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:05.693468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcd964-2c1a-4f2a-844f-13ecd25f005a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:05.695687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcd964-2c1a-4f2a-844f-13ecd25f005a service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:05.697018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcd964-2c1a-4f2a-844f-13ecd25f005a service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:05.698123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcd964-2c1a-4f2a-844f-13ecd25f005a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:05.720895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcd964-2c1a-4f2a-844f-13ecd25f005a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:05.723361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcd964-2c1a-4f2a-844f-13ecd25f005a service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:05.741129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1118/2216] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:02:05.886530 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:06.139320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3eae6-570c-4f13-834a-deac47d9888b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:06.142278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7fc3eae6-570c-4f13-834a-deac47d9888b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:06.177609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3eae6-570c-4f13-834a-deac47d9888b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:06.186843 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7971f6-84bc-491e-98eb-85f5e12981d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:06.188605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7971f6-84bc-491e-98eb-85f5e12981d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:06.188896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7971f6-84bc-491e-98eb-85f5e12981d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:06.189454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7971f6-84bc-491e-98eb-85f5e12981d0 admin admin] PATH_INFO: `/v3/projects/b85bc105b95e4a67a15532aa023c0fa5` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:06.191468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7971f6-84bc-491e-98eb-85f5e12981d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85bc105b95e4a67a15532aa023c0fa5)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:06.194014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7971f6-84bc-491e-98eb-85f5e12981d0 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:06.356192 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0b7971f6-84bc-491e-98eb-85f5e12981d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85bc105b95e4a67a15532aa023c0fa5', 'request_id': 'req-0b7971f6-84bc-491e-98eb-85f5e12981d0'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:06.453539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0b7971f6-84bc-491e-98eb-85f5e12981d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85bc105b95e4a67a15532aa023c0fa5', 'request_id': 'req-0b7971f6-84bc-491e-98eb-85f5e12981d0'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:06.462239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0b7971f6-84bc-491e-98eb-85f5e12981d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85bc105b95e4a67a15532aa023c0fa5', 'request_id': 'req-0b7971f6-84bc-491e-98eb-85f5e12981d0'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:06.475403 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0b7971f6-84bc-491e-98eb-85f5e12981d0 admin admin] The token cache is being invalidate because project b85bc105b95e4a67a15532aa023c0fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:02:06.475704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0b7971f6-84bc-491e-98eb-85f5e12981d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:06.476479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-0b7971f6-84bc-491e-98eb-85f5e12981d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:06.481667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1099/2217] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:02:06 2022] DELETE /identity/v3/projects/b85bc105b95e4a67a15532aa023c0fa5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:02:15.741787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bf74d-4d2b-4738-9b18-707cbfbf5894 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:15.742531 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bf74d-4d2b-4738-9b18-707cbfbf5894 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:15.742531 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bf74d-4d2b-4738-9b18-707cbfbf5894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:15.772248 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-041bf74d-4d2b-4738-9b18-707cbfbf5894 None None] MFA Rules not processed for user `0567620b615f4a8ab2bc5c69ba85cc93`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:15.774232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-041bf74d-4d2b-4738-9b18-707cbfbf5894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:15.883719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1119/2218] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:02:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:16.486761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:24.622432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe0b3c-ba53-41d6-ad2f-92682af5bc68 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:24.623138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe0b3c-ba53-41d6-ad2f-92682af5bc68 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:24.623138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe0b3c-ba53-41d6-ad2f-92682af5bc68 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:24.624558 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1100/2219] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 21:02:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:02:24.633249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0384451-c9ad-4990-bf31-784ef8a4b304 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:24.633860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0384451-c9ad-4990-bf31-784ef8a4b304 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:24.633860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0384451-c9ad-4990-bf31-784ef8a4b304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:24.694448 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-f0384451-c9ad-4990-bf31-784ef8a4b304 None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:24.695671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-f0384451-c9ad-4990-bf31-784ef8a4b304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:24.772015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:24.784579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1120/2220] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 21:02:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:24.800070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe0b3c-ba53-41d6-ad2f-92682af5bc68 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:24.803295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c6fe0b3c-ba53-41d6-ad2f-92682af5bc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:24.890691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe0b3c-ba53-41d6-ad2f-92682af5bc68 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:24.895306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4ddb4-ef5f-4354-ac92-0186d9f84300 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a22cd803304a19a58bfbe17addb11f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:24.896526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4ddb4-ef5f-4354-ac92-0186d9f84300 service glance] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:24.897049 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4ddb4-ef5f-4354-ac92-0186d9f84300 service glance] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:24.897599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4ddb4-ef5f-4354-ac92-0186d9f84300 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:24.912533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4ddb4-ef5f-4354-ac92-0186d9f84300 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:24.915024 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4ddb4-ef5f-4354-ac92-0186d9f84300 service glance] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:24.958230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1101/2221] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:02:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:02:25.223803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07576a70-6918-4ea4-9710-2619aa07827e None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:25.224948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07576a70-6918-4ea4-9710-2619aa07827e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:25.225688 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07576a70-6918-4ea4-9710-2619aa07827e None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:25.228692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1121/2222] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 21:02:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:02:25.245664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0944-1d02-43a0-9ecc-bc12cc4dfbb7 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:25.251115 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0944-1d02-43a0-9ecc-bc12cc4dfbb7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:25.251115 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0944-1d02-43a0-9ecc-bc12cc4dfbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:25.272072 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-6a2c0944-1d02-43a0-9ecc-bc12cc4dfbb7 None None] MFA Rules not processed for user `16a77c08d2844e7cb81ac1370c527cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:25.273338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6a2c0944-1d02-43a0-9ecc-bc12cc4dfbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:25.504891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1102/2223] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:25.505875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07576a70-6918-4ea4-9710-2619aa07827e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:25.505875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-07576a70-6918-4ea4-9710-2619aa07827e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:25.505875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07576a70-6918-4ea4-9710-2619aa07827e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:25.506308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236ab09-ced6-4d42-8a5e-2d44c4c5e19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:25.506308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236ab09-ced6-4d42-8a5e-2d44c4c5e19f service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:25.506308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236ab09-ced6-4d42-8a5e-2d44c4c5e19f service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:25.506308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236ab09-ced6-4d42-8a5e-2d44c4c5e19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:25.506650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236ab09-ced6-4d42-8a5e-2d44c4c5e19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:25.506650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236ab09-ced6-4d42-8a5e-2d44c4c5e19f service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:25.506650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1122/2224] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:02:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:02:25.522609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bffe35-ca03-47ed-aca8-f862f8d30c42 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:25.522897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bffe35-ca03-47ed-aca8-f862f8d30c42 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:25.523298 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bffe35-ca03-47ed-aca8-f862f8d30c42 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:25.524586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1103/2225] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 21:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:02:25.531197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92027a-1fb7-4bf5-a4b7-6f2c86254eae None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:25.540314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92027a-1fb7-4bf5-a4b7-6f2c86254eae None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:25.540314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92027a-1fb7-4bf5-a4b7-6f2c86254eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:25.555622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6a92027a-1fb7-4bf5-a4b7-6f2c86254eae None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:25.557185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6a92027a-1fb7-4bf5-a4b7-6f2c86254eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:25.567626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1123/2226] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:25.579332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bffe35-ca03-47ed-aca8-f862f8d30c42 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:25.593367 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bffe35-ca03-47ed-aca8-f862f8d30c42 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:25.597099 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75620847-c28a-4fb8-b887-feeacfe61db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:25.597818 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620847-c28a-4fb8-b887-feeacfe61db4 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:25.598107 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620847-c28a-4fb8-b887-feeacfe61db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:25.598389 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620847-c28a-4fb8-b887-feeacfe61db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:25.609517 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75620847-c28a-4fb8-b887-feeacfe61db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:25.610984 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75620847-c28a-4fb8-b887-feeacfe61db4 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:25.623976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1104/2227] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:02:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:02:27.582471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92027a-1fb7-4bf5-a4b7-6f2c86254eae None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:27.589830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6a92027a-1fb7-4bf5-a4b7-6f2c86254eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:27.655224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92027a-1fb7-4bf5-a4b7-6f2c86254eae None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:27.659734 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:27.660607 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:27.660883 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:27.661156 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] PATH_INFO: `/v3/users/495585254d5049359ba2c06f0a56bd0d` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:27.662470 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=495585254d5049359ba2c06f0a56bd0d)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:27.670017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:27.896425 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495585254d5049359ba2c06f0a56bd0d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:28.086563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495585254d5049359ba2c06f0a56bd0d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:28.095094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495585254d5049359ba2c06f0a56bd0d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:28.095787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495585254d5049359ba2c06f0a56bd0d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:28.096417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495585254d5049359ba2c06f0a56bd0d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:28.114885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1124/2228] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:02:27 2022] DELETE /identity/v3/users/495585254d5049359ba2c06f0a56bd0d => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:02:28.119636 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8813739-550a-4e03-8df3-838d95c3aa1d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:28.120399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8813739-550a-4e03-8df3-838d95c3aa1d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:28.120495 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8813739-550a-4e03-8df3-838d95c3aa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:28.140575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d8813739-550a-4e03-8df3-838d95c3aa1d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:28.141839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d8813739-550a-4e03-8df3-838d95c3aa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:28.207863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1105/2229] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:28.217595 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:28.219004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:28.294919 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cce365-138e-4cf7-82a6-148257df3ad1 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:28.300502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507a60e-da30-4764-a2d0-7c369c17ece5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:28.301173 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507a60e-da30-4764-a2d0-7c369c17ece5 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:28.301514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507a60e-da30-4764-a2d0-7c369c17ece5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:28.301798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507a60e-da30-4764-a2d0-7c369c17ece5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:28.312574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507a60e-da30-4764-a2d0-7c369c17ece5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:28.314088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507a60e-da30-4764-a2d0-7c369c17ece5 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:28.320443 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:28.328259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1125/2230] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:02:28.829594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8813739-550a-4e03-8df3-838d95c3aa1d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:28.832381 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d8813739-550a-4e03-8df3-838d95c3aa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:28.856039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8813739-550a-4e03-8df3-838d95c3aa1d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:28.873832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61301208-1b6f-4205-ab7f-c594525065de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:28.873832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61301208-1b6f-4205-ab7f-c594525065de admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:28.873832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61301208-1b6f-4205-ab7f-c594525065de admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:28.873832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61301208-1b6f-4205-ab7f-c594525065de admin admin] PATH_INFO: `/v3/projects/bbef91d51368407281682cc29323b797` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:28.875193 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61301208-1b6f-4205-ab7f-c594525065de admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbef91d51368407281682cc29323b797)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:28.875193 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61301208-1b6f-4205-ab7f-c594525065de admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:28.995553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:29.011514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-61301208-1b6f-4205-ab7f-c594525065de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbef91d51368407281682cc29323b797', 'request_id': 'req-61301208-1b6f-4205-ab7f-c594525065de'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:29.113600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-61301208-1b6f-4205-ab7f-c594525065de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbef91d51368407281682cc29323b797', 'request_id': 'req-61301208-1b6f-4205-ab7f-c594525065de'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:29.120632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-61301208-1b6f-4205-ab7f-c594525065de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbef91d51368407281682cc29323b797', 'request_id': 'req-61301208-1b6f-4205-ab7f-c594525065de'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:29.137339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-61301208-1b6f-4205-ab7f-c594525065de admin admin] The token cache is being invalidate because project bbef91d51368407281682cc29323b797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:02:29.137882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-61301208-1b6f-4205-ab7f-c594525065de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:29.138936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-61301208-1b6f-4205-ab7f-c594525065de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:29.141652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1106/2231] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:02:28 2022] DELETE /identity/v3/projects/bbef91d51368407281682cc29323b797 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:02:29.148283 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7ac8f-a3be-4250-9f20-3d4bd395a4b2 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:29.152631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7ac8f-a3be-4250-9f20-3d4bd395a4b2 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:29.152631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7ac8f-a3be-4250-9f20-3d4bd395a4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:29.168798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-1ec7ac8f-a3be-4250-9f20-3d4bd395a4b2 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:29.170083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1ec7ac8f-a3be-4250-9f20-3d4bd395a4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:29.233647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1126/2232] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:29.243118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c48b7-8e7a-4840-a4f8-68347992a531 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:29.243404 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c48b7-8e7a-4840-a4f8-68347992a531 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:29.243681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c48b7-8e7a-4840-a4f8-68347992a531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:29.263086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-719c48b7-8e7a-4840-a4f8-68347992a531 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:29.267268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-719c48b7-8e7a-4840-a4f8-68347992a531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:29.273045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1107/2233] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:29.277294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7ac8f-a3be-4250-9f20-3d4bd395a4b2 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:29.287137 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7ac8f-a3be-4250-9f20-3d4bd395a4b2 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:29.291830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7d380-a476-4c45-af4f-63bb3f7d87a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:29.292473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7d380-a476-4c45-af4f-63bb3f7d87a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:29.292766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7d380-a476-4c45-af4f-63bb3f7d87a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:29.293036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7d380-a476-4c45-af4f-63bb3f7d87a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:29.293802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7d380-a476-4c45-af4f-63bb3f7d87a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:02:29.294135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7d380-a476-4c45-af4f-63bb3f7d87a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:29.295726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7d380-a476-4c45-af4f-63bb3f7d87a2 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:29.309533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1127/2234] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:02:29.316120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c48b7-8e7a-4840-a4f8-68347992a531 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:29.325709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c48b7-8e7a-4840-a4f8-68347992a531 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:29.333061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f01f45-0a97-4a84-a914-6fdca6a5e279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:29.333061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f01f45-0a97-4a84-a914-6fdca6a5e279 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:29.333061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f01f45-0a97-4a84-a914-6fdca6a5e279 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:29.333061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f01f45-0a97-4a84-a914-6fdca6a5e279 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:29.333495 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f01f45-0a97-4a84-a914-6fdca6a5e279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:29.334889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f01f45-0a97-4a84-a914-6fdca6a5e279 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:29.434596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1108/2235] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:02:29 2022] POST /identity/v3/projects => generated 399 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:02:29.438699 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7d380-a476-4c45-af4f-63bb3f7d87a2 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:29.449631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7d380-a476-4c45-af4f-63bb3f7d87a2 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:29.511003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cee3d0-6759-4e86-ae83-7cb46a8dacfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:29.511683 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cee3d0-6759-4e86-ae83-7cb46a8dacfd admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:29.511969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cee3d0-6759-4e86-ae83-7cb46a8dacfd admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:29.512284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cee3d0-6759-4e86-ae83-7cb46a8dacfd admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:29.513753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cee3d0-6759-4e86-ae83-7cb46a8dacfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:29.515158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cee3d0-6759-4e86-ae83-7cb46a8dacfd admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:29.622707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1128/2236] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:02:29 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:02:29.628353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f01f45-0a97-4a84-a914-6fdca6a5e279 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:29.639706 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f01f45-0a97-4a84-a914-6fdca6a5e279 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:29.645101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51302-4c2b-4b8d-837e-cc4cf005c7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:29.645814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51302-4c2b-4b8d-837e-cc4cf005c7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:29.646106 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51302-4c2b-4b8d-837e-cc4cf005c7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:29.646376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51302-4c2b-4b8d-837e-cc4cf005c7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:29.647283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f51302-4c2b-4b8d-837e-cc4cf005c7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:29.648756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f51302-4c2b-4b8d-837e-cc4cf005c7b4 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:29.661551 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1109/2237] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:02:29.665874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cee3d0-6759-4e86-ae83-7cb46a8dacfd admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:29.677006 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cee3d0-6759-4e86-ae83-7cb46a8dacfd admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:29.695386 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b6944-c94f-4c2c-b829-69afaf19624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:29.695853 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b6944-c94f-4c2c-b829-69afaf19624d admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:29.696353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b6944-c94f-4c2c-b829-69afaf19624d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:29.696840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b6944-c94f-4c2c-b829-69afaf19624d admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:29.697841 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b6944-c94f-4c2c-b829-69afaf19624d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:29.699758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b6944-c94f-4c2c-b829-69afaf19624d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:29.741067 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1129/2238] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:02:29.747801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51302-4c2b-4b8d-837e-cc4cf005c7b4 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:29.779459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51302-4c2b-4b8d-837e-cc4cf005c7b4 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:29.791137 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102173c6-191c-4ae1-9c3e-2bb9560281ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:29.792757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102173c6-191c-4ae1-9c3e-2bb9560281ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:29.792757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102173c6-191c-4ae1-9c3e-2bb9560281ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:29.792757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102173c6-191c-4ae1-9c3e-2bb9560281ce admin admin] PATH_INFO: `/v3/projects/60cbb31ac610415bb0027163682a2b8d/users/2e74b5ac744741058ac1ec2f4c6cb31f/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:29.811204 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102173c6-191c-4ae1-9c3e-2bb9560281ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cbb31ac610415bb0027163682a2b8d, user_id=2e74b5ac744741058ac1ec2f4c6cb31f, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:29.813670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102173c6-191c-4ae1-9c3e-2bb9560281ce admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:29.917922 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1110/2239] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:02:29 2022] PUT /identity/v3/projects/60cbb31ac610415bb0027163682a2b8d/users/2e74b5ac744741058ac1ec2f4c6cb31f/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:02:29.990380 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171237-6a28-4334-a8d9-455bb7d326d7 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:29.990674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171237-6a28-4334-a8d9-455bb7d326d7 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:29.990957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171237-6a28-4334-a8d9-455bb7d326d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:30.019915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-ea171237-6a28-4334-a8d9-455bb7d326d7 None None] MFA Rules not processed for user `2e74b5ac744741058ac1ec2f4c6cb31f`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:30.021163 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ea171237-6a28-4334-a8d9-455bb7d326d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:30.083458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:30.094373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1130/2240] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:02:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:30.107460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102173c6-191c-4ae1-9c3e-2bb9560281ce admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:30.109635 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-102173c6-191c-4ae1-9c3e-2bb9560281ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:30.175422 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102173c6-191c-4ae1-9c3e-2bb9560281ce admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:30.178458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c6509-c79e-424a-bc5b-eecf31f7ec5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:30.179569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c6509-c79e-424a-bc5b-eecf31f7ec5a service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:30.179569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c6509-c79e-424a-bc5b-eecf31f7ec5a service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:30.179896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c6509-c79e-424a-bc5b-eecf31f7ec5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:30.189098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c6509-c79e-424a-bc5b-eecf31f7ec5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:30.190633 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c6509-c79e-424a-bc5b-eecf31f7ec5a service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:30.200437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1111/2241] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:02:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:02:30.653094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa0137-0410-45fa-8ae4-df6de139a97b None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:30.653556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa0137-0410-45fa-8ae4-df6de139a97b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:30.653723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa0137-0410-45fa-8ae4-df6de139a97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:30.673114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-35aa0137-0410-45fa-8ae4-df6de139a97b None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:30.674978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-35aa0137-0410-45fa-8ae4-df6de139a97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:30.744034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1131/2242] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 21:02:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:30.756938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c6509-c79e-424a-bc5b-eecf31f7ec5a service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:30.758418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-722c6509-c79e-424a-bc5b-eecf31f7ec5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:30.858576 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:30.863930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c6509-c79e-424a-bc5b-eecf31f7ec5a service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:30.869695 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d075ae0-f36f-46d3-b72a-48380efcc21c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:30.877954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d075ae0-f36f-46d3-b72a-48380efcc21c service swift] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:30.877954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d075ae0-f36f-46d3-b72a-48380efcc21c service swift] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:30.877954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d075ae0-f36f-46d3-b72a-48380efcc21c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:30.881402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d075ae0-f36f-46d3-b72a-48380efcc21c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:30.883043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d075ae0-f36f-46d3-b72a-48380efcc21c service swift] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:30.893556 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1112/2243] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:02:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:02:36.863029 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa0137-0410-45fa-8ae4-df6de139a97b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:36.929711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa0137-0410-45fa-8ae4-df6de139a97b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:36.934938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:36.935826 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:36.936279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:36.936562 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] PATH_INFO: `/v3/users/2e74b5ac744741058ac1ec2f4c6cb31f` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:36.937836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e74b5ac744741058ac1ec2f4c6cb31f)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:36.940412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:37.128244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e74b5ac744741058ac1ec2f4c6cb31f'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:37.200807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e74b5ac744741058ac1ec2f4c6cb31f'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:37.212763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e74b5ac744741058ac1ec2f4c6cb31f'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:37.213527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e74b5ac744741058ac1ec2f4c6cb31f'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:37.214135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e74b5ac744741058ac1ec2f4c6cb31f'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:37.232908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1132/2244] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:02:36 2022] DELETE /identity/v3/users/2e74b5ac744741058ac1ec2f4c6cb31f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:02:37.239218 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2209a4e-9b92-4d23-aa1d-8da08fc03274 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:37.240623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2209a4e-9b92-4d23-aa1d-8da08fc03274 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:37.241187 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2209a4e-9b92-4d23-aa1d-8da08fc03274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:37.260513 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d2209a4e-9b92-4d23-aa1d-8da08fc03274 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:37.261777 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d2209a4e-9b92-4d23-aa1d-8da08fc03274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:37.325839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1113/2245] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:37.336345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:37.338265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:37.360088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:37.415933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca3109-d6a2-4abf-bc8c-f9ae17ed6f81 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:37.419663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17921bb3-88f8-4263-b728-c5cad7dfa34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:37.420358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17921bb3-88f8-4263-b728-c5cad7dfa34b service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:37.420642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17921bb3-88f8-4263-b728-c5cad7dfa34b service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:37.420922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17921bb3-88f8-4263-b728-c5cad7dfa34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:37.431915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17921bb3-88f8-4263-b728-c5cad7dfa34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:37.434675 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17921bb3-88f8-4263-b728-c5cad7dfa34b service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:37.450838 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1133/2246] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:02:37.898711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2209a4e-9b92-4d23-aa1d-8da08fc03274 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:37.900214 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d2209a4e-9b92-4d23-aa1d-8da08fc03274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:37.925916 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2209a4e-9b92-4d23-aa1d-8da08fc03274 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:37.933321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433539fe-a170-45c2-9c69-c7f1c11a513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:37.934277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433539fe-a170-45c2-9c69-c7f1c11a513c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:37.937690 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433539fe-a170-45c2-9c69-c7f1c11a513c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:37.947566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433539fe-a170-45c2-9c69-c7f1c11a513c admin admin] PATH_INFO: `/v3/projects/60cbb31ac610415bb0027163682a2b8d` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:37.947566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433539fe-a170-45c2-9c69-c7f1c11a513c admin admin] RBAC: Authorizing `identity:delete_project(project_id=60cbb31ac610415bb0027163682a2b8d)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:37.947566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433539fe-a170-45c2-9c69-c7f1c11a513c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:38.084569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-433539fe-a170-45c2-9c69-c7f1c11a513c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60cbb31ac610415bb0027163682a2b8d', 'request_id': 'req-433539fe-a170-45c2-9c69-c7f1c11a513c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:38.154960 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-433539fe-a170-45c2-9c69-c7f1c11a513c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60cbb31ac610415bb0027163682a2b8d', 'request_id': 'req-433539fe-a170-45c2-9c69-c7f1c11a513c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:38.162444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-433539fe-a170-45c2-9c69-c7f1c11a513c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60cbb31ac610415bb0027163682a2b8d', 'request_id': 'req-433539fe-a170-45c2-9c69-c7f1c11a513c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:38.175378 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-433539fe-a170-45c2-9c69-c7f1c11a513c admin admin] The token cache is being invalidate because project 60cbb31ac610415bb0027163682a2b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:02:38.175599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-433539fe-a170-45c2-9c69-c7f1c11a513c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:38.176244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-433539fe-a170-45c2-9c69-c7f1c11a513c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:02:38.178072 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1114/2247] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:02:37 2022] DELETE /identity/v3/projects/60cbb31ac610415bb0027163682a2b8d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:02:47.472905 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=18 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:48.171986 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:49.240907 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17921bb3-88f8-4263-b728-c5cad7dfa34b service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:49.244230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-17921bb3-88f8-4263-b728-c5cad7dfa34b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:49.373847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17921bb3-88f8-4263-b728-c5cad7dfa34b service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:49.435266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd75ce-001f-4020-943f-2e4564b67c3a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:49.435759 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd75ce-001f-4020-943f-2e4564b67c3a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:49.436416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd75ce-001f-4020-943f-2e4564b67c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:49.445413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba32fa-49e5-4f04-a29c-77fea353dd38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619d0b5afa094289808516486a5e3c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:49.447004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba32fa-49e5-4f04-a29c-77fea353dd38 service placement] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:49.447004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba32fa-49e5-4f04-a29c-77fea353dd38 service placement] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:49.447004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba32fa-49e5-4f04-a29c-77fea353dd38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:49.448285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6cba32fa-49e5-4f04-a29c-77fea353dd38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:49.460164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2ccd75ce-001f-4020-943f-2e4564b67c3a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:49.461706 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba32fa-49e5-4f04-a29c-77fea353dd38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:49.462361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2ccd75ce-001f-4020-943f-2e4564b67c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:49.463448 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba32fa-49e5-4f04-a29c-77fea353dd38 service placement] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:49.475779 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1134/2248] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:02:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:02:49.535477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1115/2249] 10.222.0.32 () {58 vars in 1016 bytes} [Tue May 31 21:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:02:49.552957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba32fa-49e5-4f04-a29c-77fea353dd38 service placement] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:49.554441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6cba32fa-49e5-4f04-a29c-77fea353dd38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:49.631115 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba32fa-49e5-4f04-a29c-77fea353dd38 service placement] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:49.636567 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38603b8-81fc-4837-9fb0-73a0bcb8d81f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:49.637215 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38603b8-81fc-4837-9fb0-73a0bcb8d81f service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:49.637528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38603b8-81fc-4837-9fb0-73a0bcb8d81f service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:49.637808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38603b8-81fc-4837-9fb0-73a0bcb8d81f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:49.646978 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38603b8-81fc-4837-9fb0-73a0bcb8d81f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:49.648576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38603b8-81fc-4837-9fb0-73a0bcb8d81f service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:49.652631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:02:49.659506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1135/2250] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:02:53.539703 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e295f-961a-4746-be57-0ba84d755dbc None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:53.540192 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e295f-961a-4746-be57-0ba84d755dbc None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:53.540383 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e295f-961a-4746-be57-0ba84d755dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:53.559583 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-1d6e295f-961a-4746-be57-0ba84d755dbc None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:53.560795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1d6e295f-961a-4746-be57-0ba84d755dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:53.621091 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1116/2251] 10.222.0.39 () {58 vars in 967 bytes} [Tue May 31 21:02:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:53.633995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38603b8-81fc-4837-9fb0-73a0bcb8d81f service nova] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:53.635571 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-f38603b8-81fc-4837-9fb0-73a0bcb8d81f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:53.715948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38603b8-81fc-4837-9fb0-73a0bcb8d81f service nova] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:53.722432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504f94e-76c8-4706-8394-0269c20a1ea5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:53.723074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504f94e-76c8-4706-8394-0269c20a1ea5 service swift] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:53.723355 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504f94e-76c8-4706-8394-0269c20a1ea5 service swift] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:53.723630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504f94e-76c8-4706-8394-0269c20a1ea5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:53.731918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504f94e-76c8-4706-8394-0269c20a1ea5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:53.733520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504f94e-76c8-4706-8394-0269c20a1ea5 service swift] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:53.742292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1136/2252] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:02:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:02:54.762469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9281d8-01f4-446a-8d82-f758689e81b7 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:54.763022 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9281d8-01f4-446a-8d82-f758689e81b7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:54.763242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9281d8-01f4-446a-8d82-f758689e81b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:54.784128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-4e9281d8-01f4-446a-8d82-f758689e81b7 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:54.786103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4e9281d8-01f4-446a-8d82-f758689e81b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:54.794584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1117/2253] 10.222.0.32 () {58 vars in 1016 bytes} [Tue May 31 21:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:54.817602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504f94e-76c8-4706-8394-0269c20a1ea5 service swift] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:54.833244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504f94e-76c8-4706-8394-0269c20a1ea5 service swift] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:54.839015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658417b-9e52-4b26-9d78-efe68cc216c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:54.839669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658417b-9e52-4b26-9d78-efe68cc216c6 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:54.839950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658417b-9e52-4b26-9d78-efe68cc216c6 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:54.840228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658417b-9e52-4b26-9d78-efe68cc216c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:54.849264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658417b-9e52-4b26-9d78-efe68cc216c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:54.850878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658417b-9e52-4b26-9d78-efe68cc216c6 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:54.861559 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1137/2254] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:02:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:02:59.209525 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb2e8a-497e-4b8b-903d-4e6d095d19d0 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:59.210074 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb2e8a-497e-4b8b-903d-4e6d095d19d0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:59.210074 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb2e8a-497e-4b8b-903d-4e6d095d19d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:59.228373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-3eeb2e8a-497e-4b8b-903d-4e6d095d19d0 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:02:59.229611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-3eeb2e8a-497e-4b8b-903d-4e6d095d19d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:02:59.237502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1118/2255] 10.222.0.32 () {58 vars in 1016 bytes} [Tue May 31 21:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:02:59.255236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658417b-9e52-4b26-9d78-efe68cc216c6 service nova] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:02:59.267636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658417b-9e52-4b26-9d78-efe68cc216c6 service nova] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:02:59.273032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25591d-98d1-46b2-93aa-d9de2add7de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:02:59.273701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25591d-98d1-46b2-93aa-d9de2add7de4 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:02:59.273980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25591d-98d1-46b2-93aa-d9de2add7de4 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:02:59.274255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25591d-98d1-46b2-93aa-d9de2add7de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:02:59.282438 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25591d-98d1-46b2-93aa-d9de2add7de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:02:59.284009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25591d-98d1-46b2-93aa-d9de2add7de4 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:02:59.293318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1138/2256] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:02.086354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd749238-4430-4c3b-8c83-945231853c9a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:02.086830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd749238-4430-4c3b-8c83-945231853c9a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:02.087011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd749238-4430-4c3b-8c83-945231853c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:02.106142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-dd749238-4430-4c3b-8c83-945231853c9a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:02.108253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-dd749238-4430-4c3b-8c83-945231853c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:02.116349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1119/2257] 10.222.0.32 () {58 vars in 1016 bytes} [Tue May 31 21:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:02.131466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25591d-98d1-46b2-93aa-d9de2add7de4 service nova] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:02.132980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-db25591d-98d1-46b2-93aa-d9de2add7de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:02.147700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25591d-98d1-46b2-93aa-d9de2add7de4 service nova] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:02.153346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60a544-7c04-49a8-9b4d-067159938559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:02.154041 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60a544-7c04-49a8-9b4d-067159938559 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:02.154305 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60a544-7c04-49a8-9b4d-067159938559 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:02.154582 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60a544-7c04-49a8-9b4d-067159938559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:02.164108 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60a544-7c04-49a8-9b4d-067159938559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:02.165725 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60a544-7c04-49a8-9b4d-067159938559 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:02.176187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1139/2258] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:03:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:07.391395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dcaec-f953-443b-800f-355c9134da0e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:07.391980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dcaec-f953-443b-800f-355c9134da0e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:07.392082 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dcaec-f953-443b-800f-355c9134da0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:07.411354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-f66dcaec-f953-443b-800f-355c9134da0e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:07.412553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f66dcaec-f953-443b-800f-355c9134da0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:07.420597 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1120/2259] 10.222.0.32 () {58 vars in 1016 bytes} [Tue May 31 21:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:03:07.441412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60a544-7c04-49a8-9b4d-067159938559 service nova] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:07.452870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60a544-7c04-49a8-9b4d-067159938559 service nova] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:07.459008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc128bd-3d3c-46d9-86c5-99757c6fde9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:07.459642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc128bd-3d3c-46d9-86c5-99757c6fde9c service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:07.459924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc128bd-3d3c-46d9-86c5-99757c6fde9c service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:07.460198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc128bd-3d3c-46d9-86c5-99757c6fde9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:07.468890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc128bd-3d3c-46d9-86c5-99757c6fde9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:07.471122 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc128bd-3d3c-46d9-86c5-99757c6fde9c service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:07.481139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1140/2260] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:10.638699 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f21614-89f6-44a0-b340-97d61563122e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:10.639288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f21614-89f6-44a0-b340-97d61563122e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:10.639288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f21614-89f6-44a0-b340-97d61563122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:10.657642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-02f21614-89f6-44a0-b340-97d61563122e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:10.658891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-02f21614-89f6-44a0-b340-97d61563122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:10.667594 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1121/2261] 10.222.0.32 () {58 vars in 1016 bytes} [Tue May 31 21:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:10.681202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc128bd-3d3c-46d9-86c5-99757c6fde9c service nova] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:10.693152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc128bd-3d3c-46d9-86c5-99757c6fde9c service nova] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:10.698702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67b957-edc2-4819-a497-cf258796ce44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:10.699329 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67b957-edc2-4819-a497-cf258796ce44 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:10.699613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67b957-edc2-4819-a497-cf258796ce44 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:10.699886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67b957-edc2-4819-a497-cf258796ce44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:10.709187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67b957-edc2-4819-a497-cf258796ce44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:10.711053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67b957-edc2-4819-a497-cf258796ce44 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:10.721724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1141/2262] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:20.652528 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=67 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:20.717059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=63 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:22.154828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd0443-88e1-4240-b554-5f387727d20f None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:22.155437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd0443-88e1-4240-b554-5f387727d20f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:22.155860 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd0443-88e1-4240-b554-5f387727d20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:22.187245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e4bd0443-88e1-4240-b554-5f387727d20f None None] MFA Rules not processed for user `3c5b1c6778f74c0d8db93e3a29935480`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:22.189192 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e4bd0443-88e1-4240-b554-5f387727d20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:22.266407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1122/2263] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:03:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:30.904814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54879d-bea2-45dd-980f-c069594c4a61 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:30.905572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54879d-bea2-45dd-980f-c069594c4a61 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:30.905572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54879d-bea2-45dd-980f-c069594c4a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:30.925010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4e54879d-bea2-45dd-980f-c069594c4a61 None None] MFA Rules not processed for user `7a9db25a40744940bd07701cc57afeba`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:30.926298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4e54879d-bea2-45dd-980f-c069594c4a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:31.008773 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1142/2264] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:03:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:32.258824 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=25 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:40.996460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=25 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:50.661363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd13447-e2b6-414d-923b-fb8e21149303 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:50.662178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd13447-e2b6-414d-923b-fb8e21149303 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:50.662178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd13447-e2b6-414d-923b-fb8e21149303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:50.682482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7fd13447-e2b6-414d-923b-fb8e21149303 None None] MFA Rules not processed for user `e0d9dcb062ad4376866a98edebede7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:50.684817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7fd13447-e2b6-414d-923b-fb8e21149303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:50.786574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1123/2265] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:03:54.169084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390629f5-d4ee-478e-8836-192c6055521f None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:54.169736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390629f5-d4ee-478e-8836-192c6055521f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:54.169736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390629f5-d4ee-478e-8836-192c6055521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:54.191282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-390629f5-d4ee-478e-8836-192c6055521f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:54.195881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-390629f5-d4ee-478e-8836-192c6055521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:54.200939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1143/2266] 10.222.0.32 () {58 vars in 1016 bytes} [Tue May 31 21:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:54.220687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd13447-e2b6-414d-923b-fb8e21149303 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:54.247123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd13447-e2b6-414d-923b-fb8e21149303 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:54.251800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af6dad-79b7-4982-8ade-e070c3a4de65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:54.252477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af6dad-79b7-4982-8ade-e070c3a4de65 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:54.252763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af6dad-79b7-4982-8ade-e070c3a4de65 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:54.253042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af6dad-79b7-4982-8ade-e070c3a4de65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:54.263980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af6dad-79b7-4982-8ade-e070c3a4de65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:54.268000 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af6dad-79b7-4982-8ade-e070c3a4de65 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:54.288431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1124/2267] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:58.704420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384629e2-fd66-4db5-a66d-98774805bf3d None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:58.704957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384629e2-fd66-4db5-a66d-98774805bf3d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:58.705580 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384629e2-fd66-4db5-a66d-98774805bf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:58.734948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-384629e2-fd66-4db5-a66d-98774805bf3d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:58.737657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-384629e2-fd66-4db5-a66d-98774805bf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:58.753939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1144/2268] 10.222.0.32 () {58 vars in 1016 bytes} [Tue May 31 21:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:58.770523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af6dad-79b7-4982-8ade-e070c3a4de65 service nova] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:58.786601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af6dad-79b7-4982-8ade-e070c3a4de65 service nova] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:58.791492 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5042e79-0052-431e-b56f-67774086b80c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:58.792261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5042e79-0052-431e-b56f-67774086b80c service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:58.792810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5042e79-0052-431e-b56f-67774086b80c service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:58.793328 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5042e79-0052-431e-b56f-67774086b80c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:58.806785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5042e79-0052-431e-b56f-67774086b80c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:58.811051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5042e79-0052-431e-b56f-67774086b80c service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:58.824573 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1125/2269] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:01.498353 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcf3c4-66ce-4220-9c43-66370df39024 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:01.498985 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcf3c4-66ce-4220-9c43-66370df39024 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:01.498985 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcf3c4-66ce-4220-9c43-66370df39024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:01.517350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-eedcf3c4-66ce-4220-9c43-66370df39024 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:01.518525 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-eedcf3c4-66ce-4220-9c43-66370df39024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:01.526726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1145/2270] 10.222.0.32 () {58 vars in 1016 bytes} [Tue May 31 21:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:01.543357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5042e79-0052-431e-b56f-67774086b80c service nova] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:01.555508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5042e79-0052-431e-b56f-67774086b80c service nova] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:01.561240 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfac9e0-f41d-468b-95c5-ba7b3ca00093 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:01.562141 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfac9e0-f41d-468b-95c5-ba7b3ca00093 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:01.562337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfac9e0-f41d-468b-95c5-ba7b3ca00093 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:01.564599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfac9e0-f41d-468b-95c5-ba7b3ca00093 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:01.571947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfac9e0-f41d-468b-95c5-ba7b3ca00093 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:01.573644 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfac9e0-f41d-468b-95c5-ba7b3ca00093 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:01.585118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1126/2271] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:05.806792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f01817-741a-4559-b562-8605a6a8e19c None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:05.807343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f01817-741a-4559-b562-8605a6a8e19c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:05.807343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f01817-741a-4559-b562-8605a6a8e19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:05.826564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-e5f01817-741a-4559-b562-8605a6a8e19c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:05.828366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e5f01817-741a-4559-b562-8605a6a8e19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:05.836364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1146/2272] 10.222.0.32 () {58 vars in 1016 bytes} [Tue May 31 21:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:04:05.851711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfac9e0-f41d-468b-95c5-ba7b3ca00093 service nova] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:05.863061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfac9e0-f41d-468b-95c5-ba7b3ca00093 service nova] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:05.869555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce95ec-7931-486d-842b-49aff937e61b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:05.870225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce95ec-7931-486d-842b-49aff937e61b service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:05.870512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce95ec-7931-486d-842b-49aff937e61b service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:05.870790 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce95ec-7931-486d-842b-49aff937e61b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:05.880975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce95ec-7931-486d-842b-49aff937e61b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:05.882606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce95ec-7931-486d-842b-49aff937e61b service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:05.893812 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1127/2273] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:10.109855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f955d98-66a6-412c-bf28-6f5305af9d4d None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:10.110519 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f955d98-66a6-412c-bf28-6f5305af9d4d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:10.110848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f955d98-66a6-412c-bf28-6f5305af9d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:10.131055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-2f955d98-66a6-412c-bf28-6f5305af9d4d None None] MFA Rules not processed for user `0567620b615f4a8ab2bc5c69ba85cc93`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:10.132301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2f955d98-66a6-412c-bf28-6f5305af9d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:10.199834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1147/2274] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:04:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:11.118816 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a7c4-4403-41b0-86cb-c1bcfc5754e3 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:11.119689 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a7c4-4403-41b0-86cb-c1bcfc5754e3 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:11.119840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a7c4-4403-41b0-86cb-c1bcfc5754e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:11.143816 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-1492a7c4-4403-41b0-86cb-c1bcfc5754e3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:11.145234 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1492a7c4-4403-41b0-86cb-c1bcfc5754e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:11.155606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1128/2275] 10.222.0.32 () {58 vars in 1016 bytes} [Tue May 31 21:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:11.174248 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f955d98-66a6-412c-bf28-6f5305af9d4d None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:11.188943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f955d98-66a6-412c-bf28-6f5305af9d4d None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:11.194767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5135548-91fc-475d-863b-e64af2b894df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:11.195434 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5135548-91fc-475d-863b-e64af2b894df service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:11.195718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5135548-91fc-475d-863b-e64af2b894df service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:11.196016 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5135548-91fc-475d-863b-e64af2b894df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:11.206062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5135548-91fc-475d-863b-e64af2b894df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:11.207731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5135548-91fc-475d-863b-e64af2b894df service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:11.219667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1148/2276] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:04:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:21.136567 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=52 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:21.213869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=43 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:22.798622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d0767-f4c7-4bc1-851b-6be7225d008e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:22.799420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d0767-f4c7-4bc1-851b-6be7225d008e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:22.799420 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d0767-f4c7-4bc1-851b-6be7225d008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:22.818690 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-cd3d0767-f4c7-4bc1-851b-6be7225d008e None None] MFA Rules not processed for user `c9b5be694ffc4b329af316dc2b23fd18`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:22.819921 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cd3d0767-f4c7-4bc1-851b-6be7225d008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:22.880981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1129/2277] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:32.873682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=25 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:41.528744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c068-aef1-4aa4-bf7c-716b45c15619 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:41.535445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c068-aef1-4aa4-bf7c-716b45c15619 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:41.535445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c068-aef1-4aa4-bf7c-716b45c15619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:41.551083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-67d5c068-aef1-4aa4-bf7c-716b45c15619 None None] MFA Rules not processed for user `3c5b1c6778f74c0d8db93e3a29935480`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:41.552307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-67d5c068-aef1-4aa4-bf7c-716b45c15619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:41.559449 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1149/2278] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:04:49.139738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d0767-f4c7-4bc1-851b-6be7225d008e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:49.145362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cd3d0767-f4c7-4bc1-851b-6be7225d008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:49.158675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d0767-f4c7-4bc1-851b-6be7225d008e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:49.165554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b10a8-4e28-4717-b816-53879d28e972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:49.167496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b10a8-4e28-4717-b816-53879d28e972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.168068 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b10a8-4e28-4717-b816-53879d28e972 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.168636 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b10a8-4e28-4717-b816-53879d28e972 admin admin] PATH_INFO: `/v3/users/7a9db25a40744940bd07701cc57afeba` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.171120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b10a8-4e28-4717-b816-53879d28e972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9db25a40744940bd07701cc57afeba)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:49.174581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b10a8-4e28-4717-b816-53879d28e972 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:49.438905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-bd8b10a8-4e28-4717-b816-53879d28e972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9db25a40744940bd07701cc57afeba'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:49.537930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-bd8b10a8-4e28-4717-b816-53879d28e972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9db25a40744940bd07701cc57afeba'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:49.537930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-bd8b10a8-4e28-4717-b816-53879d28e972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9db25a40744940bd07701cc57afeba'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:49.549985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-bd8b10a8-4e28-4717-b816-53879d28e972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9db25a40744940bd07701cc57afeba'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:49.551131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-bd8b10a8-4e28-4717-b816-53879d28e972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9db25a40744940bd07701cc57afeba'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:49.576350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1130/2279] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:04:49 2022] DELETE /identity/v3/users/7a9db25a40744940bd07701cc57afeba => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:49.847256 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5c068-aef1-4aa4-bf7c-716b45c15619 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:49.863775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5c068-aef1-4aa4-bf7c-716b45c15619 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:49.929979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151144b-52f7-4f77-8f43-e3cde1b139fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:49.930863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151144b-52f7-4f77-8f43-e3cde1b139fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.931148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151144b-52f7-4f77-8f43-e3cde1b139fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.931428 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151144b-52f7-4f77-8f43-e3cde1b139fc admin admin] PATH_INFO: `/v3/projects/839a0de431ff4d3cad357e7ddb7ef7a6` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.932706 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151144b-52f7-4f77-8f43-e3cde1b139fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=839a0de431ff4d3cad357e7ddb7ef7a6)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:49.934738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151144b-52f7-4f77-8f43-e3cde1b139fc admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:50.044192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1151144b-52f7-4f77-8f43-e3cde1b139fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839a0de431ff4d3cad357e7ddb7ef7a6', 'request_id': 'req-1151144b-52f7-4f77-8f43-e3cde1b139fc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:50.116605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1151144b-52f7-4f77-8f43-e3cde1b139fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839a0de431ff4d3cad357e7ddb7ef7a6', 'request_id': 'req-1151144b-52f7-4f77-8f43-e3cde1b139fc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:50.124168 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1151144b-52f7-4f77-8f43-e3cde1b139fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839a0de431ff4d3cad357e7ddb7ef7a6', 'request_id': 'req-1151144b-52f7-4f77-8f43-e3cde1b139fc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:50.138918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1151144b-52f7-4f77-8f43-e3cde1b139fc admin admin] The token cache is being invalidate because project 839a0de431ff4d3cad357e7ddb7ef7a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:50.140401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1151144b-52f7-4f77-8f43-e3cde1b139fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:50.140401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1151144b-52f7-4f77-8f43-e3cde1b139fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:50.141696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1150/2280] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:04:49 2022] DELETE /identity/v3/projects/839a0de431ff4d3cad357e7ddb7ef7a6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:50.147223 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64929c02-6b90-47b8-80df-457c79a96997 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:50.147949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64929c02-6b90-47b8-80df-457c79a96997 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:50.147949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64929c02-6b90-47b8-80df-457c79a96997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:50.173601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-64929c02-6b90-47b8-80df-457c79a96997 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:50.174997 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-64929c02-6b90-47b8-80df-457c79a96997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:50.281467 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1131/2281] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:04:50.290630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931724-e13f-4240-8204-2f9674c14005 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:50.290918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931724-e13f-4240-8204-2f9674c14005 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:50.291208 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931724-e13f-4240-8204-2f9674c14005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:50.313936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-32931724-e13f-4240-8204-2f9674c14005 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:50.315638 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-32931724-e13f-4240-8204-2f9674c14005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:50.333919 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1151/2282] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:50.335191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64929c02-6b90-47b8-80df-457c79a96997 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:50.346949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64929c02-6b90-47b8-80df-457c79a96997 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:50.352064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb334c-3d8e-4041-918f-9fdf749a23a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:50.352752 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb334c-3d8e-4041-918f-9fdf749a23a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:50.353045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb334c-3d8e-4041-918f-9fdf749a23a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:50.353354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb334c-3d8e-4041-918f-9fdf749a23a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:50.354246 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb334c-3d8e-4041-918f-9fdf749a23a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:04:50.354397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb334c-3d8e-4041-918f-9fdf749a23a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:50.356055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb334c-3d8e-4041-918f-9fdf749a23a2 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:50.376765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1132/2283] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:04:50.381421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32931724-e13f-4240-8204-2f9674c14005 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:50.391955 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32931724-e13f-4240-8204-2f9674c14005 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:50.397026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7cec9-c565-4ae5-bdd2-94e2bc5d8890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:50.397740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7cec9-c565-4ae5-bdd2-94e2bc5d8890 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:50.398035 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7cec9-c565-4ae5-bdd2-94e2bc5d8890 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:50.398315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7cec9-c565-4ae5-bdd2-94e2bc5d8890 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:50.399028 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7cec9-c565-4ae5-bdd2-94e2bc5d8890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:50.400961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7cec9-c565-4ae5-bdd2-94e2bc5d8890 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:50.501284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1152/2284] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:04:50 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:50.506010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb334c-3d8e-4041-918f-9fdf749a23a2 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:50.517349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb334c-3d8e-4041-918f-9fdf749a23a2 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:50.581930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3797f97-bdd0-4f9a-92fc-7a6742ca82bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:50.582767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3797f97-bdd0-4f9a-92fc-7a6742ca82bd admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:50.583113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3797f97-bdd0-4f9a-92fc-7a6742ca82bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:50.583482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3797f97-bdd0-4f9a-92fc-7a6742ca82bd admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:50.584620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3797f97-bdd0-4f9a-92fc-7a6742ca82bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:50.587171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3797f97-bdd0-4f9a-92fc-7a6742ca82bd admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:50.594849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:50.695228 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1133/2285] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:04:50 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:50.700438 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7cec9-c565-4ae5-bdd2-94e2bc5d8890 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:50.712756 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7cec9-c565-4ae5-bdd2-94e2bc5d8890 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:50.719598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7d33c-31d9-49cf-ae56-e159dcfdc1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:50.720285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7d33c-31d9-49cf-ae56-e159dcfdc1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:50.720733 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7d33c-31d9-49cf-ae56-e159dcfdc1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:50.721016 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7d33c-31d9-49cf-ae56-e159dcfdc1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:50.722464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7d33c-31d9-49cf-ae56-e159dcfdc1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:50.727376 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7d33c-31d9-49cf-ae56-e159dcfdc1e2 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:50.744154 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1153/2286] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:50.751374 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3797f97-bdd0-4f9a-92fc-7a6742ca82bd admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:50.762414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3797f97-bdd0-4f9a-92fc-7a6742ca82bd admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:50.767338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50173f52-6c69-41af-8caa-ecea477dbc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:50.768040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50173f52-6c69-41af-8caa-ecea477dbc40 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:50.768330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50173f52-6c69-41af-8caa-ecea477dbc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:50.768604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50173f52-6c69-41af-8caa-ecea477dbc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:50.769339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50173f52-6c69-41af-8caa-ecea477dbc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:50.770979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50173f52-6c69-41af-8caa-ecea477dbc40 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:50.783252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1134/2287] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:04:50.787700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7d33c-31d9-49cf-ae56-e159dcfdc1e2 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:50.799723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7d33c-31d9-49cf-ae56-e159dcfdc1e2 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:50.805074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3605c-4cf4-49ca-8961-bab16e58a348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:50.806037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3605c-4cf4-49ca-8961-bab16e58a348 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:50.806324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3605c-4cf4-49ca-8961-bab16e58a348 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:50.806602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3605c-4cf4-49ca-8961-bab16e58a348 admin admin] PATH_INFO: `/v3/projects/afe531fc6b8f4fe7ae2b07aa117947d7/users/683dec78a9094dd4861bd1ba0cd4e5b5/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:50.823748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3605c-4cf4-49ca-8961-bab16e58a348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe531fc6b8f4fe7ae2b07aa117947d7, user_id=683dec78a9094dd4861bd1ba0cd4e5b5, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:50.826560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3605c-4cf4-49ca-8961-bab16e58a348 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:50.978143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1154/2288] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:04:50 2022] PUT /identity/v3/projects/afe531fc6b8f4fe7ae2b07aa117947d7/users/683dec78a9094dd4861bd1ba0cd4e5b5/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:50.984293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bfcaf-21af-4a62-919f-5445964115b9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:50.984578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bfcaf-21af-4a62-919f-5445964115b9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:50.984857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bfcaf-21af-4a62-919f-5445964115b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:51.003292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-184bfcaf-21af-4a62-919f-5445964115b9 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:51.004700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-184bfcaf-21af-4a62-919f-5445964115b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:51.078142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1135/2289] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:51.085101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3605c-4cf4-49ca-8961-bab16e58a348 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:51.087348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-48b3605c-4cf4-49ca-8961-bab16e58a348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:51.111185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:51.147863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3605c-4cf4-49ca-8961-bab16e58a348 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:51.151756 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36438e-1955-401f-b203-47c90993f166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:51.154320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36438e-1955-401f-b203-47c90993f166 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:51.154320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36438e-1955-401f-b203-47c90993f166 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:51.154320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36438e-1955-401f-b203-47c90993f166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:51.163594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36438e-1955-401f-b203-47c90993f166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:51.165419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36438e-1955-401f-b203-47c90993f166 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:51.176541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1155/2290] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:53.512950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bfcaf-21af-4a62-919f-5445964115b9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:53.531416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bfcaf-21af-4a62-919f-5445964115b9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:53.538548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b277ff-4ea9-41ed-9d1b-1f144c8a2260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:53.539417 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b277ff-4ea9-41ed-9d1b-1f144c8a2260 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:53.539694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b277ff-4ea9-41ed-9d1b-1f144c8a2260 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:53.540176 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b277ff-4ea9-41ed-9d1b-1f144c8a2260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:53.542799 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-86b277ff-4ea9-41ed-9d1b-1f144c8a2260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:53.655568 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b277ff-4ea9-41ed-9d1b-1f144c8a2260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:53.658586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b277ff-4ea9-41ed-9d1b-1f144c8a2260 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:53.678601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1136/2291] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:04:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:54.982657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36438e-1955-401f-b203-47c90993f166 service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:54.984191 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8c36438e-1955-401f-b203-47c90993f166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:55.000776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36438e-1955-401f-b203-47c90993f166 service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:55.007722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a21528-8633-4baa-909c-56a5aaa58c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:55.009831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a21528-8633-4baa-909c-56a5aaa58c21 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:55.010873 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a21528-8633-4baa-909c-56a5aaa58c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:55.011397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a21528-8633-4baa-909c-56a5aaa58c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:55.014262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-32a21528-8633-4baa-909c-56a5aaa58c21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:55.031311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a21528-8633-4baa-909c-56a5aaa58c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:55.032791 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a21528-8633-4baa-909c-56a5aaa58c21 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:55.048280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1156/2292] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:04:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:59.479256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885268fa-c1cd-4675-96f4-5e86a64566d0 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:59.480384 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885268fa-c1cd-4675-96f4-5e86a64566d0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:59.480825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885268fa-c1cd-4675-96f4-5e86a64566d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:59.516754 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-885268fa-c1cd-4675-96f4-5e86a64566d0 None None] MFA Rules not processed for user `683dec78a9094dd4861bd1ba0cd4e5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:59.518063 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-885268fa-c1cd-4675-96f4-5e86a64566d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:59.587562 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:59.606950 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1137/2293] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:04:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:59.608504 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a21528-8633-4baa-909c-56a5aaa58c21 service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:59.626128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a21528-8633-4baa-909c-56a5aaa58c21 service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:59.636132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394ba2e-5f30-47df-88e1-24a32dceae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:59.637297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394ba2e-5f30-47df-88e1-24a32dceae58 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:59.638512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394ba2e-5f30-47df-88e1-24a32dceae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:59.639949 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394ba2e-5f30-47df-88e1-24a32dceae58 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:59.641454 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394ba2e-5f30-47df-88e1-24a32dceae58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:59.645160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394ba2e-5f30-47df-88e1-24a32dceae58 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:59.806600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1157/2294] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:04:59 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:59.815240 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885268fa-c1cd-4675-96f4-5e86a64566d0 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:59.843199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885268fa-c1cd-4675-96f4-5e86a64566d0 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:59.968382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275125ce-9765-41a4-b004-c4ec1448e7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:59.969830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275125ce-9765-41a4-b004-c4ec1448e7ae admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:59.970481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275125ce-9765-41a4-b004-c4ec1448e7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:59.974026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275125ce-9765-41a4-b004-c4ec1448e7ae admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:59.974026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275125ce-9765-41a4-b004-c4ec1448e7ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:59.974615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275125ce-9765-41a4-b004-c4ec1448e7ae admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:00.081869 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1138/2295] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:04:59 2022] POST /identity/v3/users => generated 298 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:00.086680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394ba2e-5f30-47df-88e1-24a32dceae58 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:00.110417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394ba2e-5f30-47df-88e1-24a32dceae58 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:00.113788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aecb26-c48b-4c73-96e5-f6584ca5f0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:00.114705 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aecb26-c48b-4c73-96e5-f6584ca5f0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:00.115143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aecb26-c48b-4c73-96e5-f6584ca5f0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:00.115525 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aecb26-c48b-4c73-96e5-f6584ca5f0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:00.116840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aecb26-c48b-4c73-96e5-f6584ca5f0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:00.119321 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aecb26-c48b-4c73-96e5-f6584ca5f0b4 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:00.136018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1158/2296] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:00.140916 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275125ce-9765-41a4-b004-c4ec1448e7ae admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:00.155039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275125ce-9765-41a4-b004-c4ec1448e7ae admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:00.162641 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8e596-4469-4201-ac98-1efcccb6344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:00.164159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8e596-4469-4201-ac98-1efcccb6344f admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:00.164565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8e596-4469-4201-ac98-1efcccb6344f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:00.165010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8e596-4469-4201-ac98-1efcccb6344f admin admin] PATH_INFO: `/v3/projects/cbcd99342eea413db36a475f3419c8fd/users/dc87003326e84c849020deb7d983c29a/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:00.187633 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8e596-4469-4201-ac98-1efcccb6344f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbcd99342eea413db36a475f3419c8fd, user_id=dc87003326e84c849020deb7d983c29a, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:00.192319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8e596-4469-4201-ac98-1efcccb6344f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:00.276232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1139/2297] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:05:00 2022] PUT /identity/v3/projects/cbcd99342eea413db36a475f3419c8fd/users/dc87003326e84c849020deb7d983c29a/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:00.281744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aecb26-c48b-4c73-96e5-f6584ca5f0b4 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:00.301864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aecb26-c48b-4c73-96e5-f6584ca5f0b4 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:00.389417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7a93b-c277-40a4-a9dd-2d3e8e0a4bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:00.390404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7a93b-c277-40a4-a9dd-2d3e8e0a4bfc admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:00.390860 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7a93b-c277-40a4-a9dd-2d3e8e0a4bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:00.391310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7a93b-c277-40a4-a9dd-2d3e8e0a4bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:00.393179 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7a93b-c277-40a4-a9dd-2d3e8e0a4bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:00.394427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7a93b-c277-40a4-a9dd-2d3e8e0a4bfc admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:00.409022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1159/2298] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:00.413425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8e596-4469-4201-ac98-1efcccb6344f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:00.424705 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8e596-4469-4201-ac98-1efcccb6344f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:00.431456 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017cbd9-d21b-4f7d-959a-120fc634fd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:00.433325 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017cbd9-d21b-4f7d-959a-120fc634fd8e admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:00.433676 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017cbd9-d21b-4f7d-959a-120fc634fd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:00.433967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017cbd9-d21b-4f7d-959a-120fc634fd8e admin admin] PATH_INFO: `/v3/projects/cbcd99342eea413db36a475f3419c8fd/users/dc87003326e84c849020deb7d983c29a/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:00.438416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017cbd9-d21b-4f7d-959a-120fc634fd8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbcd99342eea413db36a475f3419c8fd, user_id=dc87003326e84c849020deb7d983c29a, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:00.441622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017cbd9-d21b-4f7d-959a-120fc634fd8e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:00.454696 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1140/2299] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:05:00 2022] PUT /identity/v3/projects/cbcd99342eea413db36a475f3419c8fd/users/dc87003326e84c849020deb7d983c29a/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:08.348949 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04877704-f35a-4b70-8a32-6fc65e9feccc None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:08.349956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04877704-f35a-4b70-8a32-6fc65e9feccc None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:08.349956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04877704-f35a-4b70-8a32-6fc65e9feccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:08.383004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-04877704-f35a-4b70-8a32-6fc65e9feccc None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:08.385550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-04877704-f35a-4b70-8a32-6fc65e9feccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:08.550212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1160/2300] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 21:05:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:08.776832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017cbd9-d21b-4f7d-959a-120fc634fd8e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:08.782926 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4017cbd9-d21b-4f7d-959a-120fc634fd8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:08.966308 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017cbd9-d21b-4f7d-959a-120fc634fd8e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:08.974351 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ae6a9-073d-4ec5-ab8a-1ddfa8a5ae2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:08.975358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ae6a9-073d-4ec5-ab8a-1ddfa8a5ae2b service swift] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:08.976045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ae6a9-073d-4ec5-ab8a-1ddfa8a5ae2b service swift] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:08.976495 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ae6a9-073d-4ec5-ab8a-1ddfa8a5ae2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:08.997477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ae6a9-073d-4ec5-ab8a-1ddfa8a5ae2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:09.000318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ae6a9-073d-4ec5-ab8a-1ddfa8a5ae2b service swift] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:09.048282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1141/2301] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:05:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:05:09.420011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e1460-8bc2-47c2-af8e-cff013baaf4a None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:09.421020 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e1460-8bc2-47c2-af8e-cff013baaf4a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:09.422243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e1460-8bc2-47c2-af8e-cff013baaf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:09.511527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-766e1460-8bc2-47c2-af8e-cff013baaf4a None None] MFA Rules not processed for user `dc87003326e84c849020deb7d983c29a`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:09.513494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-766e1460-8bc2-47c2-af8e-cff013baaf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:09.520437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:09.617776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1161/2302] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:05:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:09.632038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ae6a9-073d-4ec5-ab8a-1ddfa8a5ae2b service swift] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:09.633647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e36ae6a9-073d-4ec5-ab8a-1ddfa8a5ae2b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:09.737920 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:09.775505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ae6a9-073d-4ec5-ab8a-1ddfa8a5ae2b service swift] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:09.782256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebade290-acd8-42d8-8665-ff8c325abcec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a22cd803304a19a58bfbe17addb11f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:09.793015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade290-acd8-42d8-8665-ff8c325abcec service glance] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:09.793015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade290-acd8-42d8-8665-ff8c325abcec service glance] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:09.793015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebade290-acd8-42d8-8665-ff8c325abcec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:09.898438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebade290-acd8-42d8-8665-ff8c325abcec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:09.900667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebade290-acd8-42d8-8665-ff8c325abcec service glance] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:09.915648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1142/2303] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:10.386729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc34d0-a1ff-426b-ac99-5664a6636af5 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:10.387038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc34d0-a1ff-426b-ac99-5664a6636af5 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:10.388273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc34d0-a1ff-426b-ac99-5664a6636af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:10.430226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-70cc34d0-a1ff-426b-ac99-5664a6636af5 None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:10.432201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-70cc34d0-a1ff-426b-ac99-5664a6636af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:10.452610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1162/2304] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 21:05:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:10.467413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebade290-acd8-42d8-8665-ff8c325abcec service glance] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:10.489216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebade290-acd8-42d8-8665-ff8c325abcec service glance] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:10.503454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476d47a-72a8-4b6e-9e41-5265b8733a18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:10.504476 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476d47a-72a8-4b6e-9e41-5265b8733a18 service swift] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:10.505035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476d47a-72a8-4b6e-9e41-5265b8733a18 service swift] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:10.505646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476d47a-72a8-4b6e-9e41-5265b8733a18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:10.523857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476d47a-72a8-4b6e-9e41-5265b8733a18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:10.525756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476d47a-72a8-4b6e-9e41-5265b8733a18 service swift] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:10.548442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1143/2305] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:05:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 31 21:05:11.764515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc34d0-a1ff-426b-ac99-5664a6636af5 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:11.768404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-70cc34d0-a1ff-426b-ac99-5664a6636af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:11.932733 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc34d0-a1ff-426b-ac99-5664a6636af5 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:11.944727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e994ea6-04a2-42a3-8c53-01130f9c9a01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:11.949285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e994ea6-04a2-42a3-8c53-01130f9c9a01 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:11.949285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e994ea6-04a2-42a3-8c53-01130f9c9a01 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:11.949285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e994ea6-04a2-42a3-8c53-01130f9c9a01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:11.956120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1e994ea6-04a2-42a3-8c53-01130f9c9a01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:12.100803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e994ea6-04a2-42a3-8c53-01130f9c9a01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:12.102591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e994ea6-04a2-42a3-8c53-01130f9c9a01 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:12.115672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1163/2306] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:12.652080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476d47a-72a8-4b6e-9e41-5265b8733a18 service swift] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:12.655511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b476d47a-72a8-4b6e-9e41-5265b8733a18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:12.816423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476d47a-72a8-4b6e-9e41-5265b8733a18 service swift] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:12.836610 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee01f3-d19f-48f7-b0bc-8e9fef4c4b1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:12.838057 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee01f3-d19f-48f7-b0bc-8e9fef4c4b1c service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:12.838691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee01f3-d19f-48f7-b0bc-8e9fef4c4b1c service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:12.839302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee01f3-d19f-48f7-b0bc-8e9fef4c4b1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:12.846519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-77ee01f3-d19f-48f7-b0bc-8e9fef4c4b1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:12.995018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee01f3-d19f-48f7-b0bc-8e9fef4c4b1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:12.999693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee01f3-d19f-48f7-b0bc-8e9fef4c4b1c service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:13.030941 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1144/2307] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:05:15.750711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e994ea6-04a2-42a3-8c53-01130f9c9a01 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:15.789068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e994ea6-04a2-42a3-8c53-01130f9c9a01 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:15.799961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72afd4-af1d-470f-98da-e47f5a58f43c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:15.801360 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72afd4-af1d-470f-98da-e47f5a58f43c service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:15.802008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72afd4-af1d-470f-98da-e47f5a58f43c service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:15.802584 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72afd4-af1d-470f-98da-e47f5a58f43c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:15.819709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8d72afd4-af1d-470f-98da-e47f5a58f43c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:16.020404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:16.041898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72afd4-af1d-470f-98da-e47f5a58f43c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:16.046034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72afd4-af1d-470f-98da-e47f5a58f43c service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:16.113480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1164/2308] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:23.010917 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=94 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:26.075186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=5 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:28.166493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee01f3-d19f-48f7-b0bc-8e9fef4c4b1c service nova] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:28.248625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee01f3-d19f-48f7-b0bc-8e9fef4c4b1c service nova] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:28.252793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc2fbb-e452-40d7-9c79-1c7b46b9dec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:28.253225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc2fbb-e452-40d7-9c79-1c7b46b9dec4 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:28.253546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc2fbb-e452-40d7-9c79-1c7b46b9dec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:28.253956 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc2fbb-e452-40d7-9c79-1c7b46b9dec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:28.255854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-09dc2fbb-e452-40d7-9c79-1c7b46b9dec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:28.338755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc2fbb-e452-40d7-9c79-1c7b46b9dec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:28.340228 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc2fbb-e452-40d7-9c79-1c7b46b9dec4 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:28.354778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1145/2309] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:05:28.460157 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ecd6-bcd3-467d-96be-f751bf3c0f40 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:28.460937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ecd6-bcd3-467d-96be-f751bf3c0f40 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:28.461143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ecd6-bcd3-467d-96be-f751bf3c0f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:28.492326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-2691ecd6-bcd3-467d-96be-f751bf3c0f40 None None] MFA Rules not processed for user `683dec78a9094dd4861bd1ba0cd4e5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:28.494574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2691ecd6-bcd3-467d-96be-f751bf3c0f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:28.510804 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1165/2310] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:28.925830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc2fbb-e452-40d7-9c79-1c7b46b9dec4 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:28.943696 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc2fbb-e452-40d7-9c79-1c7b46b9dec4 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:28.951545 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d23ed1-77fd-4a5d-bf22-fd3e2387d99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:28.953506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d23ed1-77fd-4a5d-bf22-fd3e2387d99e service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:28.953978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d23ed1-77fd-4a5d-bf22-fd3e2387d99e service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:28.954509 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d23ed1-77fd-4a5d-bf22-fd3e2387d99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:28.957643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-86d23ed1-77fd-4a5d-bf22-fd3e2387d99e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:28.976264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d23ed1-77fd-4a5d-bf22-fd3e2387d99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:28.978843 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d23ed1-77fd-4a5d-bf22-fd3e2387d99e service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:28.994471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1146/2311] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:29.450950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ecd6-bcd3-467d-96be-f751bf3c0f40 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:29.462100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ecd6-bcd3-467d-96be-f751bf3c0f40 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:29.465947 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19ca34-66b6-4396-82f7-968328134d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:29.466602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19ca34-66b6-4396-82f7-968328134d7f service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:29.466882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19ca34-66b6-4396-82f7-968328134d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:29.467160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19ca34-66b6-4396-82f7-968328134d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:29.468972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-9c19ca34-66b6-4396-82f7-968328134d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:29.480027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19ca34-66b6-4396-82f7-968328134d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:29.482064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19ca34-66b6-4396-82f7-968328134d7f service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:29.494872 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1166/2312] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:30.324778 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d23ed1-77fd-4a5d-bf22-fd3e2387d99e service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:30.333336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-86d23ed1-77fd-4a5d-bf22-fd3e2387d99e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:30.444421 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d23ed1-77fd-4a5d-bf22-fd3e2387d99e service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:30.455590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2db4a-50c0-484e-a8e5-d2e924ccbb2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619d0b5afa094289808516486a5e3c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:30.455590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2db4a-50c0-484e-a8e5-d2e924ccbb2e service placement] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:30.455590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2db4a-50c0-484e-a8e5-d2e924ccbb2e service placement] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:30.455590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2db4a-50c0-484e-a8e5-d2e924ccbb2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:30.456542 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-60c2db4a-50c0-484e-a8e5-d2e924ccbb2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:30.471068 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2db4a-50c0-484e-a8e5-d2e924ccbb2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:30.472729 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2db4a-50c0-484e-a8e5-d2e924ccbb2e service placement] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:30.484766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1147/2313] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:32.124072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19ca34-66b6-4396-82f7-968328134d7f service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:32.147029 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19ca34-66b6-4396-82f7-968328134d7f service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:32.160488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e70106-3ae2-4a1d-87a2-91f47f6efc49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:32.162001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e70106-3ae2-4a1d-87a2-91f47f6efc49 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:32.162505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e70106-3ae2-4a1d-87a2-91f47f6efc49 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:32.162990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e70106-3ae2-4a1d-87a2-91f47f6efc49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:32.165985 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-65e70106-3ae2-4a1d-87a2-91f47f6efc49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:32.191766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e70106-3ae2-4a1d-87a2-91f47f6efc49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:32.195285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e70106-3ae2-4a1d-87a2-91f47f6efc49 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:32.218881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1167/2314] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:34.103852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2db4a-50c0-484e-a8e5-d2e924ccbb2e service placement] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:34.107401 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-60c2db4a-50c0-484e-a8e5-d2e924ccbb2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:34.128334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2db4a-50c0-484e-a8e5-d2e924ccbb2e service placement] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:34.147538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c72a1-63b7-4b8e-878b-b405b38f97be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619d0b5afa094289808516486a5e3c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:34.150493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c72a1-63b7-4b8e-878b-b405b38f97be service placement] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:34.150493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c72a1-63b7-4b8e-878b-b405b38f97be service placement] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:34.153997 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c72a1-63b7-4b8e-878b-b405b38f97be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:34.156492 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-723c72a1-63b7-4b8e-878b-b405b38f97be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:34.180638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c72a1-63b7-4b8e-878b-b405b38f97be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:34.184671 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c72a1-63b7-4b8e-878b-b405b38f97be service placement] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:34.221177 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1148/2315] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:05:34.289335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e70106-3ae2-4a1d-87a2-91f47f6efc49 service nova] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:34.290996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-65e70106-3ae2-4a1d-87a2-91f47f6efc49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:34.322272 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e70106-3ae2-4a1d-87a2-91f47f6efc49 service nova] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:34.328345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:34.330624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:34.330624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:34.330624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] PATH_INFO: `/v3/users/0567620b615f4a8ab2bc5c69ba85cc93` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:34.331940 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0567620b615f4a8ab2bc5c69ba85cc93)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:34.334006 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:34.616462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0567620b615f4a8ab2bc5c69ba85cc93'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.701973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0567620b615f4a8ab2bc5c69ba85cc93'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.719102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0567620b615f4a8ab2bc5c69ba85cc93'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.721530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0567620b615f4a8ab2bc5c69ba85cc93'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.722942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0567620b615f4a8ab2bc5c69ba85cc93'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.773833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1168/2316] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:05:34 2022] DELETE /identity/v3/users/0567620b615f4a8ab2bc5c69ba85cc93 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:35.177284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c72a1-63b7-4b8e-878b-b405b38f97be service placement] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:35.215040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c72a1-63b7-4b8e-878b-b405b38f97be service placement] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:35.216116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:35.217809 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.238036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:35.321522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1735a6a-985e-4011-921b-0246cbcf3809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:35.322770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1735a6a-985e-4011-921b-0246cbcf3809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.323132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1735a6a-985e-4011-921b-0246cbcf3809 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.323482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1735a6a-985e-4011-921b-0246cbcf3809 admin admin] PATH_INFO: `/v3/projects/4a57f1a005cd4e2883e42e1c81cbf5e6` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.324912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1735a6a-985e-4011-921b-0246cbcf3809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a57f1a005cd4e2883e42e1c81cbf5e6)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:35.327034 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1735a6a-985e-4011-921b-0246cbcf3809 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:35.337596 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b119c83-aba9-4219-a4a6-acb87e63a874 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:35.342520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed677fc4-c61e-46a0-9f3d-a62dee249d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:35.343485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed677fc4-c61e-46a0-9f3d-a62dee249d46 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.344148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed677fc4-c61e-46a0-9f3d-a62dee249d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.344645 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed677fc4-c61e-46a0-9f3d-a62dee249d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.347318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ed677fc4-c61e-46a0-9f3d-a62dee249d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.363301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed677fc4-c61e-46a0-9f3d-a62dee249d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:35.364786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed677fc4-c61e-46a0-9f3d-a62dee249d46 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:35.376012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1169/2317] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:35.377659 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e33958-2e2e-490e-a033-628be87acfab None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.378116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e33958-2e2e-490e-a033-628be87acfab None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.378565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e33958-2e2e-490e-a033-628be87acfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.398050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a5e33958-2e2e-490e-a033-628be87acfab None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:35.399401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a5e33958-2e2e-490e-a033-628be87acfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.454969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:35.481908 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f1735a6a-985e-4011-921b-0246cbcf3809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a57f1a005cd4e2883e42e1c81cbf5e6', 'request_id': 'req-f1735a6a-985e-4011-921b-0246cbcf3809'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:35.493615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1170/2318] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:35.495579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e33958-2e2e-490e-a033-628be87acfab None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:35.498561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a5e33958-2e2e-490e-a033-628be87acfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.584805 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e33958-2e2e-490e-a033-628be87acfab None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:35.586651 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f1735a6a-985e-4011-921b-0246cbcf3809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a57f1a005cd4e2883e42e1c81cbf5e6', 'request_id': 'req-f1735a6a-985e-4011-921b-0246cbcf3809'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:35.595946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f1735a6a-985e-4011-921b-0246cbcf3809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a57f1a005cd4e2883e42e1c81cbf5e6', 'request_id': 'req-f1735a6a-985e-4011-921b-0246cbcf3809'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:35.608018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f1735a6a-985e-4011-921b-0246cbcf3809 admin admin] The token cache is being invalidate because project 4a57f1a005cd4e2883e42e1c81cbf5e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:35.608335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f1735a6a-985e-4011-921b-0246cbcf3809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:35.608990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f1735a6a-985e-4011-921b-0246cbcf3809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:35.610658 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1149/2319] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:05:35 2022] DELETE /identity/v3/projects/4a57f1a005cd4e2883e42e1c81cbf5e6 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:35.622675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b715d-5dee-4e53-8612-a27645e05fb1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.622958 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b715d-5dee-4e53-8612-a27645e05fb1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.623253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b715d-5dee-4e53-8612-a27645e05fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.643186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-9a5b715d-5dee-4e53-8612-a27645e05fb1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:35.644324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-9a5b715d-5dee-4e53-8612-a27645e05fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.662807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454708d-6176-42ae-9633-949d9b52e228 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:35.663676 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454708d-6176-42ae-9633-949d9b52e228 service swift] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.664011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454708d-6176-42ae-9633-949d9b52e228 service swift] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.664306 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454708d-6176-42ae-9633-949d9b52e228 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.668045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b454708d-6176-42ae-9633-949d9b52e228 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.749147 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1150/2320] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:35.759283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d9c0-10df-485d-9f2c-77ffd5519b40 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.759283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d9c0-10df-485d-9f2c-77ffd5519b40 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.759283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d9c0-10df-485d-9f2c-77ffd5519b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.793197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-3061d9c0-10df-485d-9f2c-77ffd5519b40 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:35.794595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-3061d9c0-10df-485d-9f2c-77ffd5519b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.813563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1151/2321] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:35.817886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061d9c0-10df-485d-9f2c-77ffd5519b40 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:35.839578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061d9c0-10df-485d-9f2c-77ffd5519b40 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:35.848794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454708d-6176-42ae-9633-949d9b52e228 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:35.850759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454708d-6176-42ae-9633-949d9b52e228 service swift] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:35.858287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2a5c5-7759-4580-872a-b85e1410f0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:35.859035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2a5c5-7759-4580-872a-b85e1410f0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.859322 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2a5c5-7759-4580-872a-b85e1410f0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.859603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2a5c5-7759-4580-872a-b85e1410f0b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.860359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2a5c5-7759-4580-872a-b85e1410f0b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:05:35.860666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2a5c5-7759-4580-872a-b85e1410f0b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:35.862469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2a5c5-7759-4580-872a-b85e1410f0b6 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:35.868830 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1171/2322] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:05:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:05:35.896992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454708d-6176-42ae-9633-949d9b52e228 service swift] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:35.898097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1152/2323] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:05:35.919452 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454708d-6176-42ae-9633-949d9b52e228 service swift] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:35.934017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfc956-ab93-4c48-a47b-8e5152bebb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:35.934740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfc956-ab93-4c48-a47b-8e5152bebb59 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.935030 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfc956-ab93-4c48-a47b-8e5152bebb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.935466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfc956-ab93-4c48-a47b-8e5152bebb59 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.936193 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfc956-ab93-4c48-a47b-8e5152bebb59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:35.938237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfc956-ab93-4c48-a47b-8e5152bebb59 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:35.968139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbeefe-77ec-44d8-8cc9-caf709e1565a None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.968392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbeefe-77ec-44d8-8cc9-caf709e1565a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.968655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbeefe-77ec-44d8-8cc9-caf709e1565a None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.970590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1153/2324] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 21:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:05:35.986762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ff45-afb8-4b40-9613-1d450503232a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.987056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ff45-afb8-4b40-9613-1d450503232a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.987349 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ff45-afb8-4b40-9613-1d450503232a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:36.031503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e2b1ff45-afb8-4b40-9613-1d450503232a None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:36.031503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e2b1ff45-afb8-4b40-9613-1d450503232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:36.065085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:36.163310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1172/2325] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:05:35 2022] POST /identity/v3/projects => generated 369 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:05:36.171772 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfc956-ab93-4c48-a47b-8e5152bebb59 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:36.221683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1154/2326] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:36.238358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ff45-afb8-4b40-9613-1d450503232a None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:36.240740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e2b1ff45-afb8-4b40-9613-1d450503232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:36.400564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfc956-ab93-4c48-a47b-8e5152bebb59 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:36.416961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75864ef-52b3-44c4-8b33-1f120163be0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:36.417967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75864ef-52b3-44c4-8b33-1f120163be0f admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:36.419622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75864ef-52b3-44c4-8b33-1f120163be0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:36.420504 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75864ef-52b3-44c4-8b33-1f120163be0f admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:36.422361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75864ef-52b3-44c4-8b33-1f120163be0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:36.426920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75864ef-52b3-44c4-8b33-1f120163be0f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:36.437170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ff45-afb8-4b40-9613-1d450503232a None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:36.489256 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:36.553740 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1173/2327] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:05:36 2022] POST /identity/v3/users => generated 285 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:36.558282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75864ef-52b3-44c4-8b33-1f120163be0f admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:36.571408 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542473d-3ed7-4226-9d12-55e089a0b3e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01a22cd803304a19a58bfbe17addb11f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:36.572866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542473d-3ed7-4226-9d12-55e089a0b3e6 service glance] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:36.573749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542473d-3ed7-4226-9d12-55e089a0b3e6 service glance] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:36.575279 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542473d-3ed7-4226-9d12-55e089a0b3e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:36.587789 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75864ef-52b3-44c4-8b33-1f120163be0f admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:36.610962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3cb9e-bf80-4032-a572-df56a8919bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:36.627200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3cb9e-bf80-4032-a572-df56a8919bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:36.627200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3cb9e-bf80-4032-a572-df56a8919bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:36.627200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3cb9e-bf80-4032-a572-df56a8919bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:36.627200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3cb9e-bf80-4032-a572-df56a8919bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:36.627200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3cb9e-bf80-4032-a572-df56a8919bb7 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:36.659576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1174/2328] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:36.662185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3cb9e-bf80-4032-a572-df56a8919bb7 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:36.675627 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3cb9e-bf80-4032-a572-df56a8919bb7 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:36.698141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db6a9f-8f1d-40df-be94-2eb67b3e7b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:36.701524 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db6a9f-8f1d-40df-be94-2eb67b3e7b88 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:36.701888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db6a9f-8f1d-40df-be94-2eb67b3e7b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:36.702357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db6a9f-8f1d-40df-be94-2eb67b3e7b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:36.703327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db6a9f-8f1d-40df-be94-2eb67b3e7b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:36.705089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db6a9f-8f1d-40df-be94-2eb67b3e7b88 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:36.752788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542473d-3ed7-4226-9d12-55e089a0b3e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:36.754625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542473d-3ed7-4226-9d12-55e089a0b3e6 service glance] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:36.771064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1155/2329] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:05:36.772264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542473d-3ed7-4226-9d12-55e089a0b3e6 service glance] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:36.782457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1175/2330] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:36.788299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542473d-3ed7-4226-9d12-55e089a0b3e6 service glance] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:36.801364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39316c20-d893-4fd7-9ed5-2406c0a91bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:36.802483 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39316c20-d893-4fd7-9ed5-2406c0a91bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:36.802795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39316c20-d893-4fd7-9ed5-2406c0a91bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:36.803293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39316c20-d893-4fd7-9ed5-2406c0a91bd4 admin admin] PATH_INFO: `/v3/projects/bcd5ba4307174b538ea94f005e65dda4/users/eb2802654add427fb18dd57ea3f51382/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:36.848403 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39316c20-d893-4fd7-9ed5-2406c0a91bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd5ba4307174b538ea94f005e65dda4, user_id=eb2802654add427fb18dd57ea3f51382, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:36.853091 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39316c20-d893-4fd7-9ed5-2406c0a91bd4 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:37.003655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1156/2331] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:05:36 2022] PUT /identity/v3/projects/bcd5ba4307174b538ea94f005e65dda4/users/eb2802654add427fb18dd57ea3f51382/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:37.018095 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890e4b9-2027-4b6b-9f3a-448c4acdfc8c None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:37.018558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890e4b9-2027-4b6b-9f3a-448c4acdfc8c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:37.018721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890e4b9-2027-4b6b-9f3a-448c4acdfc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:37.023248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39316c20-d893-4fd7-9ed5-2406c0a91bd4 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:37.025343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-39316c20-d893-4fd7-9ed5-2406c0a91bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:37.093259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b890e4b9-2027-4b6b-9f3a-448c4acdfc8c None None] MFA Rules not processed for user `eb2802654add427fb18dd57ea3f51382`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:37.093259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b890e4b9-2027-4b6b-9f3a-448c4acdfc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:37.409474 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1176/2332] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:37.413504 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32243e30-1c98-4593-b51d-89a85d78f82b None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:37.414795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32243e30-1c98-4593-b51d-89a85d78f82b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:37.415638 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32243e30-1c98-4593-b51d-89a85d78f82b None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:37.420283 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1177/2333] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 21:05:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:05:37.422207 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32243e30-1c98-4593-b51d-89a85d78f82b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:37.469136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:37.545722 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39316c20-d893-4fd7-9ed5-2406c0a91bd4 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:37.567008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41a7d4-5934-4e31-a904-c635b130c0ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:37.568183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41a7d4-5934-4e31-a904-c635b130c0ac service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:37.570537 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41a7d4-5934-4e31-a904-c635b130c0ac service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:37.573249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41a7d4-5934-4e31-a904-c635b130c0ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:37.579248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5b41a7d4-5934-4e31-a904-c635b130c0ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:37.579869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32243e30-1c98-4593-b51d-89a85d78f82b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:37.588262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147413e-f6ef-4376-87d7-adf8c85d92df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:37.590994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147413e-f6ef-4376-87d7-adf8c85d92df admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:37.590994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147413e-f6ef-4376-87d7-adf8c85d92df admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:37.590994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147413e-f6ef-4376-87d7-adf8c85d92df admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:37.592241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147413e-f6ef-4376-87d7-adf8c85d92df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:37.596219 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147413e-f6ef-4376-87d7-adf8c85d92df admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:37.623812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:37.754018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41a7d4-5934-4e31-a904-c635b130c0ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:37.761273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41a7d4-5934-4e31-a904-c635b130c0ac service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:37.788193 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1178/2334] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:05:37 2022] POST /identity/v3/projects => generated 369 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:37.798249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbed91-151e-43cc-a902-418ef2745208 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:37.799161 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbed91-151e-43cc-a902-418ef2745208 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:37.799847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbed91-151e-43cc-a902-418ef2745208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:37.843107 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1157/2335] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 821 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:37.847053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41a7d4-5934-4e31-a904-c635b130c0ac service nova] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:37.928278 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-36cbed91-151e-43cc-a902-418ef2745208 None None] MFA Rules not processed for user `16a77c08d2844e7cb81ac1370c527cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:37.934877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-36cbed91-151e-43cc-a902-418ef2745208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:37.940337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41a7d4-5934-4e31-a904-c635b130c0ac service nova] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:38.112491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1179/2336] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:38.113489 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbed91-151e-43cc-a902-418ef2745208 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:38.174980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62768d4b-3df3-4557-9c50-c54dded05ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:38.175887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62768d4b-3df3-4557-9c50-c54dded05ace admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:38.176270 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62768d4b-3df3-4557-9c50-c54dded05ace admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:38.176548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62768d4b-3df3-4557-9c50-c54dded05ace admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:38.180079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62768d4b-3df3-4557-9c50-c54dded05ace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:38.186916 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62768d4b-3df3-4557-9c50-c54dded05ace admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:38.325079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbed91-151e-43cc-a902-418ef2745208 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:38.337365 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733bbf9-f318-4cf9-aa66-a61cce0c31e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:38.338519 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bbf9-f318-4cf9-aa66-a61cce0c31e8 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:38.339073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bbf9-f318-4cf9-aa66-a61cce0c31e8 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:38.339576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bbf9-f318-4cf9-aa66-a61cce0c31e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:38.342278 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5733bbf9-f318-4cf9-aa66-a61cce0c31e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:38.348617 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1158/2337] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:05:37 2022] POST /identity/v3/users => generated 291 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:38.350189 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62768d4b-3df3-4557-9c50-c54dded05ace admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:38.353584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-62768d4b-3df3-4557-9c50-c54dded05ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:38.366185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733bbf9-f318-4cf9-aa66-a61cce0c31e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:38.368702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733bbf9-f318-4cf9-aa66-a61cce0c31e8 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:38.381029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62768d4b-3df3-4557-9c50-c54dded05ace admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:38.386575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c4b6a-5085-4479-8bad-3e0292a0d5cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:38.388203 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c4b6a-5085-4479-8bad-3e0292a0d5cc service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:38.388563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c4b6a-5085-4479-8bad-3e0292a0d5cc service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:38.388808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c4b6a-5085-4479-8bad-3e0292a0d5cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:38.407131 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1180/2338] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:38.408332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733bbf9-f318-4cf9-aa66-a61cce0c31e8 service nova] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:38.424052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733bbf9-f318-4cf9-aa66-a61cce0c31e8 service nova] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:38.426370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c4b6a-5085-4479-8bad-3e0292a0d5cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:38.434130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c4b6a-5085-4479-8bad-3e0292a0d5cc service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:38.434437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b03fb-1683-4bd1-9e10-bf44862acc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:38.434437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b03fb-1683-4bd1-9e10-bf44862acc50 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:38.434437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b03fb-1683-4bd1-9e10-bf44862acc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:38.434437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b03fb-1683-4bd1-9e10-bf44862acc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:38.436114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b03fb-1683-4bd1-9e10-bf44862acc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:38.442940 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1159/2339] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:38.447079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b03fb-1683-4bd1-9e10-bf44862acc50 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:38.466132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1181/2340] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:38.472102 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c4b6a-5085-4479-8bad-3e0292a0d5cc service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:38.481855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:38.531239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c4b6a-5085-4479-8bad-3e0292a0d5cc service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:38.540031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed978f80-cb56-4db0-a0bf-ef79ee41c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:38.540031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed978f80-cb56-4db0-a0bf-ef79ee41c2e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:38.540031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed978f80-cb56-4db0-a0bf-ef79ee41c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:38.540031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed978f80-cb56-4db0-a0bf-ef79ee41c2e5 admin admin] PATH_INFO: `/v3/projects/80c97e8b477347cba0923189d7bbf433/users/3bd36eb8534640efa7869bc6ce522e6e/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:38.590288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6772e-1281-4967-9ea0-666ce200b670 None None] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:38.590961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6772e-1281-4967-9ea0-666ce200b670 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:38.590961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6772e-1281-4967-9ea0-666ce200b670 None None] PATH_INFO: `/` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:38.592755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1182/2341] 10.222.0.39 () {54 vars in 921 bytes} [Tue May 31 21:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 21:05:38.599381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3487c7-8803-4621-9a65-063a6e9ecffa None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:38.599678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3487c7-8803-4621-9a65-063a6e9ecffa None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:38.599969 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3487c7-8803-4621-9a65-063a6e9ecffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:38.600308 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed978f80-cb56-4db0-a0bf-ef79ee41c2e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c97e8b477347cba0923189d7bbf433, user_id=3bd36eb8534640efa7869bc6ce522e6e, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:38.611652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed978f80-cb56-4db0-a0bf-ef79ee41c2e5 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:38.652136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4f3487c7-8803-4621-9a65-063a6e9ecffa None None] MFA Rules not processed for user `8c86c12743bd4ee8843dba4a7af5d7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:38.654480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4f3487c7-8803-4621-9a65-063a6e9ecffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:38.681243 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1183/2342] 10.222.0.39 () {58 vars in 1018 bytes} [Tue May 31 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:38.702956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3487c7-8803-4621-9a65-063a6e9ecffa None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:38.705699 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4f3487c7-8803-4621-9a65-063a6e9ecffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:38.729314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3487c7-8803-4621-9a65-063a6e9ecffa None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:38.787835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1160/2343] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:05:38 2022] PUT /identity/v3/projects/80c97e8b477347cba0923189d7bbf433/users/3bd36eb8534640efa7869bc6ce522e6e/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:38.787835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed978f80-cb56-4db0-a0bf-ef79ee41c2e5 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:38.960664 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b07839-6477-40ec-b9e5-048a90780959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:38.961900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b07839-6477-40ec-b9e5-048a90780959 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:38.962828 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b07839-6477-40ec-b9e5-048a90780959 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:38.963439 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b07839-6477-40ec-b9e5-048a90780959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:39.003700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed978f80-cb56-4db0-a0bf-ef79ee41c2e5 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:39.010049 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae83c5-1399-4fc3-8475-2a114923dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:39.010740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae83c5-1399-4fc3-8475-2a114923dda0 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:39.011027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae83c5-1399-4fc3-8475-2a114923dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:39.011306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae83c5-1399-4fc3-8475-2a114923dda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:39.012604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae83c5-1399-4fc3-8475-2a114923dda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:39.017404 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae83c5-1399-4fc3-8475-2a114923dda0 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:39.035416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1161/2344] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:39.036466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae83c5-1399-4fc3-8475-2a114923dda0 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:39.041494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:39.064477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae83c5-1399-4fc3-8475-2a114923dda0 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:39.075617 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5725055-8a18-4d75-959e-196a68fe971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:39.076538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5725055-8a18-4d75-959e-196a68fe971a admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:39.076830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5725055-8a18-4d75-959e-196a68fe971a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:39.077111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5725055-8a18-4d75-959e-196a68fe971a admin admin] PATH_INFO: `/v3/projects/80c97e8b477347cba0923189d7bbf433/users/3bd36eb8534640efa7869bc6ce522e6e/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:39.087061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5725055-8a18-4d75-959e-196a68fe971a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c97e8b477347cba0923189d7bbf433, user_id=3bd36eb8534640efa7869bc6ce522e6e, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:39.090590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5725055-8a18-4d75-959e-196a68fe971a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:39.144488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1162/2345] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:05:39 2022] PUT /identity/v3/projects/80c97e8b477347cba0923189d7bbf433/users/3bd36eb8534640efa7869bc6ce522e6e/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:39.168864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbe491-7796-45dc-bf57-e67943f03397 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:39.168864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbe491-7796-45dc-bf57-e67943f03397 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:39.172245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbe491-7796-45dc-bf57-e67943f03397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:39.273418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-1dfbe491-7796-45dc-bf57-e67943f03397 None None] MFA Rules not processed for user `3bd36eb8534640efa7869bc6ce522e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:39.276005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1dfbe491-7796-45dc-bf57-e67943f03397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:39.394801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b07839-6477-40ec-b9e5-048a90780959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:39.396397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b07839-6477-40ec-b9e5-048a90780959 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:39.427461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1184/2346] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:39.509970 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1163/2347] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:05:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:39.525693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b07839-6477-40ec-b9e5-048a90780959 service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:39.527843 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-16b07839-6477-40ec-b9e5-048a90780959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:39.744286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b07839-6477-40ec-b9e5-048a90780959 service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:39.860666 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16512304-e828-420f-a961-49b7195c3e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:39.861943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16512304-e828-420f-a961-49b7195c3e37 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:39.862272 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16512304-e828-420f-a961-49b7195c3e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:39.863122 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16512304-e828-420f-a961-49b7195c3e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:39.892259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16512304-e828-420f-a961-49b7195c3e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:39.899023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16512304-e828-420f-a961-49b7195c3e37 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:39.965693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1185/2348] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:05:45.843815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbe491-7796-45dc-bf57-e67943f03397 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:45.906720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:45.928351 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbe491-7796-45dc-bf57-e67943f03397 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:45.935222 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:45.936256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:45.939557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:45.939557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] PATH_INFO: `/v3/users/eb2802654add427fb18dd57ea3f51382` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:45.939557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb2802654add427fb18dd57ea3f51382)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:45.941102 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:46.216539 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb2802654add427fb18dd57ea3f51382'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:46.348637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb2802654add427fb18dd57ea3f51382'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:46.349666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb2802654add427fb18dd57ea3f51382'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:46.359383 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb2802654add427fb18dd57ea3f51382'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:46.360883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb2802654add427fb18dd57ea3f51382'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:46.381691 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1164/2349] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:05:45 2022] DELETE /identity/v3/users/eb2802654add427fb18dd57ea3f51382 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:46.387498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef46f44-7907-4fb9-94b3-0ba2aa8a3e3c None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:46.388106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef46f44-7907-4fb9-94b3-0ba2aa8a3e3c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:46.388205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef46f44-7907-4fb9-94b3-0ba2aa8a3e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:46.411943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4ef46f44-7907-4fb9-94b3-0ba2aa8a3e3c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:46.413331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4ef46f44-7907-4fb9-94b3-0ba2aa8a3e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:46.476328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:46.488346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1186/2350] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:46.500681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:46.502702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:46.566918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2799c8-72ee-4c76-9cdc-c1d873b0f088 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:46.570931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10474e7a-ccb0-4ab7-ac47-c97fd16af7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:46.571806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10474e7a-ccb0-4ab7-ac47-c97fd16af7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:46.572283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10474e7a-ccb0-4ab7-ac47-c97fd16af7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:46.572283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10474e7a-ccb0-4ab7-ac47-c97fd16af7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:46.582710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10474e7a-ccb0-4ab7-ac47-c97fd16af7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:46.584170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10474e7a-ccb0-4ab7-ac47-c97fd16af7c6 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:46.594986 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1165/2351] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:47.221605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef46f44-7907-4fb9-94b3-0ba2aa8a3e3c None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:47.223809 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4ef46f44-7907-4fb9-94b3-0ba2aa8a3e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:47.240865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef46f44-7907-4fb9-94b3-0ba2aa8a3e3c None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:47.265245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:47.268754 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:47.269322 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:47.269652 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] PATH_INFO: `/v3/projects/bcd5ba4307174b538ea94f005e65dda4` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:47.274372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd5ba4307174b538ea94f005e65dda4)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:47.279147 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:47.478355 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd5ba4307174b538ea94f005e65dda4', 'request_id': 'req-24c39049-3ad4-40b8-b1c4-41740400d47c'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:47.606370 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd5ba4307174b538ea94f005e65dda4', 'request_id': 'req-24c39049-3ad4-40b8-b1c4-41740400d47c'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:47.613267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd5ba4307174b538ea94f005e65dda4', 'request_id': 'req-24c39049-3ad4-40b8-b1c4-41740400d47c'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:47.626299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] The token cache is being invalidate because project bcd5ba4307174b538ea94f005e65dda4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:47.626593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:47.627334 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:47.628911 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1187/2352] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:05:47 2022] DELETE /identity/v3/projects/bcd5ba4307174b538ea94f005e65dda4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:47.633114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10474e7a-ccb0-4ab7-ac47-c97fd16af7c6 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:47.644124 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10474e7a-ccb0-4ab7-ac47-c97fd16af7c6 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:47.717065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc896a6-9400-4c93-8648-6e0add36321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:47.718042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc896a6-9400-4c93-8648-6e0add36321f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:47.718326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc896a6-9400-4c93-8648-6e0add36321f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:47.718591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc896a6-9400-4c93-8648-6e0add36321f admin admin] PATH_INFO: `/v3/users/3bd36eb8534640efa7869bc6ce522e6e` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:47.719857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc896a6-9400-4c93-8648-6e0add36321f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd36eb8534640efa7869bc6ce522e6e)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:47.721859 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc896a6-9400-4c93-8648-6e0add36321f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:47.734661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:47.992957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1cc896a6-9400-4c93-8648-6e0add36321f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd36eb8534640efa7869bc6ce522e6e'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:48.078083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1cc896a6-9400-4c93-8648-6e0add36321f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd36eb8534640efa7869bc6ce522e6e'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:48.079418 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1cc896a6-9400-4c93-8648-6e0add36321f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd36eb8534640efa7869bc6ce522e6e'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:48.096258 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1cc896a6-9400-4c93-8648-6e0add36321f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd36eb8534640efa7869bc6ce522e6e'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:48.098268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-1cc896a6-9400-4c93-8648-6e0add36321f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd36eb8534640efa7869bc6ce522e6e'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:48.147105 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1166/2353] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:05:47 2022] DELETE /identity/v3/users/3bd36eb8534640efa7869bc6ce522e6e => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:48.964774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:48.964774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:48.974129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c39049-3ad4-40b8-b1c4-41740400d47c admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:49.052212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:49.057244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:49.057716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:49.057903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0 admin admin] PATH_INFO: `/v3/projects/80c97e8b477347cba0923189d7bbf433` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:49.060284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c97e8b477347cba0923189d7bbf433)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:49.062448 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:49.215514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c97e8b477347cba0923189d7bbf433', 'request_id': 'req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:49.343531 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c97e8b477347cba0923189d7bbf433', 'request_id': 'req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:49.350159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c97e8b477347cba0923189d7bbf433', 'request_id': 'req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:49.362526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0 admin admin] The token cache is being invalidate because project 80c97e8b477347cba0923189d7bbf433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:49.362865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:49.363565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-256e0fbb-2eef-48c7-8366-fcf70de4c6e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:49.365547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1188/2354] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:05:48 2022] DELETE /identity/v3/projects/80c97e8b477347cba0923189d7bbf433 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:49.371592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f42791-b44d-448d-964f-9a6cec3e445b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:49.374642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f42791-b44d-448d-964f-9a6cec3e445b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:49.374642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f42791-b44d-448d-964f-9a6cec3e445b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:49.392774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-f1f42791-b44d-448d-964f-9a6cec3e445b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:49.394012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f1f42791-b44d-448d-964f-9a6cec3e445b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:49.475880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1167/2355] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:49.484848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec2849-73e6-488f-8ae5-c3e2d3a11f9a None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:49.485140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec2849-73e6-488f-8ae5-c3e2d3a11f9a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:49.485463 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec2849-73e6-488f-8ae5-c3e2d3a11f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:49.505831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b7ec2849-73e6-488f-8ae5-c3e2d3a11f9a None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:49.507073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b7ec2849-73e6-488f-8ae5-c3e2d3a11f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:49.515285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1189/2356] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:49.520837 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f42791-b44d-448d-964f-9a6cec3e445b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:49.535009 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f42791-b44d-448d-964f-9a6cec3e445b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:49.539819 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ddb59-1589-45dd-8667-a11b1f7a8acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:49.540492 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ddb59-1589-45dd-8667-a11b1f7a8acb admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:49.540775 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ddb59-1589-45dd-8667-a11b1f7a8acb admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:49.541094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ddb59-1589-45dd-8667-a11b1f7a8acb admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:49.541875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ddb59-1589-45dd-8667-a11b1f7a8acb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:05:49.542185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ddb59-1589-45dd-8667-a11b1f7a8acb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:49.544446 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ddb59-1589-45dd-8667-a11b1f7a8acb admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:49.558278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1168/2357] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:05:49.564713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec2849-73e6-488f-8ae5-c3e2d3a11f9a None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:49.569141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:49.574882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec2849-73e6-488f-8ae5-c3e2d3a11f9a None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:49.584082 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b036d4a-0c21-4db7-8a0a-3ef686dca362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:49.584082 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b036d4a-0c21-4db7-8a0a-3ef686dca362 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:49.584082 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b036d4a-0c21-4db7-8a0a-3ef686dca362 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:49.584082 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b036d4a-0c21-4db7-8a0a-3ef686dca362 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:49.584529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b036d4a-0c21-4db7-8a0a-3ef686dca362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:49.584529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b036d4a-0c21-4db7-8a0a-3ef686dca362 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:49.716772 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1190/2358] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:05:49 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:05:49.719248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ddb59-1589-45dd-8667-a11b1f7a8acb admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:49.736681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ddb59-1589-45dd-8667-a11b1f7a8acb admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:49.810453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ab2bc-e7ce-48d5-9cb7-652a0241ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:49.811061 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ab2bc-e7ce-48d5-9cb7-652a0241ba0e admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:49.811344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ab2bc-e7ce-48d5-9cb7-652a0241ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:49.811625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ab2bc-e7ce-48d5-9cb7-652a0241ba0e admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:49.812435 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ab2bc-e7ce-48d5-9cb7-652a0241ba0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:49.814437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ab2bc-e7ce-48d5-9cb7-652a0241ba0e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:49.908905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1169/2359] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:05:49 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:05:49.915105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b036d4a-0c21-4db7-8a0a-3ef686dca362 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:49.932146 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b036d4a-0c21-4db7-8a0a-3ef686dca362 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:49.940852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf421-275c-43b4-95bc-6cf1c073a1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:49.942105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf421-275c-43b4-95bc-6cf1c073a1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:49.942623 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf421-275c-43b4-95bc-6cf1c073a1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:49.943139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf421-275c-43b4-95bc-6cf1c073a1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:49.944547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf421-275c-43b4-95bc-6cf1c073a1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:49.947815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf421-275c-43b4-95bc-6cf1c073a1e0 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:49.967191 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1191/2360] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:05:49.972631 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ab2bc-e7ce-48d5-9cb7-652a0241ba0e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:49.983968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:49.990844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ab2bc-e7ce-48d5-9cb7-652a0241ba0e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:49.999787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6ff7c-9889-4e37-9a83-32124c37f61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:50.000977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6ff7c-9889-4e37-9a83-32124c37f61c admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:50.001546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6ff7c-9889-4e37-9a83-32124c37f61c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:50.002062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6ff7c-9889-4e37-9a83-32124c37f61c admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:50.003496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6ff7c-9889-4e37-9a83-32124c37f61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:50.006692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6ff7c-9889-4e37-9a83-32124c37f61c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:50.020131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1170/2361] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:50.024784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf421-275c-43b4-95bc-6cf1c073a1e0 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:50.035953 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf421-275c-43b4-95bc-6cf1c073a1e0 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:50.041575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131a9ef-212b-492e-b086-34b54303393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:50.042506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a9ef-212b-492e-b086-34b54303393c admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:50.042784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a9ef-212b-492e-b086-34b54303393c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:50.043055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a9ef-212b-492e-b086-34b54303393c admin admin] PATH_INFO: `/v3/projects/d7bf26ecd4584373885a7d7035893b01/users/a2ff5529f91848f78d86ad2d62f76072/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:50.059185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131a9ef-212b-492e-b086-34b54303393c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bf26ecd4584373885a7d7035893b01, user_id=a2ff5529f91848f78d86ad2d62f76072, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:50.063361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131a9ef-212b-492e-b086-34b54303393c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:50.196076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1192/2362] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:05:50 2022] PUT /identity/v3/projects/d7bf26ecd4584373885a7d7035893b01/users/a2ff5529f91848f78d86ad2d62f76072/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:50.207479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dd756-8158-4e88-8474-880e9a00e5e8 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:50.208292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dd756-8158-4e88-8474-880e9a00e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:50.216475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dd756-8158-4e88-8474-880e9a00e5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:50.251977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-430dd756-8158-4e88-8474-880e9a00e5e8 None None] MFA Rules not processed for user `a2ff5529f91848f78d86ad2d62f76072`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:50.253213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-430dd756-8158-4e88-8474-880e9a00e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:50.348845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1171/2363] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:50.352932 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131a9ef-212b-492e-b086-34b54303393c admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:50.446876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131a9ef-212b-492e-b086-34b54303393c admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:50.453026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fe67a-ef47-4d17-ba39-8391175d3ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:50.453797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fe67a-ef47-4d17-ba39-8391175d3ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:50.454249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fe67a-ef47-4d17-ba39-8391175d3ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:50.454585 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fe67a-ef47-4d17-ba39-8391175d3ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:50.455370 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fe67a-ef47-4d17-ba39-8391175d3ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:50.457328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fe67a-ef47-4d17-ba39-8391175d3ca0 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:50.590087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1193/2364] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:05:50 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:50.594772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dd756-8158-4e88-8474-880e9a00e5e8 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:50.605984 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dd756-8158-4e88-8474-880e9a00e5e8 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:50.672283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8943ca-1caf-4b35-ad01-bb82094b7261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:50.672978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8943ca-1caf-4b35-ad01-bb82094b7261 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:50.673285 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8943ca-1caf-4b35-ad01-bb82094b7261 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:50.673595 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8943ca-1caf-4b35-ad01-bb82094b7261 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:50.674300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8943ca-1caf-4b35-ad01-bb82094b7261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:50.676364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8943ca-1caf-4b35-ad01-bb82094b7261 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:50.756247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1172/2365] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:05:50 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:50.763244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fe67a-ef47-4d17-ba39-8391175d3ca0 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:50.776038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fe67a-ef47-4d17-ba39-8391175d3ca0 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:50.782040 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64021f91-7bb5-404b-be71-278375fce613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:50.782040 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64021f91-7bb5-404b-be71-278375fce613 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:50.782268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64021f91-7bb5-404b-be71-278375fce613 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:50.782513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64021f91-7bb5-404b-be71-278375fce613 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:50.783233 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64021f91-7bb5-404b-be71-278375fce613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:50.792246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64021f91-7bb5-404b-be71-278375fce613 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:50.812007 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1194/2366] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:50.816221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8943ca-1caf-4b35-ad01-bb82094b7261 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:50.832138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8943ca-1caf-4b35-ad01-bb82094b7261 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:50.837125 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ecb52-75ca-4dba-adff-48b1d6c1154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:50.838064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ecb52-75ca-4dba-adff-48b1d6c1154f admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:50.839304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ecb52-75ca-4dba-adff-48b1d6c1154f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:50.839304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ecb52-75ca-4dba-adff-48b1d6c1154f admin admin] PATH_INFO: `/v3/projects/3a87a2ebac274308a4c5d9ffb90ea519/users/533f35aa850f41fc9550503c664f2a67/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:50.855388 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ecb52-75ca-4dba-adff-48b1d6c1154f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a87a2ebac274308a4c5d9ffb90ea519, user_id=533f35aa850f41fc9550503c664f2a67, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:50.858169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ecb52-75ca-4dba-adff-48b1d6c1154f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:51.059116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1173/2367] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:05:50 2022] PUT /identity/v3/projects/3a87a2ebac274308a4c5d9ffb90ea519/users/533f35aa850f41fc9550503c664f2a67/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:51.063484 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64021f91-7bb5-404b-be71-278375fce613 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:51.074503 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64021f91-7bb5-404b-be71-278375fce613 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:51.142604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511a5cd-8db9-4d0a-a0bd-ada965ea81df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:51.143297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a5cd-8db9-4d0a-a0bd-ada965ea81df admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:51.143584 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a5cd-8db9-4d0a-a0bd-ada965ea81df admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:51.143864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a5cd-8db9-4d0a-a0bd-ada965ea81df admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:51.144600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511a5cd-8db9-4d0a-a0bd-ada965ea81df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:51.146305 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511a5cd-8db9-4d0a-a0bd-ada965ea81df admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:51.158460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1195/2368] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:51.163302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ecb52-75ca-4dba-adff-48b1d6c1154f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:51.174733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ecb52-75ca-4dba-adff-48b1d6c1154f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:51.179850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb10b8-0dad-4232-ba33-87b762968e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:51.180750 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb10b8-0dad-4232-ba33-87b762968e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:51.181033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb10b8-0dad-4232-ba33-87b762968e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:51.181306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb10b8-0dad-4232-ba33-87b762968e1c admin admin] PATH_INFO: `/v3/projects/3a87a2ebac274308a4c5d9ffb90ea519/users/533f35aa850f41fc9550503c664f2a67/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:51.183424 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb10b8-0dad-4232-ba33-87b762968e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a87a2ebac274308a4c5d9ffb90ea519, user_id=533f35aa850f41fc9550503c664f2a67, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:51.186194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb10b8-0dad-4232-ba33-87b762968e1c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:51.198741 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1174/2369] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:05:51 2022] PUT /identity/v3/projects/3a87a2ebac274308a4c5d9ffb90ea519/users/533f35aa850f41fc9550503c664f2a67/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:51.211520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff628-bf0f-4296-9681-2a99d2d79475 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:51.212078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff628-bf0f-4296-9681-2a99d2d79475 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:51.212845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff628-bf0f-4296-9681-2a99d2d79475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:51.251050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17936734-9ddd-47a5-9a27-420a7638ccf1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:51.251530 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17936734-9ddd-47a5-9a27-420a7638ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:51.251884 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17936734-9ddd-47a5-9a27-420a7638ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:51.263377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-848ff628-bf0f-4296-9681-2a99d2d79475 None None] MFA Rules not processed for user `533f35aa850f41fc9550503c664f2a67`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:51.264732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-848ff628-bf0f-4296-9681-2a99d2d79475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:51.270297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:51.277823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-17936734-9ddd-47a5-9a27-420a7638ccf1 None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:51.279661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-17936734-9ddd-47a5-9a27-420a7638ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:51.328343 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:51.403603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1175/2370] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:51.404618 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17936734-9ddd-47a5-9a27-420a7638ccf1 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:51.406062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-17936734-9ddd-47a5-9a27-420a7638ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:51.410959 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1196/2371] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:51.433787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ff628-bf0f-4296-9681-2a99d2d79475 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:51.435473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-848ff628-bf0f-4296-9681-2a99d2d79475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:51.535913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17936734-9ddd-47a5-9a27-420a7638ccf1 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:51.543643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d116b2-0b58-4c37-bc41-1f4793f4ff6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:51.544674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d116b2-0b58-4c37-bc41-1f4793f4ff6e service swift] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:51.546410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d116b2-0b58-4c37-bc41-1f4793f4ff6e service swift] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:51.546839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d116b2-0b58-4c37-bc41-1f4793f4ff6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:51.551965 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ff628-bf0f-4296-9681-2a99d2d79475 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:51.565570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe71d2-0fe7-4922-8565-61ec592389ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:51.565570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe71d2-0fe7-4922-8565-61ec592389ee service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:51.565570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe71d2-0fe7-4922-8565-61ec592389ee service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:51.565570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe71d2-0fe7-4922-8565-61ec592389ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:51.570121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d116b2-0b58-4c37-bc41-1f4793f4ff6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:51.573279 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d116b2-0b58-4c37-bc41-1f4793f4ff6e service swift] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:51.589988 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1176/2372] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:05:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:05:51.699460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe71d2-0fe7-4922-8565-61ec592389ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:51.703333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe71d2-0fe7-4922-8565-61ec592389ee service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:51.730570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1197/2373] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:05:54.006998 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d116b2-0b58-4c37-bc41-1f4793f4ff6e service swift] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:54.020851 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d116b2-0b58-4c37-bc41-1f4793f4ff6e service swift] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:54.027872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac846a-5bac-4e83-a329-ab60bedacdb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:54.030230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac846a-5bac-4e83-a329-ab60bedacdb0 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:54.031542 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac846a-5bac-4e83-a329-ab60bedacdb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:54.031786 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac846a-5bac-4e83-a329-ab60bedacdb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:54.052847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac846a-5bac-4e83-a329-ab60bedacdb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:54.057272 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac846a-5bac-4e83-a329-ab60bedacdb0 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:54.079257 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1177/2374] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:05:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:59.982455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe71d2-0fe7-4922-8565-61ec592389ee service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:00.070213 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:00.077009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe71d2-0fe7-4922-8565-61ec592389ee service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:00.082972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:00.084123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:00.084757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:00.085204 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] PATH_INFO: `/v3/users/a2ff5529f91848f78d86ad2d62f76072` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:00.086701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ff5529f91848f78d86ad2d62f76072)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:00.091366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:00.587901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ff5529f91848f78d86ad2d62f76072'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:00.668123 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ff5529f91848f78d86ad2d62f76072'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:00.679890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ff5529f91848f78d86ad2d62f76072'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:00.682560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ff5529f91848f78d86ad2d62f76072'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:00.682560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ff5529f91848f78d86ad2d62f76072'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:00.706380 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1198/2375] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:05:59 2022] DELETE /identity/v3/users/a2ff5529f91848f78d86ad2d62f76072 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:00.711068 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10321-1276-4073-8c0c-460e43b07039 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:00.711714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10321-1276-4073-8c0c-460e43b07039 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:00.711714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10321-1276-4073-8c0c-460e43b07039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:00.728786 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-16c10321-1276-4073-8c0c-460e43b07039 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:00.730013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-16c10321-1276-4073-8c0c-460e43b07039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:00.810965 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1178/2376] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:00.826733 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:00.829303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:00.900236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ec0f2-5ed4-40e5-b91f-305f82de260f admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:00.906768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288e71f-1708-4d44-9daf-b84f9884109a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:00.907928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288e71f-1708-4d44-9daf-b84f9884109a service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:00.908456 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288e71f-1708-4d44-9daf-b84f9884109a service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:00.908968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288e71f-1708-4d44-9daf-b84f9884109a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:00.925179 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288e71f-1708-4d44-9daf-b84f9884109a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:00.926750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288e71f-1708-4d44-9daf-b84f9884109a service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:00.937900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1199/2377] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:01.378638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c10321-1276-4073-8c0c-460e43b07039 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:01.383608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-16c10321-1276-4073-8c0c-460e43b07039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:01.394942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c10321-1276-4073-8c0c-460e43b07039 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:01.401456 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:01.402672 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:01.402919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:01.403262 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] PATH_INFO: `/v3/projects/d7bf26ecd4584373885a7d7035893b01` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:01.405425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7bf26ecd4584373885a7d7035893b01)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:01.407138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:01.523781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7bf26ecd4584373885a7d7035893b01', 'request_id': 'req-ba83f437-a01f-40df-a7e4-7f74b072959d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:01.527051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:01.639894 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7bf26ecd4584373885a7d7035893b01', 'request_id': 'req-ba83f437-a01f-40df-a7e4-7f74b072959d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:01.647250 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7bf26ecd4584373885a7d7035893b01', 'request_id': 'req-ba83f437-a01f-40df-a7e4-7f74b072959d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:01.659308 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] The token cache is being invalidate because project d7bf26ecd4584373885a7d7035893b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:01.659603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:01.660258 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:01.661947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1179/2378] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:06:01 2022] DELETE /identity/v3/projects/d7bf26ecd4584373885a7d7035893b01 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:01.665845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288e71f-1708-4d44-9daf-b84f9884109a service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:01.675928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288e71f-1708-4d44-9daf-b84f9884109a service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:01.735687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d71a6-4a6e-45aa-8b33-d05bcc4c0a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:01.739152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d71a6-4a6e-45aa-8b33-d05bcc4c0a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:01.739152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d71a6-4a6e-45aa-8b33-d05bcc4c0a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:01.739152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d71a6-4a6e-45aa-8b33-d05bcc4c0a49 admin admin] PATH_INFO: `/v3/users/533f35aa850f41fc9550503c664f2a67` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:01.739152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d71a6-4a6e-45aa-8b33-d05bcc4c0a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=533f35aa850f41fc9550503c664f2a67)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:01.741164 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d71a6-4a6e-45aa-8b33-d05bcc4c0a49 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:01.766034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:01.938114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-a93d71a6-4a6e-45aa-8b33-d05bcc4c0a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533f35aa850f41fc9550503c664f2a67'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:02.022443 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-a93d71a6-4a6e-45aa-8b33-d05bcc4c0a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533f35aa850f41fc9550503c664f2a67'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:02.031335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-a93d71a6-4a6e-45aa-8b33-d05bcc4c0a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533f35aa850f41fc9550503c664f2a67'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:02.032253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-a93d71a6-4a6e-45aa-8b33-d05bcc4c0a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533f35aa850f41fc9550503c664f2a67'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:02.032971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-a93d71a6-4a6e-45aa-8b33-d05bcc4c0a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533f35aa850f41fc9550503c664f2a67'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:02.053115 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1200/2379] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:06:01 2022] DELETE /identity/v3/users/533f35aa850f41fc9550503c664f2a67 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:02.509824 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:02.511369 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:02.532536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83f437-a01f-40df-a7e4-7f74b072959d admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:02.770875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:02.772078 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:02.772365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:02.772643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0 admin admin] PATH_INFO: `/v3/projects/3a87a2ebac274308a4c5d9ffb90ea519` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:02.773935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a87a2ebac274308a4c5d9ffb90ea519)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:02.776504 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:02.934704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a87a2ebac274308a4c5d9ffb90ea519', 'request_id': 'req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:03.022662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a87a2ebac274308a4c5d9ffb90ea519', 'request_id': 'req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:03.029623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a87a2ebac274308a4c5d9ffb90ea519', 'request_id': 'req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:03.040972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0 admin admin] The token cache is being invalidate because project 3a87a2ebac274308a4c5d9ffb90ea519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:03.041271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:03.041960 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f4a266ac-9c38-4ffd-a094-d69bb7ba57a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:03.044173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1180/2380] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:06:02 2022] DELETE /identity/v3/projects/3a87a2ebac274308a4c5d9ffb90ea519 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:03.049238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739cc3-b10d-43fb-bacb-ea907591336c None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:03.049742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739cc3-b10d-43fb-bacb-ea907591336c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:03.049865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739cc3-b10d-43fb-bacb-ea907591336c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:03.068583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-2e739cc3-b10d-43fb-bacb-ea907591336c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:03.070025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2e739cc3-b10d-43fb-bacb-ea907591336c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:03.134506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1201/2381] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:03.143731 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e403a-dd84-45ae-9737-8fe04468bf23 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:03.144101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e403a-dd84-45ae-9737-8fe04468bf23 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:03.144454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e403a-dd84-45ae-9737-8fe04468bf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:03.170940 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7f4e403a-dd84-45ae-9737-8fe04468bf23 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:03.172148 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7f4e403a-dd84-45ae-9737-8fe04468bf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:03.181106 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1181/2382] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:03.187311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e739cc3-b10d-43fb-bacb-ea907591336c None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:03.195893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e739cc3-b10d-43fb-bacb-ea907591336c None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:03.201645 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc56ef5-9ca8-4a79-8570-ec32117badbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:03.202313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc56ef5-9ca8-4a79-8570-ec32117badbf admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:03.202593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc56ef5-9ca8-4a79-8570-ec32117badbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:03.202864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc56ef5-9ca8-4a79-8570-ec32117badbf admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:03.203591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc56ef5-9ca8-4a79-8570-ec32117badbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:06:03.203893 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc56ef5-9ca8-4a79-8570-ec32117badbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:03.205518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc56ef5-9ca8-4a79-8570-ec32117badbf admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:03.218350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1202/2383] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:06:03.225785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e403a-dd84-45ae-9737-8fe04468bf23 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:03.236373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e403a-dd84-45ae-9737-8fe04468bf23 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:03.241982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec6a08-5afc-48b4-a294-0b976d7d8e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:03.243008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec6a08-5afc-48b4-a294-0b976d7d8e67 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:03.243479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec6a08-5afc-48b4-a294-0b976d7d8e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:03.243803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec6a08-5afc-48b4-a294-0b976d7d8e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:03.248782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec6a08-5afc-48b4-a294-0b976d7d8e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:03.252357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec6a08-5afc-48b4-a294-0b976d7d8e67 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:03.407383 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1182/2384] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:03 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:03.411566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc56ef5-9ca8-4a79-8570-ec32117badbf admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:03.422510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc56ef5-9ca8-4a79-8570-ec32117badbf admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:03.482963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd8914-4215-49d1-988e-51032b76606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:03.483632 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8914-4215-49d1-988e-51032b76606c admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:03.483914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8914-4215-49d1-988e-51032b76606c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:03.484188 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8914-4215-49d1-988e-51032b76606c admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:03.484882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd8914-4215-49d1-988e-51032b76606c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:03.501669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd8914-4215-49d1-988e-51032b76606c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:03.607867 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1203/2385] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:03 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:03.613845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec6a08-5afc-48b4-a294-0b976d7d8e67 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:03.631768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec6a08-5afc-48b4-a294-0b976d7d8e67 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:03.638251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2c6f-f83d-48dd-8d9f-121f2d0f8f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:03.639236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2c6f-f83d-48dd-8d9f-121f2d0f8f21 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:03.639521 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2c6f-f83d-48dd-8d9f-121f2d0f8f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:03.639795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2c6f-f83d-48dd-8d9f-121f2d0f8f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:03.640599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa2c6f-f83d-48dd-8d9f-121f2d0f8f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:03.642266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa2c6f-f83d-48dd-8d9f-121f2d0f8f21 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:03.658169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1183/2386] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:03.659845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd8914-4215-49d1-988e-51032b76606c admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:03.672053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd8914-4215-49d1-988e-51032b76606c admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:03.676753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282e34f-27a9-49f2-bf31-6e7df145a723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:03.677469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282e34f-27a9-49f2-bf31-6e7df145a723 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:03.677761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282e34f-27a9-49f2-bf31-6e7df145a723 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:03.678042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282e34f-27a9-49f2-bf31-6e7df145a723 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:03.678783 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282e34f-27a9-49f2-bf31-6e7df145a723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:03.680419 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282e34f-27a9-49f2-bf31-6e7df145a723 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:03.692224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1204/2387] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:03.697297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2c6f-f83d-48dd-8d9f-121f2d0f8f21 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:03.709332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2c6f-f83d-48dd-8d9f-121f2d0f8f21 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:03.714893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f0f1b-758e-407a-a565-fda1df57ba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:03.715927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f0f1b-758e-407a-a565-fda1df57ba83 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:03.716211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f0f1b-758e-407a-a565-fda1df57ba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:03.716491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f0f1b-758e-407a-a565-fda1df57ba83 admin admin] PATH_INFO: `/v3/projects/4ed83340d47040949a1847debd8fc1b0/users/c67da27023144c5ca078752ad4a2a539/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:03.742021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f0f1b-758e-407a-a565-fda1df57ba83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed83340d47040949a1847debd8fc1b0, user_id=c67da27023144c5ca078752ad4a2a539, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:03.744773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f0f1b-758e-407a-a565-fda1df57ba83 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:03.845201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:03.874037 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1184/2388] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:03 2022] PUT /identity/v3/projects/4ed83340d47040949a1847debd8fc1b0/users/c67da27023144c5ca078752ad4a2a539/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:03.884346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bab22-2073-4664-8261-132e272bc778 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:03.884639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bab22-2073-4664-8261-132e272bc778 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:03.884947 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bab22-2073-4664-8261-132e272bc778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:03.891551 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:03.920663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-264bab22-2073-4664-8261-132e272bc778 None None] MFA Rules not processed for user `c67da27023144c5ca078752ad4a2a539`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:03.922106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-264bab22-2073-4664-8261-132e272bc778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:04.026301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1205/2389] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:04.027812 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f0f1b-758e-407a-a565-fda1df57ba83 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:04.102816 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f0f1b-758e-407a-a565-fda1df57ba83 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:04.108318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac95c3-d4d7-4102-b493-a674d1695a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:04.108944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac95c3-d4d7-4102-b493-a674d1695a1e admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:04.109350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac95c3-d4d7-4102-b493-a674d1695a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:04.110050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac95c3-d4d7-4102-b493-a674d1695a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:04.113882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac95c3-d4d7-4102-b493-a674d1695a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:04.113882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac95c3-d4d7-4102-b493-a674d1695a1e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:04.236923 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1185/2390] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:04 2022] POST /identity/v3/projects => generated 393 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:04.241719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bab22-2073-4664-8261-132e272bc778 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:04.252816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bab22-2073-4664-8261-132e272bc778 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:04.314550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0fec8-dbc6-468e-ad07-93b037a8f284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:04.315240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0fec8-dbc6-468e-ad07-93b037a8f284 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:04.315522 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0fec8-dbc6-468e-ad07-93b037a8f284 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:04.315868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0fec8-dbc6-468e-ad07-93b037a8f284 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:04.316530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0fec8-dbc6-468e-ad07-93b037a8f284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:04.318635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0fec8-dbc6-468e-ad07-93b037a8f284 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:04.436476 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1206/2391] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:04 2022] POST /identity/v3/users => generated 303 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:04.441942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac95c3-d4d7-4102-b493-a674d1695a1e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:04.453284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac95c3-d4d7-4102-b493-a674d1695a1e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:04.459090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63d158-3cd2-46f1-9441-287ed01a4b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:04.459763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63d158-3cd2-46f1-9441-287ed01a4b85 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:04.460043 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63d158-3cd2-46f1-9441-287ed01a4b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:04.460315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63d158-3cd2-46f1-9441-287ed01a4b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:04.461289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63d158-3cd2-46f1-9441-287ed01a4b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:04.467796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63d158-3cd2-46f1-9441-287ed01a4b85 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:04.478982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1186/2392] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:04.484140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0fec8-dbc6-468e-ad07-93b037a8f284 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:04.498728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0fec8-dbc6-468e-ad07-93b037a8f284 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:04.504294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b408949-4d82-4a1a-8f65-5c5a6e39c86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:04.505335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b408949-4d82-4a1a-8f65-5c5a6e39c86e admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:04.505751 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b408949-4d82-4a1a-8f65-5c5a6e39c86e admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:04.506099 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b408949-4d82-4a1a-8f65-5c5a6e39c86e admin admin] PATH_INFO: `/v3/projects/aff43cf78efe4ea7b3934042eddbabc6/users/bcc6e05d93954949bcd58b7fb8705b29/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:04.525326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b408949-4d82-4a1a-8f65-5c5a6e39c86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff43cf78efe4ea7b3934042eddbabc6, user_id=bcc6e05d93954949bcd58b7fb8705b29, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:04.528280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b408949-4d82-4a1a-8f65-5c5a6e39c86e admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:04.599012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1207/2393] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:04 2022] PUT /identity/v3/projects/aff43cf78efe4ea7b3934042eddbabc6/users/bcc6e05d93954949bcd58b7fb8705b29/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:04.603548 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63d158-3cd2-46f1-9441-287ed01a4b85 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:04.616881 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63d158-3cd2-46f1-9441-287ed01a4b85 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:04.689627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c71817-0a48-4fcb-adcc-a160f4e29526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:04.690341 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c71817-0a48-4fcb-adcc-a160f4e29526 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:04.690626 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c71817-0a48-4fcb-adcc-a160f4e29526 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:04.690900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c71817-0a48-4fcb-adcc-a160f4e29526 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:04.691626 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c71817-0a48-4fcb-adcc-a160f4e29526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:04.693565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c71817-0a48-4fcb-adcc-a160f4e29526 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:04.710358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1187/2394] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:04.714198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b408949-4d82-4a1a-8f65-5c5a6e39c86e admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:04.727646 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b408949-4d82-4a1a-8f65-5c5a6e39c86e admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:04.737206 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70ad47-cb6c-4a1d-bc4c-eb4482613f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:04.738478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70ad47-cb6c-4a1d-bc4c-eb4482613f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:04.738698 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70ad47-cb6c-4a1d-bc4c-eb4482613f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:04.739518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70ad47-cb6c-4a1d-bc4c-eb4482613f9f admin admin] PATH_INFO: `/v3/projects/aff43cf78efe4ea7b3934042eddbabc6/users/bcc6e05d93954949bcd58b7fb8705b29/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:04.741323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70ad47-cb6c-4a1d-bc4c-eb4482613f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff43cf78efe4ea7b3934042eddbabc6, user_id=bcc6e05d93954949bcd58b7fb8705b29, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:04.744326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70ad47-cb6c-4a1d-bc4c-eb4482613f9f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:04.756464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1208/2395] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:04 2022] PUT /identity/v3/projects/aff43cf78efe4ea7b3934042eddbabc6/users/bcc6e05d93954949bcd58b7fb8705b29/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:04.767949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f3b79-ffb3-44a2-af81-f29716526aa9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:04.770581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f3b79-ffb3-44a2-af81-f29716526aa9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:04.770581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f3b79-ffb3-44a2-af81-f29716526aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:04.800130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-8f2f3b79-ffb3-44a2-af81-f29716526aa9 None None] MFA Rules not processed for user `bcc6e05d93954949bcd58b7fb8705b29`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:04.801367 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8f2f3b79-ffb3-44a2-af81-f29716526aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:04.878757 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:04.890612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1188/2396] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:04.901766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70ad47-cb6c-4a1d-bc4c-eb4482613f9f admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:04.904333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-cc70ad47-cb6c-4a1d-bc4c-eb4482613f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:04.963701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:04.976609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70ad47-cb6c-4a1d-bc4c-eb4482613f9f admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:04.980656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a739d2-65e5-4bdc-a65f-0fa3a068b6bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:04.981943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a739d2-65e5-4bdc-a65f-0fa3a068b6bb service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:04.982226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a739d2-65e5-4bdc-a65f-0fa3a068b6bb service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:04.982675 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a739d2-65e5-4bdc-a65f-0fa3a068b6bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:04.995071 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a739d2-65e5-4bdc-a65f-0fa3a068b6bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:04.996927 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a739d2-65e5-4bdc-a65f-0fa3a068b6bb service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:05.013874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1209/2397] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:05.071998 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f3b79-ffb3-44a2-af81-f29716526aa9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:05.074309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8f2f3b79-ffb3-44a2-af81-f29716526aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:05.094481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f3b79-ffb3-44a2-af81-f29716526aa9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:05.098710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691df190-3bcd-4b72-a9df-13c4f5958016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:05.099476 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691df190-3bcd-4b72-a9df-13c4f5958016 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:05.099925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691df190-3bcd-4b72-a9df-13c4f5958016 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:05.100415 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691df190-3bcd-4b72-a9df-13c4f5958016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:05.165472 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691df190-3bcd-4b72-a9df-13c4f5958016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:05.166903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691df190-3bcd-4b72-a9df-13c4f5958016 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:05.182335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1189/2398] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:07.223244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a739d2-65e5-4bdc-a65f-0fa3a068b6bb service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:07.224764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-47a739d2-65e5-4bdc-a65f-0fa3a068b6bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:07.289594 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a739d2-65e5-4bdc-a65f-0fa3a068b6bb service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:07.293921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea7149-bd6e-4453-bec8-6d8f003d89a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:07.294576 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea7149-bd6e-4453-bec8-6d8f003d89a7 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:07.294886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea7149-bd6e-4453-bec8-6d8f003d89a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:07.295172 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea7149-bd6e-4453-bec8-6d8f003d89a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:07.297032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8fea7149-bd6e-4453-bec8-6d8f003d89a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:07.363748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea7149-bd6e-4453-bec8-6d8f003d89a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:07.365512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea7149-bd6e-4453-bec8-6d8f003d89a7 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:07.379643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1210/2399] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:08.459890 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252e7b1-b02f-4093-a818-364ab3fa31f7 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:08.460417 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252e7b1-b02f-4093-a818-364ab3fa31f7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:08.460520 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252e7b1-b02f-4093-a818-364ab3fa31f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:08.506451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-4252e7b1-b02f-4093-a818-364ab3fa31f7 None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:08.507688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4252e7b1-b02f-4093-a818-364ab3fa31f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:08.584693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1190/2400] 10.222.0.39 () {58 vars in 967 bytes} [Tue May 31 21:06:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:08.620757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea7149-bd6e-4453-bec8-6d8f003d89a7 service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:08.620757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8fea7149-bd6e-4453-bec8-6d8f003d89a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:08.716050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea7149-bd6e-4453-bec8-6d8f003d89a7 service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:08.726040 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96835411-4a46-4e4d-b865-59c5e862bb8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:08.727138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96835411-4a46-4e4d-b865-59c5e862bb8a service swift] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:08.727640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96835411-4a46-4e4d-b865-59c5e862bb8a service swift] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:08.728143 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96835411-4a46-4e4d-b865-59c5e862bb8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:08.744311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96835411-4a46-4e4d-b865-59c5e862bb8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:08.746136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96835411-4a46-4e4d-b865-59c5e862bb8a service swift] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:08.756184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1211/2401] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:06:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:06:09.646448 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252e7b1-b02f-4093-a818-364ab3fa31f7 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:09.647951 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4252e7b1-b02f-4093-a818-364ab3fa31f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:09.660169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252e7b1-b02f-4093-a818-364ab3fa31f7 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:09.664531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc8a90-e263-4c27-acdd-72519e359ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:09.665190 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc8a90-e263-4c27-acdd-72519e359ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:09.665519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc8a90-e263-4c27-acdd-72519e359ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:09.665789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc8a90-e263-4c27-acdd-72519e359ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:09.667734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-76dc8a90-e263-4c27-acdd-72519e359ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:09.748979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc8a90-e263-4c27-acdd-72519e359ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:09.750380 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc8a90-e263-4c27-acdd-72519e359ca7 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:09.760918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1191/2402] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:10.169547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96835411-4a46-4e4d-b865-59c5e862bb8a service swift] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:10.170961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-96835411-4a46-4e4d-b865-59c5e862bb8a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:10.219896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:10.291706 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96835411-4a46-4e4d-b865-59c5e862bb8a service swift] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:10.300531 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab9074-38ec-4221-9c1c-fb114e1c7977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:10.301914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab9074-38ec-4221-9c1c-fb114e1c7977 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:10.303011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab9074-38ec-4221-9c1c-fb114e1c7977 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:10.303011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab9074-38ec-4221-9c1c-fb114e1c7977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:10.307266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a7ab9074-38ec-4221-9c1c-fb114e1c7977 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:10.339072 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab9074-38ec-4221-9c1c-fb114e1c7977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:10.341010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab9074-38ec-4221-9c1c-fb114e1c7977 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:10.366039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1212/2403] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:10.819581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc8a90-e263-4c27-acdd-72519e359ca7 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:10.830926 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc8a90-e263-4c27-acdd-72519e359ca7 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:10.835882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:10.837064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:10.837623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:10.838081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] PATH_INFO: `/v3/users/c67da27023144c5ca078752ad4a2a539` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:10.839606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67da27023144c5ca078752ad4a2a539)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:10.842382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:10.947074 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:11.162574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67da27023144c5ca078752ad4a2a539'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:11.279526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67da27023144c5ca078752ad4a2a539'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:11.280164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67da27023144c5ca078752ad4a2a539'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:11.295025 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67da27023144c5ca078752ad4a2a539'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:11.295783 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67da27023144c5ca078752ad4a2a539'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:11.342121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1192/2404] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:06:10 2022] DELETE /identity/v3/users/c67da27023144c5ca078752ad4a2a539 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:11.347993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbb189-246e-425a-9074-3e7459915442 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:11.348848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbb189-246e-425a-9074-3e7459915442 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:11.349296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbb189-246e-425a-9074-3e7459915442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:11.369079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-77fbb189-246e-425a-9074-3e7459915442 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:11.370535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-77fbb189-246e-425a-9074-3e7459915442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:11.478142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1213/2405] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:11.502904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:11.504522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:11.605934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cf3de-20e2-45cd-b710-18ba008f927b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:11.612690 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76657c-396f-467e-8beb-08df589f7da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:11.613722 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76657c-396f-467e-8beb-08df589f7da5 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:11.614519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76657c-396f-467e-8beb-08df589f7da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:11.614959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76657c-396f-467e-8beb-08df589f7da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:11.660772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76657c-396f-467e-8beb-08df589f7da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:11.663075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76657c-396f-467e-8beb-08df589f7da5 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:11.685614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1193/2406] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:12.479416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbb189-246e-425a-9074-3e7459915442 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:12.484657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-77fbb189-246e-425a-9074-3e7459915442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:12.509062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbb189-246e-425a-9074-3e7459915442 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:12.518430 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:12.520129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:12.520608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:12.521210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] PATH_INFO: `/v3/projects/4ed83340d47040949a1847debd8fc1b0` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:12.523408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed83340d47040949a1847debd8fc1b0)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:12.526766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:12.658273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed83340d47040949a1847debd8fc1b0', 'request_id': 'req-aee95a57-5615-453f-b502-0bc1a2cc5520'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:12.782093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed83340d47040949a1847debd8fc1b0', 'request_id': 'req-aee95a57-5615-453f-b502-0bc1a2cc5520'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:12.793061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed83340d47040949a1847debd8fc1b0', 'request_id': 'req-aee95a57-5615-453f-b502-0bc1a2cc5520'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:12.821563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] The token cache is being invalidate because project 4ed83340d47040949a1847debd8fc1b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:12.821882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:12.822944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:12.825931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1214/2407] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:06:12 2022] DELETE /identity/v3/projects/4ed83340d47040949a1847debd8fc1b0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:12.829721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76657c-396f-467e-8beb-08df589f7da5 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:12.844165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76657c-396f-467e-8beb-08df589f7da5 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:12.964698 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabe833-6f46-4ddb-9ff2-70a8632d3c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:12.966056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabe833-6f46-4ddb-9ff2-70a8632d3c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:12.966056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabe833-6f46-4ddb-9ff2-70a8632d3c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:12.966287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabe833-6f46-4ddb-9ff2-70a8632d3c8c admin admin] PATH_INFO: `/v3/users/bcc6e05d93954949bcd58b7fb8705b29` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:12.967500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabe833-6f46-4ddb-9ff2-70a8632d3c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc6e05d93954949bcd58b7fb8705b29)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:12.969966 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabe833-6f46-4ddb-9ff2-70a8632d3c8c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:13.331310 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-fcabe833-6f46-4ddb-9ff2-70a8632d3c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc6e05d93954949bcd58b7fb8705b29'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:13.333313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:13.485622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-fcabe833-6f46-4ddb-9ff2-70a8632d3c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc6e05d93954949bcd58b7fb8705b29'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:13.486303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-fcabe833-6f46-4ddb-9ff2-70a8632d3c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc6e05d93954949bcd58b7fb8705b29'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:13.498510 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-fcabe833-6f46-4ddb-9ff2-70a8632d3c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc6e05d93954949bcd58b7fb8705b29'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:13.499781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-fcabe833-6f46-4ddb-9ff2-70a8632d3c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc6e05d93954949bcd58b7fb8705b29'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:13.530519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1194/2408] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:06:12 2022] DELETE /identity/v3/users/bcc6e05d93954949bcd58b7fb8705b29 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:14.153210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:14.155205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:14.182220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee95a57-5615-453f-b502-0bc1a2cc5520 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:14.238624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:14.268202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac4659-61e9-48f8-b905-6a93ea8d0913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:14.269257 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac4659-61e9-48f8-b905-6a93ea8d0913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:14.269638 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac4659-61e9-48f8-b905-6a93ea8d0913 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:14.269913 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac4659-61e9-48f8-b905-6a93ea8d0913 admin admin] PATH_INFO: `/v3/projects/aff43cf78efe4ea7b3934042eddbabc6` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:14.271175 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac4659-61e9-48f8-b905-6a93ea8d0913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff43cf78efe4ea7b3934042eddbabc6)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:14.273134 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac4659-61e9-48f8-b905-6a93ea8d0913 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:14.489323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-4dac4659-61e9-48f8-b905-6a93ea8d0913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff43cf78efe4ea7b3934042eddbabc6', 'request_id': 'req-4dac4659-61e9-48f8-b905-6a93ea8d0913'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:14.568246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-4dac4659-61e9-48f8-b905-6a93ea8d0913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff43cf78efe4ea7b3934042eddbabc6', 'request_id': 'req-4dac4659-61e9-48f8-b905-6a93ea8d0913'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:14.593414 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-4dac4659-61e9-48f8-b905-6a93ea8d0913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff43cf78efe4ea7b3934042eddbabc6', 'request_id': 'req-4dac4659-61e9-48f8-b905-6a93ea8d0913'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:14.633710 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-4dac4659-61e9-48f8-b905-6a93ea8d0913 admin admin] The token cache is being invalidate because project aff43cf78efe4ea7b3934042eddbabc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:14.634331 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-4dac4659-61e9-48f8-b905-6a93ea8d0913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:14.635602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-4dac4659-61e9-48f8-b905-6a93ea8d0913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:14.639372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1215/2409] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:06:14 2022] DELETE /identity/v3/projects/aff43cf78efe4ea7b3934042eddbabc6 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:14.645040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6cf4f-5202-438c-80f8-ca41c439bfb9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:14.645919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6cf4f-5202-438c-80f8-ca41c439bfb9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:14.645919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6cf4f-5202-438c-80f8-ca41c439bfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:14.685783 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-11b6cf4f-5202-438c-80f8-ca41c439bfb9 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:14.688669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-11b6cf4f-5202-438c-80f8-ca41c439bfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:14.788535 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1195/2410] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:14.801436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccefb56-fe2f-4069-9135-1b7f517aae53 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:14.801436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccefb56-fe2f-4069-9135-1b7f517aae53 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:14.801436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccefb56-fe2f-4069-9135-1b7f517aae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:14.818952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-dccefb56-fe2f-4069-9135-1b7f517aae53 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:14.820282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-dccefb56-fe2f-4069-9135-1b7f517aae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:14.839994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1216/2411] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:14.843095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6cf4f-5202-438c-80f8-ca41c439bfb9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:14.854514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6cf4f-5202-438c-80f8-ca41c439bfb9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:14.874477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5f619-48a9-4a1e-94b2-4b3e2719fee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:14.874693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5f619-48a9-4a1e-94b2-4b3e2719fee9 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:14.875693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5f619-48a9-4a1e-94b2-4b3e2719fee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:14.875978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5f619-48a9-4a1e-94b2-4b3e2719fee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:14.877198 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5f619-48a9-4a1e-94b2-4b3e2719fee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:06:14.877921 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5f619-48a9-4a1e-94b2-4b3e2719fee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:14.880212 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5f619-48a9-4a1e-94b2-4b3e2719fee9 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:14.902739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccefb56-fe2f-4069-9135-1b7f517aae53 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:14.902910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1196/2412] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:06:14.915328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccefb56-fe2f-4069-9135-1b7f517aae53 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:14.927510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d52ef-7539-4101-a9fa-567256731d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:14.928808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d52ef-7539-4101-a9fa-567256731d48 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:14.929348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d52ef-7539-4101-a9fa-567256731d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:14.929837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d52ef-7539-4101-a9fa-567256731d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:14.934296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d52ef-7539-4101-a9fa-567256731d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:14.934296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d52ef-7539-4101-a9fa-567256731d48 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:15.066670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1217/2413] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:14 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:15.069521 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5f619-48a9-4a1e-94b2-4b3e2719fee9 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:15.100681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5f619-48a9-4a1e-94b2-4b3e2719fee9 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:15.257844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cc85e-6d8c-4578-aeec-bf7cbd97300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:15.259254 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cc85e-6d8c-4578-aeec-bf7cbd97300a admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:15.259644 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cc85e-6d8c-4578-aeec-bf7cbd97300a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:15.260253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cc85e-6d8c-4578-aeec-bf7cbd97300a admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:15.261354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cc85e-6d8c-4578-aeec-bf7cbd97300a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:15.263477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cc85e-6d8c-4578-aeec-bf7cbd97300a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:15.365532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1197/2414] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:15 2022] POST /identity/v3/users => generated 292 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:15.372698 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d52ef-7539-4101-a9fa-567256731d48 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:15.391397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d52ef-7539-4101-a9fa-567256731d48 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:15.405813 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76266a1-bc15-4d5d-a0ce-fcba48b3fd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:15.413441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76266a1-bc15-4d5d-a0ce-fcba48b3fd00 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:15.413441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76266a1-bc15-4d5d-a0ce-fcba48b3fd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:15.413441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76266a1-bc15-4d5d-a0ce-fcba48b3fd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:15.413441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76266a1-bc15-4d5d-a0ce-fcba48b3fd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:15.413441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76266a1-bc15-4d5d-a0ce-fcba48b3fd00 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:15.437246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1218/2415] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:15.441489 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cc85e-6d8c-4578-aeec-bf7cbd97300a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:15.461682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cc85e-6d8c-4578-aeec-bf7cbd97300a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:15.470463 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3aaad-6772-4a27-920a-cc2fbba8157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:15.472114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3aaad-6772-4a27-920a-cc2fbba8157c admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:15.472319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3aaad-6772-4a27-920a-cc2fbba8157c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:15.472759 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3aaad-6772-4a27-920a-cc2fbba8157c admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:15.474074 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3aaad-6772-4a27-920a-cc2fbba8157c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:15.476033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3aaad-6772-4a27-920a-cc2fbba8157c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:15.491410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1198/2416] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:15.495499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76266a1-bc15-4d5d-a0ce-fcba48b3fd00 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:15.513838 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76266a1-bc15-4d5d-a0ce-fcba48b3fd00 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:15.527660 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b39acb-4503-4398-96f3-a43bfecd01d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:15.528901 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b39acb-4503-4398-96f3-a43bfecd01d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:15.531987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b39acb-4503-4398-96f3-a43bfecd01d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:15.532352 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b39acb-4503-4398-96f3-a43bfecd01d3 admin admin] PATH_INFO: `/v3/projects/a48153d36a0a4a318410ecded8f48e72/users/62727d74491c40d096f6af9a86368e1b/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:15.557943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b39acb-4503-4398-96f3-a43bfecd01d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48153d36a0a4a318410ecded8f48e72, user_id=62727d74491c40d096f6af9a86368e1b, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:15.562096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b39acb-4503-4398-96f3-a43bfecd01d3 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:15.562654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3aaad-6772-4a27-920a-cc2fbba8157c admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:15.564648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-30e3aaad-6772-4a27-920a-cc2fbba8157c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:15.649267 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:15.696900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3aaad-6772-4a27-920a-cc2fbba8157c admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:15.704426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce4c8c-463c-4f50-8a87-9c5911557b95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619d0b5afa094289808516486a5e3c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:15.707094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce4c8c-463c-4f50-8a87-9c5911557b95 service placement] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:15.708155 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce4c8c-463c-4f50-8a87-9c5911557b95 service placement] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:15.708676 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce4c8c-463c-4f50-8a87-9c5911557b95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:15.712035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4dce4c8c-463c-4f50-8a87-9c5911557b95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:15.738469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce4c8c-463c-4f50-8a87-9c5911557b95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:15.741007 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce4c8c-463c-4f50-8a87-9c5911557b95 service placement] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:15.757480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1199/2417] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:06:15.869542 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1219/2418] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:15 2022] PUT /identity/v3/projects/a48153d36a0a4a318410ecded8f48e72/users/62727d74491c40d096f6af9a86368e1b/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:15.879801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce4c8c-463c-4f50-8a87-9c5911557b95 service placement] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:15.880047 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24ae7a-0f73-4645-8980-f0456074486a None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:15.880350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24ae7a-0f73-4645-8980-f0456074486a None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:15.880786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24ae7a-0f73-4645-8980-f0456074486a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:15.881617 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4dce4c8c-463c-4f50-8a87-9c5911557b95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:15.908850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce4c8c-463c-4f50-8a87-9c5911557b95 service placement] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:15.956182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-ec24ae7a-0f73-4645-8980-f0456074486a None None] MFA Rules not processed for user `62727d74491c40d096f6af9a86368e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:15.962748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ec24ae7a-0f73-4645-8980-f0456074486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:16.021716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b928dc-8e94-4c25-8ad9-a3c0c1a660ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:16.022721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b928dc-8e94-4c25-8ad9-a3c0c1a660ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:16.023070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b928dc-8e94-4c25-8ad9-a3c0c1a660ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:16.023412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b928dc-8e94-4c25-8ad9-a3c0c1a660ac admin admin] PATH_INFO: `/v3/users/c9b5be694ffc4b329af316dc2b23fd18` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:16.024964 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b928dc-8e94-4c25-8ad9-a3c0c1a660ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b5be694ffc4b329af316dc2b23fd18)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:16.028401 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b928dc-8e94-4c25-8ad9-a3c0c1a660ac admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:16.056230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:16.081081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1220/2419] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:16.096245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24ae7a-0f73-4645-8980-f0456074486a None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:16.098055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ec24ae7a-0f73-4645-8980-f0456074486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:16.165633 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24ae7a-0f73-4645-8980-f0456074486a None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:16.171444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7125a28-6fdb-4b8f-bd74-e8a838362705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:16.172101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7125a28-6fdb-4b8f-bd74-e8a838362705 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:16.172384 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7125a28-6fdb-4b8f-bd74-e8a838362705 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:16.172659 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7125a28-6fdb-4b8f-bd74-e8a838362705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:16.184314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7125a28-6fdb-4b8f-bd74-e8a838362705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:16.185897 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7125a28-6fdb-4b8f-bd74-e8a838362705 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:16.195949 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1221/2420] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:06:16.216189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7125a28-6fdb-4b8f-bd74-e8a838362705 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:16.235451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7125a28-6fdb-4b8f-bd74-e8a838362705 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:16.240982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:16.242064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:16.242365 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:16.242646 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] PATH_INFO: `/v3/users/62727d74491c40d096f6af9a86368e1b` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:16.244011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62727d74491c40d096f6af9a86368e1b)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:16.245991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:16.271359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d0b928dc-8e94-4c25-8ad9-a3c0c1a660ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b5be694ffc4b329af316dc2b23fd18'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:16.393268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d0b928dc-8e94-4c25-8ad9-a3c0c1a660ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b5be694ffc4b329af316dc2b23fd18'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:16.393957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d0b928dc-8e94-4c25-8ad9-a3c0c1a660ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b5be694ffc4b329af316dc2b23fd18'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:16.402713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d0b928dc-8e94-4c25-8ad9-a3c0c1a660ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b5be694ffc4b329af316dc2b23fd18'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:16.408113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-d0b928dc-8e94-4c25-8ad9-a3c0c1a660ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b5be694ffc4b329af316dc2b23fd18'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:16.421542 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1200/2421] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:06:15 2022] DELETE /identity/v3/users/c9b5be694ffc4b329af316dc2b23fd18 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:16.504680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62727d74491c40d096f6af9a86368e1b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:16.582039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62727d74491c40d096f6af9a86368e1b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:16.589508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62727d74491c40d096f6af9a86368e1b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:16.591104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62727d74491c40d096f6af9a86368e1b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:16.591104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62727d74491c40d096f6af9a86368e1b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:16.609758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1222/2422] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:06:16 2022] DELETE /identity/v3/users/62727d74491c40d096f6af9a86368e1b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:16.614708 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a225daf-9caf-4ad8-bc4f-a16109eb52a4 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:16.619768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a225daf-9caf-4ad8-bc4f-a16109eb52a4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:16.619768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a225daf-9caf-4ad8-bc4f-a16109eb52a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:16.633957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-4a225daf-9caf-4ad8-bc4f-a16109eb52a4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:16.635168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4a225daf-9caf-4ad8-bc4f-a16109eb52a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:16.686450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:16.688712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:16.696830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1201/2423] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:16.707601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a225daf-9caf-4ad8-bc4f-a16109eb52a4 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:16.709154 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aab1a4-6d64-4904-b99d-e5013f1a2b52 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:16.709296 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4a225daf-9caf-4ad8-bc4f-a16109eb52a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:16.720726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098aeda-7222-4243-aca2-ed33a90016e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:16.722554 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098aeda-7222-4243-aca2-ed33a90016e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:16.723046 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098aeda-7222-4243-aca2-ed33a90016e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:16.723534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098aeda-7222-4243-aca2-ed33a90016e8 admin admin] PATH_INFO: `/v3/projects/fab43db62b7b402f8665fd191f3d4f5e` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:16.725864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098aeda-7222-4243-aca2-ed33a90016e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fab43db62b7b402f8665fd191f3d4f5e)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:16.730007 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098aeda-7222-4243-aca2-ed33a90016e8 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:16.795021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a225daf-9caf-4ad8-bc4f-a16109eb52a4 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:16.798986 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaa7e9-29be-4974-8e6f-2248bff6be95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:16.799844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaa7e9-29be-4974-8e6f-2248bff6be95 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:16.800035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaa7e9-29be-4974-8e6f-2248bff6be95 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:16.800255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaa7e9-29be-4974-8e6f-2248bff6be95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:16.812990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafaa7e9-29be-4974-8e6f-2248bff6be95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:16.815140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafaa7e9-29be-4974-8e6f-2248bff6be95 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:16.832195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1202/2424] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:06:16.850940 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaa7e9-29be-4974-8e6f-2248bff6be95 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:16.852825 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fafaa7e9-29be-4974-8e6f-2248bff6be95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:16.864938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaa7e9-29be-4974-8e6f-2248bff6be95 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:16.889749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5098aeda-7222-4243-aca2-ed33a90016e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fab43db62b7b402f8665fd191f3d4f5e', 'request_id': 'req-5098aeda-7222-4243-aca2-ed33a90016e8'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:16.929706 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cf639-9a12-47c0-b3cc-b37d09ef22fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:16.930419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cf639-9a12-47c0-b3cc-b37d09ef22fa service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:16.930702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cf639-9a12-47c0-b3cc-b37d09ef22fa service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:16.931009 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cf639-9a12-47c0-b3cc-b37d09ef22fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:16.932994 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d24cf639-9a12-47c0-b3cc-b37d09ef22fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:16.992889 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5098aeda-7222-4243-aca2-ed33a90016e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fab43db62b7b402f8665fd191f3d4f5e', 'request_id': 'req-5098aeda-7222-4243-aca2-ed33a90016e8'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:17.001394 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5098aeda-7222-4243-aca2-ed33a90016e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fab43db62b7b402f8665fd191f3d4f5e', 'request_id': 'req-5098aeda-7222-4243-aca2-ed33a90016e8'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:17.003121 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cf639-9a12-47c0-b3cc-b37d09ef22fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:17.004722 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cf639-9a12-47c0-b3cc-b37d09ef22fa service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:17.014149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5098aeda-7222-4243-aca2-ed33a90016e8 admin admin] The token cache is being invalidate because project fab43db62b7b402f8665fd191f3d4f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:17.014736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5098aeda-7222-4243-aca2-ed33a90016e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:17.015118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1203/2425] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:06:17.015456 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5098aeda-7222-4243-aca2-ed33a90016e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:17.017191 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1223/2426] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:06:16 2022] DELETE /identity/v3/projects/fab43db62b7b402f8665fd191f3d4f5e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:17.022151 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e17ad-511f-4258-bdee-223793e7baba None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.022601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e17ad-511f-4258-bdee-223793e7baba None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.022879 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e17ad-511f-4258-bdee-223793e7baba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.046360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-967e17ad-511f-4258-bdee-223793e7baba None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:17.047608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-967e17ad-511f-4258-bdee-223793e7baba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:17.056341 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1204/2427] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:17.070506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed4e6b-b770-4bfd-a08c-be576fb727b9 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.071553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed4e6b-b770-4bfd-a08c-be576fb727b9 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.072744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed4e6b-b770-4bfd-a08c-be576fb727b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.110001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-e5ed4e6b-b770-4bfd-a08c-be576fb727b9 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:17.112237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e5ed4e6b-b770-4bfd-a08c-be576fb727b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:17.139428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e17ad-511f-4258-bdee-223793e7baba None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:17.140276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1224/2428] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:17.154134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e17ad-511f-4258-bdee-223793e7baba None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:17.166513 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b021596-1d03-491e-b410-d65021fbd761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:17.167206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b021596-1d03-491e-b410-d65021fbd761 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.167498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b021596-1d03-491e-b410-d65021fbd761 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.167805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b021596-1d03-491e-b410-d65021fbd761 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.169221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b021596-1d03-491e-b410-d65021fbd761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:06:17.170643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b021596-1d03-491e-b410-d65021fbd761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:17.171264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b021596-1d03-491e-b410-d65021fbd761 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:17.187598 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1205/2429] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:06:17.192130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed4e6b-b770-4bfd-a08c-be576fb727b9 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:17.204505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed4e6b-b770-4bfd-a08c-be576fb727b9 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:17.208981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcc2a6-ef3d-4037-9026-90d9366e0602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:17.210648 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcc2a6-ef3d-4037-9026-90d9366e0602 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.211153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcc2a6-ef3d-4037-9026-90d9366e0602 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.211447 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcc2a6-ef3d-4037-9026-90d9366e0602 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.215222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcc2a6-ef3d-4037-9026-90d9366e0602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:17.217411 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcc2a6-ef3d-4037-9026-90d9366e0602 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:17.315011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1225/2430] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:17 2022] POST /identity/v3/projects => generated 405 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:17.320498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b021596-1d03-491e-b410-d65021fbd761 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:17.331197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b021596-1d03-491e-b410-d65021fbd761 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:17.382194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcc2a6-ef3d-4037-9026-90d9366e0602 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:17.385464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c7dcc2a6-ef3d-4037-9026-90d9366e0602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:17.412586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffed559-5692-47e7-889e-52abb0ed5dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:17.413796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffed559-5692-47e7-889e-52abb0ed5dbb admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.414298 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffed559-5692-47e7-889e-52abb0ed5dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.414804 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffed559-5692-47e7-889e-52abb0ed5dbb admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.416136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffed559-5692-47e7-889e-52abb0ed5dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:17.419989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffed559-5692-47e7-889e-52abb0ed5dbb admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:17.481885 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcc2a6-ef3d-4037-9026-90d9366e0602 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:17.486758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70420c21-d494-4223-ade8-99b6a9b0b676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:17.487619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70420c21-d494-4223-ade8-99b6a9b0b676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.487955 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70420c21-d494-4223-ade8-99b6a9b0b676 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.488540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70420c21-d494-4223-ade8-99b6a9b0b676 admin admin] PATH_INFO: `/v3/projects/a48153d36a0a4a318410ecded8f48e72` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.490027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70420c21-d494-4223-ade8-99b6a9b0b676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a48153d36a0a4a318410ecded8f48e72)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:17.491987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70420c21-d494-4223-ade8-99b6a9b0b676 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:17.535611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1206/2431] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:17 2022] POST /identity/v3/users => generated 303 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:17.539583 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffed559-5692-47e7-889e-52abb0ed5dbb admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:17.550030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffed559-5692-47e7-889e-52abb0ed5dbb admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:17.562585 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab94e2-b529-4780-a54b-c2536f0a2e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:17.563311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab94e2-b529-4780-a54b-c2536f0a2e9b admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.564175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab94e2-b529-4780-a54b-c2536f0a2e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.564175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab94e2-b529-4780-a54b-c2536f0a2e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.564678 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab94e2-b529-4780-a54b-c2536f0a2e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:17.566438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab94e2-b529-4780-a54b-c2536f0a2e9b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:17.578716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1207/2432] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:17.582841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab94e2-b529-4780-a54b-c2536f0a2e9b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:17.594494 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab94e2-b529-4780-a54b-c2536f0a2e9b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:17.599294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bc40a-d2e6-4d30-950b-3840741b0184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:17.600009 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bc40a-d2e6-4d30-950b-3840741b0184 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.600281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bc40a-d2e6-4d30-950b-3840741b0184 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.600565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bc40a-d2e6-4d30-950b-3840741b0184 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.601294 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bc40a-d2e6-4d30-950b-3840741b0184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:17.602948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bc40a-d2e6-4d30-950b-3840741b0184 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:17.614785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1208/2433] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:17.619287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bc40a-d2e6-4d30-950b-3840741b0184 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:17.623036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-70420c21-d494-4223-ade8-99b6a9b0b676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a48153d36a0a4a318410ecded8f48e72', 'request_id': 'req-70420c21-d494-4223-ade8-99b6a9b0b676'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:17.635990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bc40a-d2e6-4d30-950b-3840741b0184 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:17.693973 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf9139-d7b7-4ad4-b945-b1824644cb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:17.695040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9139-d7b7-4ad4-b945-b1824644cb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.695428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9139-d7b7-4ad4-b945-b1824644cb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.695810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9139-d7b7-4ad4-b945-b1824644cb49 admin admin] PATH_INFO: `/v3/projects/7516bd071aa140daa6c4a8cfb12a0a7b/users/c72d3a086c3b4e8b885f19d5e07dec91/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.707971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-70420c21-d494-4223-ade8-99b6a9b0b676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a48153d36a0a4a318410ecded8f48e72', 'request_id': 'req-70420c21-d494-4223-ade8-99b6a9b0b676'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:17.711622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf9139-d7b7-4ad4-b945-b1824644cb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7516bd071aa140daa6c4a8cfb12a0a7b, user_id=c72d3a086c3b4e8b885f19d5e07dec91, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:17.714450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-70420c21-d494-4223-ade8-99b6a9b0b676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a48153d36a0a4a318410ecded8f48e72', 'request_id': 'req-70420c21-d494-4223-ade8-99b6a9b0b676'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:17.716387 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf9139-d7b7-4ad4-b945-b1824644cb49 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:17.727321 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-70420c21-d494-4223-ade8-99b6a9b0b676 admin admin] The token cache is being invalidate because project a48153d36a0a4a318410ecded8f48e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:17.727651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-70420c21-d494-4223-ade8-99b6a9b0b676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:17.728506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-70420c21-d494-4223-ade8-99b6a9b0b676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:17.730136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1226/2434] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:06:17 2022] DELETE /identity/v3/projects/a48153d36a0a4a318410ecded8f48e72 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:17.735970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c937eb-c4f2-47d7-ba0a-2f729be5e2bc None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.736466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c937eb-c4f2-47d7-ba0a-2f729be5e2bc None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.737001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c937eb-c4f2-47d7-ba0a-2f729be5e2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.742615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:17.760388 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-e6c937eb-c4f2-47d7-ba0a-2f729be5e2bc None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:17.761781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e6c937eb-c4f2-47d7-ba0a-2f729be5e2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:17.770039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1227/2435] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:17.778821 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70853cc0-f78f-4d0e-9c76-41b8b05633bf None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.779457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70853cc0-f78f-4d0e-9c76-41b8b05633bf None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.779866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70853cc0-f78f-4d0e-9c76-41b8b05633bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.798414 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-70853cc0-f78f-4d0e-9c76-41b8b05633bf None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:17.799651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-70853cc0-f78f-4d0e-9c76-41b8b05633bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:17.807640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1228/2436] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:17.813553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70853cc0-f78f-4d0e-9c76-41b8b05633bf None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:17.824670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70853cc0-f78f-4d0e-9c76-41b8b05633bf None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:17.832946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1209/2437] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:17 2022] PUT /identity/v3/projects/7516bd071aa140daa6c4a8cfb12a0a7b/users/c72d3a086c3b4e8b885f19d5e07dec91/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:17.844112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c17ad-132a-425a-995f-37867f43a3ce None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.844593 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c17ad-132a-425a-995f-37867f43a3ce None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.844961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c17ad-132a-425a-995f-37867f43a3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.878068 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-f42c17ad-132a-425a-995f-37867f43a3ce None None] MFA Rules not processed for user `c72d3a086c3b4e8b885f19d5e07dec91`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:17.879461 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f42c17ad-132a-425a-995f-37867f43a3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:17.893570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436286a-933b-4c60-b061-a77a02c7d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:17.894430 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436286a-933b-4c60-b061-a77a02c7d6cd admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.894802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436286a-933b-4c60-b061-a77a02c7d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.895086 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436286a-933b-4c60-b061-a77a02c7d6cd admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.895960 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436286a-933b-4c60-b061-a77a02c7d6cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:06:17.896276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436286a-933b-4c60-b061-a77a02c7d6cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:17.897994 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436286a-933b-4c60-b061-a77a02c7d6cd admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:17.915575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1229/2438] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:06:17.916537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436286a-933b-4c60-b061-a77a02c7d6cd admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:17.929095 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436286a-933b-4c60-b061-a77a02c7d6cd admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:17.935097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f8583-b46e-4451-aaad-3e1d9764222c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:17.937850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f8583-b46e-4451-aaad-3e1d9764222c admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.937850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f8583-b46e-4451-aaad-3e1d9764222c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.937850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f8583-b46e-4451-aaad-3e1d9764222c admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.937850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f8583-b46e-4451-aaad-3e1d9764222c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:17.938993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f8583-b46e-4451-aaad-3e1d9764222c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:17.956164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1210/2439] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:17.960532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c17ad-132a-425a-995f-37867f43a3ce None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:17.962318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f42c17ad-132a-425a-995f-37867f43a3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:17.976338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c17ad-132a-425a-995f-37867f43a3ce None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:17.981649 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e360448-017e-4b55-8e23-f92c77454135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:17.982303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e360448-017e-4b55-8e23-f92c77454135 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:17.982584 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e360448-017e-4b55-8e23-f92c77454135 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:17.982864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e360448-017e-4b55-8e23-f92c77454135 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:17.983667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e360448-017e-4b55-8e23-f92c77454135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:17.985531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e360448-017e-4b55-8e23-f92c77454135 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:18.029963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:18.037675 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1230/2440] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:17 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:18.041673 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f8583-b46e-4451-aaad-3e1d9764222c admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:18.097002 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1211/2441] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:17 2022] POST /identity/v3/projects => generated 403 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:18.100705 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e360448-017e-4b55-8e23-f92c77454135 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:18.121924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f8583-b46e-4451-aaad-3e1d9764222c admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:18.207243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e360448-017e-4b55-8e23-f92c77454135 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:18.212181 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfad37-ef88-4707-94c1-3d6fe6491a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:18.212842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfad37-ef88-4707-94c1-3d6fe6491a2a admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:18.213180 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfad37-ef88-4707-94c1-3d6fe6491a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:18.213516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfad37-ef88-4707-94c1-3d6fe6491a2a admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:18.214270 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfad37-ef88-4707-94c1-3d6fe6491a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:18.217189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ed4d-76ea-487e-aead-f4b849436c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:18.217395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfad37-ef88-4707-94c1-3d6fe6491a2a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:18.218458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ed4d-76ea-487e-aead-f4b849436c8c admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:18.219074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ed4d-76ea-487e-aead-f4b849436c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:18.219357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ed4d-76ea-487e-aead-f4b849436c8c admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:18.220096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601ed4d-76ea-487e-aead-f4b849436c8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:18.222227 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601ed4d-76ea-487e-aead-f4b849436c8c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:18.383431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1212/2442] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:18 2022] POST /identity/v3/users => generated 308 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:18.387471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfad37-ef88-4707-94c1-3d6fe6491a2a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:18.398400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfad37-ef88-4707-94c1-3d6fe6491a2a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:18.404090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b762e66-e8de-43f0-be3b-d9c9e2108680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:18.404789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b762e66-e8de-43f0-be3b-d9c9e2108680 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:18.405070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b762e66-e8de-43f0-be3b-d9c9e2108680 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:18.405346 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b762e66-e8de-43f0-be3b-d9c9e2108680 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:18.406118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b762e66-e8de-43f0-be3b-d9c9e2108680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:18.407805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b762e66-e8de-43f0-be3b-d9c9e2108680 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:18.423464 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1213/2443] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:18.424424 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b762e66-e8de-43f0-be3b-d9c9e2108680 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:18.424629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1231/2444] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:18 2022] POST /identity/v3/users => generated 292 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:18.428784 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ed4d-76ea-487e-aead-f4b849436c8c admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:18.435744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b762e66-e8de-43f0-be3b-d9c9e2108680 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:18.439258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ed4d-76ea-487e-aead-f4b849436c8c admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:18.440779 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55acbb1-b3ae-415e-a0f7-faba53211d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:18.441815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55acbb1-b3ae-415e-a0f7-faba53211d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:18.442017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55acbb1-b3ae-415e-a0f7-faba53211d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:18.442293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55acbb1-b3ae-415e-a0f7-faba53211d21 admin admin] PATH_INFO: `/v3/projects/66db1b2e6d204dc7a8d259f30013c8cc/users/8337c53794c4420f9e414ec320187412/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:18.444192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a42b6-d48a-4c04-b56d-9d8f92de9a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:18.444997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a42b6-d48a-4c04-b56d-9d8f92de9a1e admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:18.445282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a42b6-d48a-4c04-b56d-9d8f92de9a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:18.445770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a42b6-d48a-4c04-b56d-9d8f92de9a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:18.446735 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a42b6-d48a-4c04-b56d-9d8f92de9a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:18.448304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a42b6-d48a-4c04-b56d-9d8f92de9a1e admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:18.459366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55acbb1-b3ae-415e-a0f7-faba53211d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66db1b2e6d204dc7a8d259f30013c8cc, user_id=8337c53794c4420f9e414ec320187412, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:18.464221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1232/2445] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:18.464399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55acbb1-b3ae-415e-a0f7-faba53211d21 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:18.466294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a42b6-d48a-4c04-b56d-9d8f92de9a1e admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:18.476936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a42b6-d48a-4c04-b56d-9d8f92de9a1e admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:18.482816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3620556-4b3a-41a9-8259-3464c918ad3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:18.483511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3620556-4b3a-41a9-8259-3464c918ad3b admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:18.483794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3620556-4b3a-41a9-8259-3464c918ad3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:18.484069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3620556-4b3a-41a9-8259-3464c918ad3b admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:18.484801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3620556-4b3a-41a9-8259-3464c918ad3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:18.486536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3620556-4b3a-41a9-8259-3464c918ad3b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:18.498821 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1233/2446] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:18.506825 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3620556-4b3a-41a9-8259-3464c918ad3b admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:18.518912 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3620556-4b3a-41a9-8259-3464c918ad3b admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:18.524255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa1771-25c6-48c0-b92d-e8e84355513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:18.525111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1771-25c6-48c0-b92d-e8e84355513b admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:18.525424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1771-25c6-48c0-b92d-e8e84355513b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:18.525711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1771-25c6-48c0-b92d-e8e84355513b admin admin] PATH_INFO: `/v3/projects/56affffa13a948ba919e78bcac8ebc27/users/f932a6579f0244e38e3c63f5671f6085/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:18.544060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa1771-25c6-48c0-b92d-e8e84355513b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56affffa13a948ba919e78bcac8ebc27, user_id=f932a6579f0244e38e3c63f5671f6085, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:18.547005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa1771-25c6-48c0-b92d-e8e84355513b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:18.570830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1214/2447] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:18 2022] PUT /identity/v3/projects/66db1b2e6d204dc7a8d259f30013c8cc/users/8337c53794c4420f9e414ec320187412/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:18.575414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55acbb1-b3ae-415e-a0f7-faba53211d21 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:18.623282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1234/2448] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:18 2022] PUT /identity/v3/projects/56affffa13a948ba919e78bcac8ebc27/users/f932a6579f0244e38e3c63f5671f6085/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:18.633415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf985dd-e4d5-4ebc-bddc-ebaa1b0a87d4 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:18.633722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf985dd-e4d5-4ebc-bddc-ebaa1b0a87d4 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:18.634005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf985dd-e4d5-4ebc-bddc-ebaa1b0a87d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:18.659184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55acbb1-b3ae-415e-a0f7-faba53211d21 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:18.666478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-abf985dd-e4d5-4ebc-bddc-ebaa1b0a87d4 None None] MFA Rules not processed for user `f932a6579f0244e38e3c63f5671f6085`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:18.667887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-abf985dd-e4d5-4ebc-bddc-ebaa1b0a87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:18.682956 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:18.735691 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1235/2449] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:18.747532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf985dd-e4d5-4ebc-bddc-ebaa1b0a87d4 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:18.749073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-abf985dd-e4d5-4ebc-bddc-ebaa1b0a87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:18.764630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d8727-1077-486d-9df2-0215f7b996c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:18.765797 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d8727-1077-486d-9df2-0215f7b996c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:18.766305 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d8727-1077-486d-9df2-0215f7b996c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:18.768136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d8727-1077-486d-9df2-0215f7b996c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:18.768136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d8727-1077-486d-9df2-0215f7b996c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:18.770563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:18.770784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d8727-1077-486d-9df2-0215f7b996c3 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:18.786969 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1215/2450] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:18.787899 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d8727-1077-486d-9df2-0215f7b996c3 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:18.795577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:18.800146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d8727-1077-486d-9df2-0215f7b996c3 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:18.807224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806431d-99d6-4131-bf0f-c25078ac7cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:18.807224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806431d-99d6-4131-bf0f-c25078ac7cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:18.807224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806431d-99d6-4131-bf0f-c25078ac7cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:18.807224 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806431d-99d6-4131-bf0f-c25078ac7cc5 admin admin] PATH_INFO: `/v3/projects/66db1b2e6d204dc7a8d259f30013c8cc/users/8337c53794c4420f9e414ec320187412/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:18.809473 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806431d-99d6-4131-bf0f-c25078ac7cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66db1b2e6d204dc7a8d259f30013c8cc, user_id=8337c53794c4420f9e414ec320187412, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:18.812211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806431d-99d6-4131-bf0f-c25078ac7cc5 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:18.816354 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf985dd-e4d5-4ebc-bddc-ebaa1b0a87d4 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:18.821056 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc37905-8396-4bd2-8f29-7620caad51aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:18.821768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc37905-8396-4bd2-8f29-7620caad51aa service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:18.822286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc37905-8396-4bd2-8f29-7620caad51aa service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:18.822412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc37905-8396-4bd2-8f29-7620caad51aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:18.823680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1216/2451] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:18 2022] PUT /identity/v3/projects/66db1b2e6d204dc7a8d259f30013c8cc/users/8337c53794c4420f9e414ec320187412/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:18.832311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc37905-8396-4bd2-8f29-7620caad51aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:18.833763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc37905-8396-4bd2-8f29-7620caad51aa service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:18.838306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c068d90-bd34-4b12-abec-736b91530461 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:18.838593 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c068d90-bd34-4b12-abec-736b91530461 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:18.839026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c068d90-bd34-4b12-abec-736b91530461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:18.845525 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1236/2452] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:06:18.985000 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-0c068d90-bd34-4b12-abec-736b91530461 None None] MFA Rules not processed for user `8337c53794c4420f9e414ec320187412`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:18.987209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0c068d90-bd34-4b12-abec-736b91530461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:19.077569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1217/2453] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:19.096207 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc37905-8396-4bd2-8f29-7620caad51aa service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:19.099273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-cbc37905-8396-4bd2-8f29-7620caad51aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:19.111767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc37905-8396-4bd2-8f29-7620caad51aa service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:19.191834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c4f02-df9b-4f6d-8d7c-d57ce376683c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:19.192704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4f02-df9b-4f6d-8d7c-d57ce376683c service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:19.193126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4f02-df9b-4f6d-8d7c-d57ce376683c service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:19.193559 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4f02-df9b-4f6d-8d7c-d57ce376683c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:19.208439 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c4f02-df9b-4f6d-8d7c-d57ce376683c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:19.214176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c4f02-df9b-4f6d-8d7c-d57ce376683c service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:19.223451 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1237/2454] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:19.340839 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:19.379832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c068d90-bd34-4b12-abec-736b91530461 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:19.434206 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:19.452413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c068d90-bd34-4b12-abec-736b91530461 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:19.457436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:19.458352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:19.458628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:19.458905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] PATH_INFO: `/v3/users/c72d3a086c3b4e8b885f19d5e07dec91` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:19.460106 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c72d3a086c3b4e8b885f19d5e07dec91)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:19.462140 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:19.689552 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c72d3a086c3b4e8b885f19d5e07dec91'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:19.762973 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c72d3a086c3b4e8b885f19d5e07dec91'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:19.762973 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c72d3a086c3b4e8b885f19d5e07dec91'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:19.768723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c72d3a086c3b4e8b885f19d5e07dec91'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:19.770737 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c72d3a086c3b4e8b885f19d5e07dec91'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:19.805741 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1218/2455] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:06:19 2022] DELETE /identity/v3/users/c72d3a086c3b4e8b885f19d5e07dec91 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:19.812406 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8309be-78c8-484b-8a81-c4de78085397 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:19.813201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8309be-78c8-484b-8a81-c4de78085397 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:19.813201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8309be-78c8-484b-8a81-c4de78085397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:19.814964 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:19.842561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-ef8309be-78c8-484b-8a81-c4de78085397 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:19.846899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ef8309be-78c8-484b-8a81-c4de78085397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:19.962536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:20.001699 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1238/2456] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:20.011752 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:20.013502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:20.083931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3068522-cef7-4d43-95cf-157b619ca4b8 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:20.087623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d88ec-6b3c-4315-bb47-b52aea5f4ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:20.088228 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d88ec-6b3c-4315-bb47-b52aea5f4ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:20.088508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d88ec-6b3c-4315-bb47-b52aea5f4ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:20.088780 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d88ec-6b3c-4315-bb47-b52aea5f4ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:20.099074 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d88ec-6b3c-4315-bb47-b52aea5f4ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:20.100836 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d88ec-6b3c-4315-bb47-b52aea5f4ea4 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:20.111744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1219/2457] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:20.655937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8309be-78c8-484b-8a81-c4de78085397 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:20.665431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ef8309be-78c8-484b-8a81-c4de78085397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:20.681224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8309be-78c8-484b-8a81-c4de78085397 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:20.687707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:20.688464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:20.688749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:20.689026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] PATH_INFO: `/v3/projects/7516bd071aa140daa6c4a8cfb12a0a7b` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:20.693656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7516bd071aa140daa6c4a8cfb12a0a7b)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:20.697346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:20.844496 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7516bd071aa140daa6c4a8cfb12a0a7b', 'request_id': 'req-930420a7-d971-4db5-8ca8-401bf272f784'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:20.996114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7516bd071aa140daa6c4a8cfb12a0a7b', 'request_id': 'req-930420a7-d971-4db5-8ca8-401bf272f784'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.004915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7516bd071aa140daa6c4a8cfb12a0a7b', 'request_id': 'req-930420a7-d971-4db5-8ca8-401bf272f784'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.023627 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] The token cache is being invalidate because project 7516bd071aa140daa6c4a8cfb12a0a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:21.023924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.024600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.027163 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1239/2458] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:06:20 2022] DELETE /identity/v3/projects/7516bd071aa140daa6c4a8cfb12a0a7b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:21.032740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d88ec-6b3c-4315-bb47-b52aea5f4ea4 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:21.052003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d88ec-6b3c-4315-bb47-b52aea5f4ea4 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:21.153137 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:21.154090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:21.154375 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:21.154712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] PATH_INFO: `/v3/users/8337c53794c4420f9e414ec320187412` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:21.158051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8337c53794c4420f9e414ec320187412)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:21.160332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:21.432686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:21.434677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:21.450531 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930420a7-d971-4db5-8ca8-401bf272f784 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:21.455667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:21.456572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:21.465366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:21.465366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] PATH_INFO: `/v3/users/3c5b1c6778f74c0d8db93e3a29935480` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:21.465366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5b1c6778f74c0d8db93e3a29935480)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:21.465366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:21.528088 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8337c53794c4420f9e414ec320187412'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.610177 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8337c53794c4420f9e414ec320187412'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.610756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8337c53794c4420f9e414ec320187412'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.618785 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8337c53794c4420f9e414ec320187412'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.620048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8337c53794c4420f9e414ec320187412'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.622046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:21.639319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1220/2459] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:06:21 2022] DELETE /identity/v3/users/8337c53794c4420f9e414ec320187412 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:21.730379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5b1c6778f74c0d8db93e3a29935480'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.808138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5b1c6778f74c0d8db93e3a29935480'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.816711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5b1c6778f74c0d8db93e3a29935480'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.818517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5b1c6778f74c0d8db93e3a29935480'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.818517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5b1c6778f74c0d8db93e3a29935480'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:21.843521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1240/2460] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:06:21 2022] DELETE /identity/v3/users/3c5b1c6778f74c0d8db93e3a29935480 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:22.139173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:22.141003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:22.225734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f686640-36fe-40ba-9ac9-ab6624368139 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:22.225917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:22.226630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:22.274900 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:22.307044 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:22.309350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:22.310005 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:22.310657 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] PATH_INFO: `/v3/projects/66db1b2e6d204dc7a8d259f30013c8cc` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:22.312741 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66db1b2e6d204dc7a8d259f30013c8cc)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:22.316896 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:22.327920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d6d2a-a8ce-4425-9815-805c73c5a48a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:22.341157 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:22.342138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:22.342422 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:22.342696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32 admin admin] PATH_INFO: `/v3/projects/754999c4bc534bba908edc1249b29a73` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:22.344017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=754999c4bc534bba908edc1249b29a73)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:22.346102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:22.468488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66db1b2e6d204dc7a8d259f30013c8cc', 'request_id': 'req-b22d4f21-3c34-484c-ab7a-89cd12ff3797'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:22.503319 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754999c4bc534bba908edc1249b29a73', 'request_id': 'req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:22.562608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66db1b2e6d204dc7a8d259f30013c8cc', 'request_id': 'req-b22d4f21-3c34-484c-ab7a-89cd12ff3797'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:22.572989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66db1b2e6d204dc7a8d259f30013c8cc', 'request_id': 'req-b22d4f21-3c34-484c-ab7a-89cd12ff3797'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:22.592823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] The token cache is being invalidate because project 66db1b2e6d204dc7a8d259f30013c8cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:22.593310 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:22.594394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:22.597304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1221/2461] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:06:22 2022] DELETE /identity/v3/projects/66db1b2e6d204dc7a8d259f30013c8cc => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:22.598694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:22.600046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:22.624727 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:22.648341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754999c4bc534bba908edc1249b29a73', 'request_id': 'req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:22.655799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754999c4bc534bba908edc1249b29a73', 'request_id': 'req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:22.668497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32 admin admin] The token cache is being invalidate because project 754999c4bc534bba908edc1249b29a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:22.673185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:22.673185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-bce8e791-cf5c-4c82-a2a4-a35f4ecf2e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:22.673528 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d4f21-3c34-484c-ab7a-89cd12ff3797 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:22.673640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1241/2462] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:06:22 2022] DELETE /identity/v3/projects/754999c4bc534bba908edc1249b29a73 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:22.675650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1afec-1c94-44d8-af62-fcb0d4930ee1 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:22.676584 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1afec-1c94-44d8-af62-fcb0d4930ee1 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:22.676729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1afec-1c94-44d8-af62-fcb0d4930ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:22.704827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-9dc1afec-1c94-44d8-af62-fcb0d4930ee1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:22.706203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-9dc1afec-1c94-44d8-af62-fcb0d4930ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:22.737844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:22.739295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:22.739816 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:22.739967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] PATH_INFO: `/v3/users/f932a6579f0244e38e3c63f5671f6085` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:22.741111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f932a6579f0244e38e3c63f5671f6085)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:22.743084 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:22.779950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1242/2463] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:22.781584 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82710d9b-6eb8-49e5-9c1e-30cd46d147cd None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:22.781878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82710d9b-6eb8-49e5-9c1e-30cd46d147cd None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:22.782169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82710d9b-6eb8-49e5-9c1e-30cd46d147cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:22.801760 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-82710d9b-6eb8-49e5-9c1e-30cd46d147cd None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:22.803001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-82710d9b-6eb8-49e5-9c1e-30cd46d147cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:22.811234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1243/2464] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:22.812689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38e5e6-f0ba-490a-8ccc-ebf0f302a268 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:22.812977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38e5e6-f0ba-490a-8ccc-ebf0f302a268 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:22.813256 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38e5e6-f0ba-490a-8ccc-ebf0f302a268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:22.833677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-8e38e5e6-f0ba-490a-8ccc-ebf0f302a268 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:22.836963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8e38e5e6-f0ba-490a-8ccc-ebf0f302a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:22.843884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1244/2465] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:22.845190 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022b949-ea15-4a54-a3fd-e87034ac0e5e None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:22.845532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022b949-ea15-4a54-a3fd-e87034ac0e5e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:22.845809 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022b949-ea15-4a54-a3fd-e87034ac0e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:22.866065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-a022b949-ea15-4a54-a3fd-e87034ac0e5e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:22.867366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a022b949-ea15-4a54-a3fd-e87034ac0e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:22.876219 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1245/2466] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:22.877236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022b949-ea15-4a54-a3fd-e87034ac0e5e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:22.889057 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022b949-ea15-4a54-a3fd-e87034ac0e5e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:22.894184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566674ff-686f-4b35-bcea-c0ed1099807a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:22.894855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566674ff-686f-4b35-bcea-c0ed1099807a admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:22.895146 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566674ff-686f-4b35-bcea-c0ed1099807a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:22.895417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566674ff-686f-4b35-bcea-c0ed1099807a admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:22.896176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566674ff-686f-4b35-bcea-c0ed1099807a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:06:22.896482 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566674ff-686f-4b35-bcea-c0ed1099807a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:22.898158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566674ff-686f-4b35-bcea-c0ed1099807a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:22.911705 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1246/2467] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:06:22.912579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566674ff-686f-4b35-bcea-c0ed1099807a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:22.924533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566674ff-686f-4b35-bcea-c0ed1099807a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:22.929513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7877e6-7bfd-46ed-8982-237a97428624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:22.930213 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7877e6-7bfd-46ed-8982-237a97428624 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:22.930493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7877e6-7bfd-46ed-8982-237a97428624 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:22.930783 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7877e6-7bfd-46ed-8982-237a97428624 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:22.931497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7877e6-7bfd-46ed-8982-237a97428624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:06:22.931802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7877e6-7bfd-46ed-8982-237a97428624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:22.933967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7877e6-7bfd-46ed-8982-237a97428624 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:22.947265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1247/2468] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:06:22.948265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7877e6-7bfd-46ed-8982-237a97428624 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:22.959921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7877e6-7bfd-46ed-8982-237a97428624 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:22.965300 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fb77e-4cd9-41f6-9603-9bb1ddd49d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:22.966034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fb77e-4cd9-41f6-9603-9bb1ddd49d6b admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:22.966279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fb77e-4cd9-41f6-9603-9bb1ddd49d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:22.966559 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fb77e-4cd9-41f6-9603-9bb1ddd49d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:22.967250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fb77e-4cd9-41f6-9603-9bb1ddd49d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:22.969228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fb77e-4cd9-41f6-9603-9bb1ddd49d6b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:22.975257 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f932a6579f0244e38e3c63f5671f6085'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:22.985150 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:23.050563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f932a6579f0244e38e3c63f5671f6085'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:23.051315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f932a6579f0244e38e3c63f5671f6085'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:23.060741 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f932a6579f0244e38e3c63f5671f6085'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:23.061542 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f932a6579f0244e38e3c63f5671f6085'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:23.082526 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1222/2469] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:06:22 2022] DELETE /identity/v3/users/f932a6579f0244e38e3c63f5671f6085 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:23.085255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:23.085255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:23.125139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1248/2470] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:22 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:23.127933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25447-73cd-45ac-98af-37c693d8ec67 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.128530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25447-73cd-45ac-98af-37c693d8ec67 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.129026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25447-73cd-45ac-98af-37c693d8ec67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.145746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:23.152910 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-e2e25447-73cd-45ac-98af-37c693d8ec67 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:23.154198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e2e25447-73cd-45ac-98af-37c693d8ec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:23.165395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192e8ef-3e0e-4dc1-8a9b-82bdb6e474e7 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:23.229739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1249/2471] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:23.231283 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e25447-73cd-45ac-98af-37c693d8ec67 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:23.235933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e2e25447-73cd-45ac-98af-37c693d8ec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:23.237712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7898e5-5d57-4b19-885b-5c07f4c6bad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:23.239220 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7898e5-5d57-4b19-885b-5c07f4c6bad9 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.240906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7898e5-5d57-4b19-885b-5c07f4c6bad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.241506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7898e5-5d57-4b19-885b-5c07f4c6bad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.242300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7898e5-5d57-4b19-885b-5c07f4c6bad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:23.244288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7898e5-5d57-4b19-885b-5c07f4c6bad9 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:23.253167 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e25447-73cd-45ac-98af-37c693d8ec67 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:23.259119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59010a25-dc82-4369-bcc7-91acedd5adf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:23.260073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59010a25-dc82-4369-bcc7-91acedd5adf5 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.260288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59010a25-dc82-4369-bcc7-91acedd5adf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.260692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59010a25-dc82-4369-bcc7-91acedd5adf5 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.262095 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59010a25-dc82-4369-bcc7-91acedd5adf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:23.264054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59010a25-dc82-4369-bcc7-91acedd5adf5 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:23.365982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1223/2472] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:23 2022] POST /identity/v3/projects => generated 367 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:23.366895 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7898e5-5d57-4b19-885b-5c07f4c6bad9 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:23.368656 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fc7898e5-5d57-4b19-885b-5c07f4c6bad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:23.403604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1250/2473] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:23 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:23.403604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59010a25-dc82-4369-bcc7-91acedd5adf5 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:23.412255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59010a25-dc82-4369-bcc7-91acedd5adf5 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:23.456146 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7898e5-5d57-4b19-885b-5c07f4c6bad9 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:23.461592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a841ee0-091c-427d-84d5-6e3af2032992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:23.462468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a841ee0-091c-427d-84d5-6e3af2032992 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.462872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a841ee0-091c-427d-84d5-6e3af2032992 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.463243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a841ee0-091c-427d-84d5-6e3af2032992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.485989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a74c9-1f12-4c48-8728-f67a7254de1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:23.486766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a74c9-1f12-4c48-8728-f67a7254de1d admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.487151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a74c9-1f12-4c48-8728-f67a7254de1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.487530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a74c9-1f12-4c48-8728-f67a7254de1d admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.488526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a74c9-1f12-4c48-8728-f67a7254de1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:23.491299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a74c9-1f12-4c48-8728-f67a7254de1d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:23.543331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a841ee0-091c-427d-84d5-6e3af2032992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:23.544910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a841ee0-091c-427d-84d5-6e3af2032992 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:23.555623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1224/2474] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:23.556495 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a841ee0-091c-427d-84d5-6e3af2032992 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:23.568111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a841ee0-091c-427d-84d5-6e3af2032992 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:23.574724 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed401933-e433-4389-b630-516c61703792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:23.575796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed401933-e433-4389-b630-516c61703792 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.576175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed401933-e433-4389-b630-516c61703792 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.576541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed401933-e433-4389-b630-516c61703792 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.577404 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed401933-e433-4389-b630-516c61703792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:23.579329 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed401933-e433-4389-b630-516c61703792 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:23.593463 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1225/2475] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:23.597637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed401933-e433-4389-b630-516c61703792 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:23.608370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed401933-e433-4389-b630-516c61703792 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:23.619097 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1251/2476] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:23 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:23.621504 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33392ac0-b67d-47ef-b084-c64198437e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:23.622975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33392ac0-b67d-47ef-b084-c64198437e64 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.623321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33392ac0-b67d-47ef-b084-c64198437e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.623878 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33392ac0-b67d-47ef-b084-c64198437e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.624119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a74c9-1f12-4c48-8728-f67a7254de1d admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:23.625328 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33392ac0-b67d-47ef-b084-c64198437e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:23.628458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33392ac0-b67d-47ef-b084-c64198437e64 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:23.637223 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a74c9-1f12-4c48-8728-f67a7254de1d admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:23.643340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0132d6-0f45-40de-adac-06452733f281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:23.644073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0132d6-0f45-40de-adac-06452733f281 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.644358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0132d6-0f45-40de-adac-06452733f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.645176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0132d6-0f45-40de-adac-06452733f281 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.645975 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0132d6-0f45-40de-adac-06452733f281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:23.647619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0132d6-0f45-40de-adac-06452733f281 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:23.650085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1226/2477] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:23.654207 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33392ac0-b67d-47ef-b084-c64198437e64 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:23.664324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1252/2478] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:23.668734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33392ac0-b67d-47ef-b084-c64198437e64 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:23.669236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0132d6-0f45-40de-adac-06452733f281 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:23.674395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50364d0-6326-470f-8467-8bdddece9ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:23.675378 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50364d0-6326-470f-8467-8bdddece9ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.675670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50364d0-6326-470f-8467-8bdddece9ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.675940 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50364d0-6326-470f-8467-8bdddece9ec1 admin admin] PATH_INFO: `/v3/projects/b5013291ea9c40dd9b9462fd8abe641b/users/da7293ac7a4e4fec8495864e3f59bf4c/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.678987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:23.681849 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0132d6-0f45-40de-adac-06452733f281 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:23.687785 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183219f-ade9-47a9-8931-edcf7f43614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:23.688508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183219f-ade9-47a9-8931-edcf7f43614e admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.690352 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183219f-ade9-47a9-8931-edcf7f43614e admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.690352 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183219f-ade9-47a9-8931-edcf7f43614e admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.690352 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183219f-ade9-47a9-8931-edcf7f43614e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:23.691560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183219f-ade9-47a9-8931-edcf7f43614e admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:23.695523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50364d0-6326-470f-8467-8bdddece9ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5013291ea9c40dd9b9462fd8abe641b, user_id=da7293ac7a4e4fec8495864e3f59bf4c, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:23.698265 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50364d0-6326-470f-8467-8bdddece9ec1 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:23.704124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1253/2479] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:23.708333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183219f-ade9-47a9-8931-edcf7f43614e admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:23.719569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183219f-ade9-47a9-8931-edcf7f43614e admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:23.724612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ed900-9510-4138-8e5f-6eeb086a8bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:23.725552 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ed900-9510-4138-8e5f-6eeb086a8bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.725849 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ed900-9510-4138-8e5f-6eeb086a8bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.726131 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ed900-9510-4138-8e5f-6eeb086a8bc3 admin admin] PATH_INFO: `/v3/projects/8d0bf42a1c7e4db684176530c432bd0e/users/48b8807667234e56a326d12742698921/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.747864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ed900-9510-4138-8e5f-6eeb086a8bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0bf42a1c7e4db684176530c432bd0e, user_id=48b8807667234e56a326d12742698921, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:23.747864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ed900-9510-4138-8e5f-6eeb086a8bc3 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:23.778729 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1227/2480] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:23 2022] PUT /identity/v3/projects/b5013291ea9c40dd9b9462fd8abe641b/users/da7293ac7a4e4fec8495864e3f59bf4c/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:23.792239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e232e-ed94-47c2-9f6d-caac43613e00 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.793230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e232e-ed94-47c2-9f6d-caac43613e00 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.793679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e232e-ed94-47c2-9f6d-caac43613e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.836893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-3f0e232e-ed94-47c2-9f6d-caac43613e00 None None] MFA Rules not processed for user `da7293ac7a4e4fec8495864e3f59bf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:23.838725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-3f0e232e-ed94-47c2-9f6d-caac43613e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:23.876749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1254/2481] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:23 2022] PUT /identity/v3/projects/8d0bf42a1c7e4db684176530c432bd0e/users/48b8807667234e56a326d12742698921/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:23.887724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a94e-04ca-41db-8e4e-13bc90b4fc75 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.888308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a94e-04ca-41db-8e4e-13bc90b4fc75 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.888799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a94e-04ca-41db-8e4e-13bc90b4fc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.921917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4942a94e-04ca-41db-8e4e-13bc90b4fc75 None None] MFA Rules not processed for user `48b8807667234e56a326d12742698921`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:23.924027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4942a94e-04ca-41db-8e4e-13bc90b4fc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:23.932683 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:23.953659 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1228/2482] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:23.959077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e232e-ed94-47c2-9f6d-caac43613e00 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.003494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1255/2483] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:24.017693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942a94e-04ca-41db-8e4e-13bc90b4fc75 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.028100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4942a94e-04ca-41db-8e4e-13bc90b4fc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:24.044225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e232e-ed94-47c2-9f6d-caac43613e00 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:24.100099 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942a94e-04ca-41db-8e4e-13bc90b4fc75 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:24.104294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e115fd5-d202-4301-9bb6-d09449621e5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:24.104944 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e115fd5-d202-4301-9bb6-d09449621e5d service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.105240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e115fd5-d202-4301-9bb6-d09449621e5d service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.105549 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e115fd5-d202-4301-9bb6-d09449621e5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.116192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e115fd5-d202-4301-9bb6-d09449621e5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:24.118605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e115fd5-d202-4301-9bb6-d09449621e5d service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.124527 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31b807-9643-462c-9e4f-d8900bba2446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:24.125197 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31b807-9643-462c-9e4f-d8900bba2446 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.125518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31b807-9643-462c-9e4f-d8900bba2446 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.125795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31b807-9643-462c-9e4f-d8900bba2446 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.126491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31b807-9643-462c-9e4f-d8900bba2446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:24.128193 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1256/2484] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:06:24.128821 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31b807-9643-462c-9e4f-d8900bba2446 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.171041 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e115fd5-d202-4301-9bb6-d09449621e5d service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.184623 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6e115fd5-d202-4301-9bb6-d09449621e5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:24.204987 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e115fd5-d202-4301-9bb6-d09449621e5d service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:24.210026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae08c1-b465-4e8a-b198-afbb0d7d6238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:24.210903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae08c1-b465-4e8a-b198-afbb0d7d6238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.211187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae08c1-b465-4e8a-b198-afbb0d7d6238 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.211466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae08c1-b465-4e8a-b198-afbb0d7d6238 admin admin] PATH_INFO: `/v3/projects/56affffa13a948ba919e78bcac8ebc27` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.212800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae08c1-b465-4e8a-b198-afbb0d7d6238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56affffa13a948ba919e78bcac8ebc27)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:24.215384 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae08c1-b465-4e8a-b198-afbb0d7d6238 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.262603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1229/2485] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:23 2022] POST /identity/v3/projects => generated 371 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:24.268198 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31b807-9643-462c-9e4f-d8900bba2446 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.278045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:24.343383 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-eeae08c1-b465-4e8a-b198-afbb0d7d6238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56affffa13a948ba919e78bcac8ebc27', 'request_id': 'req-eeae08c1-b465-4e8a-b198-afbb0d7d6238'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.355497 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31b807-9643-462c-9e4f-d8900bba2446 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:24.423772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d5c91-cec5-4106-90da-3cc34de3bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:24.424954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d5c91-cec5-4106-90da-3cc34de3bd2f admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.425506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d5c91-cec5-4106-90da-3cc34de3bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.426013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d5c91-cec5-4106-90da-3cc34de3bd2f admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.426798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d5c91-cec5-4106-90da-3cc34de3bd2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:24.428801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d5c91-cec5-4106-90da-3cc34de3bd2f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.435797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-eeae08c1-b465-4e8a-b198-afbb0d7d6238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56affffa13a948ba919e78bcac8ebc27', 'request_id': 'req-eeae08c1-b465-4e8a-b198-afbb0d7d6238'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.444086 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-eeae08c1-b465-4e8a-b198-afbb0d7d6238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56affffa13a948ba919e78bcac8ebc27', 'request_id': 'req-eeae08c1-b465-4e8a-b198-afbb0d7d6238'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.458719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-eeae08c1-b465-4e8a-b198-afbb0d7d6238 admin admin] The token cache is being invalidate because project 56affffa13a948ba919e78bcac8ebc27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:24.459015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-eeae08c1-b465-4e8a-b198-afbb0d7d6238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.459778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-eeae08c1-b465-4e8a-b198-afbb0d7d6238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.461801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1257/2486] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:06:24 2022] DELETE /identity/v3/projects/56affffa13a948ba919e78bcac8ebc27 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:24.466945 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4c26-3403-407c-af5b-3935b2039ff6 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.467235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4c26-3403-407c-af5b-3935b2039ff6 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.467516 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4c26-3403-407c-af5b-3935b2039ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.487366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-ca2e4c26-3403-407c-af5b-3935b2039ff6 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:24.488601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ca2e4c26-3403-407c-af5b-3935b2039ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:24.498076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1258/2487] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:24.506538 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b50da3-55b2-46f2-8bd4-96a076088845 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.506946 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b50da3-55b2-46f2-8bd4-96a076088845 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.507332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b50da3-55b2-46f2-8bd4-96a076088845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.527620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b0b50da3-55b2-46f2-8bd4-96a076088845 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:24.528769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b0b50da3-55b2-46f2-8bd4-96a076088845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:24.532514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1230/2488] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:24 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:24.537080 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1259/2489] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:24.542717 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d5c91-cec5-4106-90da-3cc34de3bd2f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.544488 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8b3d5c91-cec5-4106-90da-3cc34de3bd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:24.544634 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b50da3-55b2-46f2-8bd4-96a076088845 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.554906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b50da3-55b2-46f2-8bd4-96a076088845 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:24.556661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d5c91-cec5-4106-90da-3cc34de3bd2f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:24.561086 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c9e28-81b1-4981-ace7-dbe525680a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:24.561847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c9e28-81b1-4981-ace7-dbe525680a57 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.562139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c9e28-81b1-4981-ace7-dbe525680a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.562418 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c9e28-81b1-4981-ace7-dbe525680a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.562580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b98aaa-cb02-4bde-b775-eec71fe33efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:24.563100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b98aaa-cb02-4bde-b775-eec71fe33efa admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.563251 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c9e28-81b1-4981-ace7-dbe525680a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:06:24.563388 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b98aaa-cb02-4bde-b775-eec71fe33efa admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.563566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c9e28-81b1-4981-ace7-dbe525680a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:24.563710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b98aaa-cb02-4bde-b775-eec71fe33efa admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.564357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b98aaa-cb02-4bde-b775-eec71fe33efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:24.565272 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c9e28-81b1-4981-ace7-dbe525680a57 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.565989 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b98aaa-cb02-4bde-b775-eec71fe33efa admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.581251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1231/2490] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:24.583308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1260/2491] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:06:24.583475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b98aaa-cb02-4bde-b775-eec71fe33efa admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.586107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c9e28-81b1-4981-ace7-dbe525680a57 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.593354 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b98aaa-cb02-4bde-b775-eec71fe33efa admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:24.597391 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c9e28-81b1-4981-ace7-dbe525680a57 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:24.598265 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e9071-fffe-4bd7-8b04-ddd0f0d91c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:24.599173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e9071-fffe-4bd7-8b04-ddd0f0d91c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.599457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e9071-fffe-4bd7-8b04-ddd0f0d91c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.599730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e9071-fffe-4bd7-8b04-ddd0f0d91c75 admin admin] PATH_INFO: `/v3/projects/60c1005ba7a94866a5eecc04136e2046/users/efe9d56c6f4d4810a7c08725ad633eac/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.602315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22b192-8edc-4bcf-b838-d1671f6f93ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:24.603001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22b192-8edc-4bcf-b838-d1671f6f93ed admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.603289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22b192-8edc-4bcf-b838-d1671f6f93ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.603565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22b192-8edc-4bcf-b838-d1671f6f93ed admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.604259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22b192-8edc-4bcf-b838-d1671f6f93ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:24.606303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22b192-8edc-4bcf-b838-d1671f6f93ed admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.611920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:24.617284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e9071-fffe-4bd7-8b04-ddd0f0d91c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c1005ba7a94866a5eecc04136e2046, user_id=efe9d56c6f4d4810a7c08725ad633eac, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:24.620185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e9071-fffe-4bd7-8b04-ddd0f0d91c75 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.708072 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1232/2492] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:24 2022] PUT /identity/v3/projects/60c1005ba7a94866a5eecc04136e2046/users/efe9d56c6f4d4810a7c08725ad633eac/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:24.710495 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1261/2493] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:24 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:24.713794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e9071-fffe-4bd7-8b04-ddd0f0d91c75 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.715477 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22b192-8edc-4bcf-b838-d1671f6f93ed admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.810379 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e9071-fffe-4bd7-8b04-ddd0f0d91c75 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:24.817782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee84d5-6be5-4ac1-9c45-f3f70527727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:24.818795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee84d5-6be5-4ac1-9c45-f3f70527727a admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.819227 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee84d5-6be5-4ac1-9c45-f3f70527727a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.819655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee84d5-6be5-4ac1-9c45-f3f70527727a admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.820904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee84d5-6be5-4ac1-9c45-f3f70527727a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:24.823726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee84d5-6be5-4ac1-9c45-f3f70527727a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.826272 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22b192-8edc-4bcf-b838-d1671f6f93ed admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:24.834926 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a8c68-7a07-4499-b157-77d9966d9f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:24.836037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a8c68-7a07-4499-b157-77d9966d9f7a admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.836535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a8c68-7a07-4499-b157-77d9966d9f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.837035 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a8c68-7a07-4499-b157-77d9966d9f7a admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.839304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a8c68-7a07-4499-b157-77d9966d9f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:24.844823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1233/2494] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:24.846052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a8c68-7a07-4499-b157-77d9966d9f7a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.846320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee84d5-6be5-4ac1-9c45-f3f70527727a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.852708 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:24.860398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee84d5-6be5-4ac1-9c45-f3f70527727a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:24.867091 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24828c-111c-4668-8a81-2f9a15fb2502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:24.868085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24828c-111c-4668-8a81-2f9a15fb2502 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.868439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24828c-111c-4668-8a81-2f9a15fb2502 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.868772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24828c-111c-4668-8a81-2f9a15fb2502 admin admin] PATH_INFO: `/v3/projects/60c1005ba7a94866a5eecc04136e2046/users/efe9d56c6f4d4810a7c08725ad633eac/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.871616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24828c-111c-4668-8a81-2f9a15fb2502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c1005ba7a94866a5eecc04136e2046, user_id=efe9d56c6f4d4810a7c08725ad633eac, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:24.877253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24828c-111c-4668-8a81-2f9a15fb2502 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.893690 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1234/2495] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:24 2022] PUT /identity/v3/projects/60c1005ba7a94866a5eecc04136e2046/users/efe9d56c6f4d4810a7c08725ad633eac/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:24.905964 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93d0fb-7eed-4857-9a19-f80e18214cac None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.906394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93d0fb-7eed-4857-9a19-f80e18214cac None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.909628 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93d0fb-7eed-4857-9a19-f80e18214cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.939457 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7f93d0fb-7eed-4857-9a19-f80e18214cac None None] MFA Rules not processed for user `efe9d56c6f4d4810a7c08725ad633eac`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:24.940882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7f93d0fb-7eed-4857-9a19-f80e18214cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:25.014633 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1262/2496] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:24 2022] POST /identity/v3/users => generated 286 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:25.016416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a8c68-7a07-4499-b157-77d9966d9f7a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:25.034913 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a8c68-7a07-4499-b157-77d9966d9f7a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:25.062123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1235/2497] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:25.078163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93d0fb-7eed-4857-9a19-f80e18214cac None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:25.080233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7f93d0fb-7eed-4857-9a19-f80e18214cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:25.140779 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb99916-dc81-45ea-80cb-bf7cea2653cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:25.142063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb99916-dc81-45ea-80cb-bf7cea2653cd admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.142604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb99916-dc81-45ea-80cb-bf7cea2653cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.143155 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb99916-dc81-45ea-80cb-bf7cea2653cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.144583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb99916-dc81-45ea-80cb-bf7cea2653cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:25.147732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb99916-dc81-45ea-80cb-bf7cea2653cd admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:25.161217 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93d0fb-7eed-4857-9a19-f80e18214cac None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:25.166494 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009bf03-45ea-4059-8e6a-e78ba11b1c0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:25.169446 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009bf03-45ea-4059-8e6a-e78ba11b1c0f service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.169446 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009bf03-45ea-4059-8e6a-e78ba11b1c0f service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.169446 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009bf03-45ea-4059-8e6a-e78ba11b1c0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.169742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1263/2498] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:25.171723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb99916-dc81-45ea-80cb-bf7cea2653cd admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:25.180331 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009bf03-45ea-4059-8e6a-e78ba11b1c0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:25.182463 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009bf03-45ea-4059-8e6a-e78ba11b1c0f service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:25.185182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb99916-dc81-45ea-80cb-bf7cea2653cd admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:25.193202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c0fcb-c988-4546-8b71-b71afbc9e63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:25.197578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1236/2499] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:25.197858 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c0fcb-c988-4546-8b71-b71afbc9e63f admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.197858 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c0fcb-c988-4546-8b71-b71afbc9e63f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.197858 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c0fcb-c988-4546-8b71-b71afbc9e63f admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.197858 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c0fcb-c988-4546-8b71-b71afbc9e63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:25.199715 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c0fcb-c988-4546-8b71-b71afbc9e63f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:25.213241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1264/2500] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:25.220206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009bf03-45ea-4059-8e6a-e78ba11b1c0f service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:25.232815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009bf03-45ea-4059-8e6a-e78ba11b1c0f service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:25.239159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf1f3e-8b42-45c4-9691-b6b3af3187a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:25.240575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf1f3e-8b42-45c4-9691-b6b3af3187a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.241004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf1f3e-8b42-45c4-9691-b6b3af3187a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.241321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf1f3e-8b42-45c4-9691-b6b3af3187a4 admin admin] PATH_INFO: `/v3/projects/37510ecaee1949ba9c7e4d3109ceb10b/users/e77aa0d243c04083819ad5fcd855af78/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.265860 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf1f3e-8b42-45c4-9691-b6b3af3187a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37510ecaee1949ba9c7e4d3109ceb10b, user_id=e77aa0d243c04083819ad5fcd855af78, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:25.268531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf1f3e-8b42-45c4-9691-b6b3af3187a4 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:25.387936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1237/2501] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:25 2022] PUT /identity/v3/projects/37510ecaee1949ba9c7e4d3109ceb10b/users/e77aa0d243c04083819ad5fcd855af78/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:25.393111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44079544-37c8-432f-a8da-60a3437861d1 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.393664 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44079544-37c8-432f-a8da-60a3437861d1 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.393774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44079544-37c8-432f-a8da-60a3437861d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.412820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-44079544-37c8-432f-a8da-60a3437861d1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:25.414182 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-44079544-37c8-432f-a8da-60a3437861d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:25.466566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf1f3e-8b42-45c4-9691-b6b3af3187a4 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:25.492731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1265/2502] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:25.503618 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44079544-37c8-432f-a8da-60a3437861d1 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:25.505415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-44079544-37c8-432f-a8da-60a3437861d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:25.512250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:25.544470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf1f3e-8b42-45c4-9691-b6b3af3187a4 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:25.548730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6243b-d268-4e2a-9539-42876446f8ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:25.549426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6243b-d268-4e2a-9539-42876446f8ed service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.549717 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6243b-d268-4e2a-9539-42876446f8ed service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.549999 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6243b-d268-4e2a-9539-42876446f8ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.551925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-51a6243b-d268-4e2a-9539-42876446f8ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:25.561500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:25.583609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44079544-37c8-432f-a8da-60a3437861d1 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:25.587242 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad584a-6aaa-4a5c-b12c-2db7286ffab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:25.588044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad584a-6aaa-4a5c-b12c-2db7286ffab9 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.588334 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad584a-6aaa-4a5c-b12c-2db7286ffab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.588613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad584a-6aaa-4a5c-b12c-2db7286ffab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.598169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad584a-6aaa-4a5c-b12c-2db7286ffab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:25.599617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad584a-6aaa-4a5c-b12c-2db7286ffab9 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:25.611432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1266/2503] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:06:25.619468 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6243b-d268-4e2a-9539-42876446f8ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:25.621622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6243b-d268-4e2a-9539-42876446f8ed service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:25.632205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1238/2504] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:33.244173 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd60d4-4c67-4f76-8928-19d1b6417ea4 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:33.244757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd60d4-4c67-4f76-8928-19d1b6417ea4 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:33.244945 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd60d4-4c67-4f76-8928-19d1b6417ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:33.284259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-fdcd60d4-4c67-4f76-8928-19d1b6417ea4 None None] MFA Rules not processed for user `e77aa0d243c04083819ad5fcd855af78`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:33.285992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-fdcd60d4-4c67-4f76-8928-19d1b6417ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:33.402349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1267/2505] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:33.406710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6243b-d268-4e2a-9539-42876446f8ed service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:33.418315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6243b-d268-4e2a-9539-42876446f8ed service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:33.424643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b1fb6-75bc-4a0d-9e04-c32412b28382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:33.425324 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b1fb6-75bc-4a0d-9e04-c32412b28382 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:33.425665 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b1fb6-75bc-4a0d-9e04-c32412b28382 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:33.425954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b1fb6-75bc-4a0d-9e04-c32412b28382 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:33.426653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b1fb6-75bc-4a0d-9e04-c32412b28382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:33.428607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b1fb6-75bc-4a0d-9e04-c32412b28382 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:33.570414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1239/2506] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:33 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:33.578457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd60d4-4c67-4f76-8928-19d1b6417ea4 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:33.593926 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd60d4-4c67-4f76-8928-19d1b6417ea4 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:33.673368 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c6a17-9478-4012-8f94-6477a3498061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:33.674155 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c6a17-9478-4012-8f94-6477a3498061 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:33.674512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c6a17-9478-4012-8f94-6477a3498061 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:33.674856 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c6a17-9478-4012-8f94-6477a3498061 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:33.675678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c6a17-9478-4012-8f94-6477a3498061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:33.678118 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c6a17-9478-4012-8f94-6477a3498061 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:33.799316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1268/2507] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:33 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:33.803629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b1fb6-75bc-4a0d-9e04-c32412b28382 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:33.814261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b1fb6-75bc-4a0d-9e04-c32412b28382 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:33.818863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b5ce6-f45b-49ca-b916-c9f96dc24693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:33.819531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b5ce6-f45b-49ca-b916-c9f96dc24693 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:33.819816 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b5ce6-f45b-49ca-b916-c9f96dc24693 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:33.820098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b5ce6-f45b-49ca-b916-c9f96dc24693 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:33.820959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b5ce6-f45b-49ca-b916-c9f96dc24693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:33.822657 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b5ce6-f45b-49ca-b916-c9f96dc24693 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:33.835491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1240/2508] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:33.840027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c6a17-9478-4012-8f94-6477a3498061 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:33.851342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c6a17-9478-4012-8f94-6477a3498061 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:33.856324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72350a9a-768f-4c27-a410-6a06bcbb2992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:33.857262 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72350a9a-768f-4c27-a410-6a06bcbb2992 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:33.857584 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72350a9a-768f-4c27-a410-6a06bcbb2992 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:33.857868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72350a9a-768f-4c27-a410-6a06bcbb2992 admin admin] PATH_INFO: `/v3/projects/b60f9e6bea2f4cd4911b8bb40427123a/users/4a846f83b7be4a6bb2c6d942c0b3bf94/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:33.876825 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72350a9a-768f-4c27-a410-6a06bcbb2992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60f9e6bea2f4cd4911b8bb40427123a, user_id=4a846f83b7be4a6bb2c6d942c0b3bf94, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:33.879807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72350a9a-768f-4c27-a410-6a06bcbb2992 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:33.949591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:33.954819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1269/2509] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:33 2022] PUT /identity/v3/projects/b60f9e6bea2f4cd4911b8bb40427123a/users/4a846f83b7be4a6bb2c6d942c0b3bf94/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:33.959030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b5ce6-f45b-49ca-b916-c9f96dc24693 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:33.970803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b5ce6-f45b-49ca-b916-c9f96dc24693 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:34.041844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf45ba-e40d-4c1e-a504-d73ffe67a112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:34.043171 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf45ba-e40d-4c1e-a504-d73ffe67a112 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:34.043460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf45ba-e40d-4c1e-a504-d73ffe67a112 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:34.043733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf45ba-e40d-4c1e-a504-d73ffe67a112 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:34.044601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf45ba-e40d-4c1e-a504-d73ffe67a112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:34.046281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf45ba-e40d-4c1e-a504-d73ffe67a112 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:34.063637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1241/2510] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:34.065597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72350a9a-768f-4c27-a410-6a06bcbb2992 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:34.084748 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72350a9a-768f-4c27-a410-6a06bcbb2992 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:34.099603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdd821-f5d8-488d-b210-71b0c2d84aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:34.100491 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdd821-f5d8-488d-b210-71b0c2d84aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:34.101153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdd821-f5d8-488d-b210-71b0c2d84aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:34.102085 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdd821-f5d8-488d-b210-71b0c2d84aa0 admin admin] PATH_INFO: `/v3/projects/b60f9e6bea2f4cd4911b8bb40427123a/users/4a846f83b7be4a6bb2c6d942c0b3bf94/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:34.104347 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdd821-f5d8-488d-b210-71b0c2d84aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60f9e6bea2f4cd4911b8bb40427123a, user_id=4a846f83b7be4a6bb2c6d942c0b3bf94, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:34.108055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdd821-f5d8-488d-b210-71b0c2d84aa0 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:34.134298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1270/2511] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:34 2022] PUT /identity/v3/projects/b60f9e6bea2f4cd4911b8bb40427123a/users/4a846f83b7be4a6bb2c6d942c0b3bf94/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:35.557320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf45ba-e40d-4c1e-a504-d73ffe67a112 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:35.559319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-eedf45ba-e40d-4c1e-a504-d73ffe67a112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:35.573188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf45ba-e40d-4c1e-a504-d73ffe67a112 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:35.644953 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:35.646378 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:35.646669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:35.646944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] PATH_INFO: `/v3/users/48b8807667234e56a326d12742698921` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:35.648264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b8807667234e56a326d12742698921)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:35.650313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:35.668008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:35.879933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b8807667234e56a326d12742698921'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:35.998740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b8807667234e56a326d12742698921'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:36.000066 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b8807667234e56a326d12742698921'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:36.008978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b8807667234e56a326d12742698921'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:36.009807 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b8807667234e56a326d12742698921'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:36.029499 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1242/2512] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:06:35 2022] DELETE /identity/v3/users/48b8807667234e56a326d12742698921 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:36.034358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12781b-0761-4414-8dd8-a755cf5008bf None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:36.034840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12781b-0761-4414-8dd8-a755cf5008bf None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:36.035708 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12781b-0761-4414-8dd8-a755cf5008bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:36.055263 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-8b12781b-0761-4414-8dd8-a755cf5008bf None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:36.056582 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8b12781b-0761-4414-8dd8-a755cf5008bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:36.125806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1271/2513] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:36.135889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:36.137369 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:36.203518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf3028-22a7-43a8-ad2e-9dc1c4b82f58 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:36.207284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ba0b1-1b87-439e-90d5-9e15e17d4bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:36.207991 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ba0b1-1b87-439e-90d5-9e15e17d4bcb service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:36.208278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ba0b1-1b87-439e-90d5-9e15e17d4bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:36.208559 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ba0b1-1b87-439e-90d5-9e15e17d4bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:36.219088 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ba0b1-1b87-439e-90d5-9e15e17d4bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:36.220649 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ba0b1-1b87-439e-90d5-9e15e17d4bcb service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:36.232058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1243/2514] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:37.163574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12781b-0761-4414-8dd8-a755cf5008bf None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:37.165762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8b12781b-0761-4414-8dd8-a755cf5008bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:37.189326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12781b-0761-4414-8dd8-a755cf5008bf None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:37.209439 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:37.210626 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:37.211436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:37.211840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2 admin admin] PATH_INFO: `/v3/projects/8d0bf42a1c7e4db684176530c432bd0e` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:37.214328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d0bf42a1c7e4db684176530c432bd0e)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:37.217541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:37.365792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0bf42a1c7e4db684176530c432bd0e', 'request_id': 'req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:37.451002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0bf42a1c7e4db684176530c432bd0e', 'request_id': 'req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:37.460092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0bf42a1c7e4db684176530c432bd0e', 'request_id': 'req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:37.474530 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2 admin admin] The token cache is being invalidate because project 8d0bf42a1c7e4db684176530c432bd0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:37.475231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:37.476950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0f6f9d46-bd29-4877-b2a4-cca1047bcdc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:37.479033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1272/2515] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:06:37 2022] DELETE /identity/v3/projects/8d0bf42a1c7e4db684176530c432bd0e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:37.485720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2da37b-30ed-4575-8828-6a74fcc9eb7f None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:37.486613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2da37b-30ed-4575-8828-6a74fcc9eb7f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:37.490333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2da37b-30ed-4575-8828-6a74fcc9eb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:37.515787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-6e2da37b-30ed-4575-8828-6a74fcc9eb7f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:37.517055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6e2da37b-30ed-4575-8828-6a74fcc9eb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:37.597687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1244/2516] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:37.606694 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80cf18-775b-4a05-b9ae-4388f2a04266 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:37.606991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80cf18-775b-4a05-b9ae-4388f2a04266 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:37.607279 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80cf18-775b-4a05-b9ae-4388f2a04266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:37.671111 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-0d80cf18-775b-4a05-b9ae-4388f2a04266 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:37.672899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0d80cf18-775b-4a05-b9ae-4388f2a04266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:37.690354 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1273/2517] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:37.694214 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2da37b-30ed-4575-8828-6a74fcc9eb7f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:37.707027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2da37b-30ed-4575-8828-6a74fcc9eb7f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:37.717405 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7d511-fb19-41a2-ae1f-eab278641514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:37.718259 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7d511-fb19-41a2-ae1f-eab278641514 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:37.718645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7d511-fb19-41a2-ae1f-eab278641514 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:37.719013 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7d511-fb19-41a2-ae1f-eab278641514 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:37.725683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7d511-fb19-41a2-ae1f-eab278641514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:06:37.725683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7d511-fb19-41a2-ae1f-eab278641514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:37.725683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7d511-fb19-41a2-ae1f-eab278641514 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:37.741439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1245/2518] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:06:37.753136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80cf18-775b-4a05-b9ae-4388f2a04266 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:37.772828 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80cf18-775b-4a05-b9ae-4388f2a04266 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:37.781898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d919a-67f2-43a6-9112-8ca1276e5bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:37.784265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d919a-67f2-43a6-9112-8ca1276e5bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:37.785126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d919a-67f2-43a6-9112-8ca1276e5bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:37.785610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d919a-67f2-43a6-9112-8ca1276e5bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:37.786511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d919a-67f2-43a6-9112-8ca1276e5bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:37.788851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d919a-67f2-43a6-9112-8ca1276e5bc9 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:37.977476 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1274/2519] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:37 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:37.977960 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7d511-fb19-41a2-ae1f-eab278641514 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:37.999080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7d511-fb19-41a2-ae1f-eab278641514 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:38.028541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:38.076795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04340c-df0e-40ac-b72b-5e0c9c7661d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:38.077525 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04340c-df0e-40ac-b72b-5e0c9c7661d9 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:38.078458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04340c-df0e-40ac-b72b-5e0c9c7661d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:38.078747 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04340c-df0e-40ac-b72b-5e0c9c7661d9 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:38.079866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04340c-df0e-40ac-b72b-5e0c9c7661d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:38.081766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04340c-df0e-40ac-b72b-5e0c9c7661d9 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:38.177662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1246/2520] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:37 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:38.179130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d919a-67f2-43a6-9112-8ca1276e5bc9 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:38.194107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d919a-67f2-43a6-9112-8ca1276e5bc9 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:38.199544 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d6121-d049-47d3-9622-f19dc17c7650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:38.200564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d6121-d049-47d3-9622-f19dc17c7650 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:38.201065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d6121-d049-47d3-9622-f19dc17c7650 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:38.201613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d6121-d049-47d3-9622-f19dc17c7650 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:38.202799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d6121-d049-47d3-9622-f19dc17c7650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:38.204675 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d6121-d049-47d3-9622-f19dc17c7650 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:38.228991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1275/2521] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:38.233931 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04340c-df0e-40ac-b72b-5e0c9c7661d9 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:38.247273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04340c-df0e-40ac-b72b-5e0c9c7661d9 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:38.253998 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d516eb7-db87-4bae-9731-7cda5e0001aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:38.254746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516eb7-db87-4bae-9731-7cda5e0001aa admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:38.255874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516eb7-db87-4bae-9731-7cda5e0001aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:38.255874 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516eb7-db87-4bae-9731-7cda5e0001aa admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:38.256260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d516eb7-db87-4bae-9731-7cda5e0001aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:38.257967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d516eb7-db87-4bae-9731-7cda5e0001aa admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:38.275600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d6121-d049-47d3-9622-f19dc17c7650 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:38.282985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1247/2522] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:38.287118 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d6121-d049-47d3-9622-f19dc17c7650 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:38.293511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a658c6e-3dfe-4040-a9e0-a7e2487c682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:38.294528 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658c6e-3dfe-4040-a9e0-a7e2487c682c admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:38.294915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658c6e-3dfe-4040-a9e0-a7e2487c682c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:38.295277 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658c6e-3dfe-4040-a9e0-a7e2487c682c admin admin] PATH_INFO: `/v3/projects/9f9de6681c4744828e5ab392e17ad3d5/users/184756634102427a8467302396a41da4/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:38.324586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a658c6e-3dfe-4040-a9e0-a7e2487c682c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9de6681c4744828e5ab392e17ad3d5, user_id=184756634102427a8467302396a41da4, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:38.328107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a658c6e-3dfe-4040-a9e0-a7e2487c682c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:38.416642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1276/2523] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:38 2022] PUT /identity/v3/projects/9f9de6681c4744828e5ab392e17ad3d5/users/184756634102427a8467302396a41da4/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:38.431490 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509a59d-48aa-4aa4-ad01-9a15e164fbfb None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:38.431897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509a59d-48aa-4aa4-ad01-9a15e164fbfb None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:38.432377 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509a59d-48aa-4aa4-ad01-9a15e164fbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:38.477365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7509a59d-48aa-4aa4-ad01-9a15e164fbfb None None] MFA Rules not processed for user `184756634102427a8467302396a41da4`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:38.479029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7509a59d-48aa-4aa4-ad01-9a15e164fbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:38.560792 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1248/2524] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:38.564929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a658c6e-3dfe-4040-a9e0-a7e2487c682c admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:38.575801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:38.639619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a658c6e-3dfe-4040-a9e0-a7e2487c682c admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:38.644580 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e973fc-beb2-4d0a-a202-90bc423eda4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:38.645355 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e973fc-beb2-4d0a-a202-90bc423eda4a admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:38.645726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e973fc-beb2-4d0a-a202-90bc423eda4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:38.646062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e973fc-beb2-4d0a-a202-90bc423eda4a admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:38.646831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e973fc-beb2-4d0a-a202-90bc423eda4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:38.648981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e973fc-beb2-4d0a-a202-90bc423eda4a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:38.765963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1277/2525] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:38 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:38.769934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509a59d-48aa-4aa4-ad01-9a15e164fbfb None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:38.791374 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509a59d-48aa-4aa4-ad01-9a15e164fbfb None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:38.939109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18945e73-d9d6-4edd-a37b-6b226f8154dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:38.940058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18945e73-d9d6-4edd-a37b-6b226f8154dd admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:38.940534 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18945e73-d9d6-4edd-a37b-6b226f8154dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:38.940952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18945e73-d9d6-4edd-a37b-6b226f8154dd admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:38.941861 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18945e73-d9d6-4edd-a37b-6b226f8154dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:38.944159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18945e73-d9d6-4edd-a37b-6b226f8154dd admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:39.070776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1249/2526] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:38 2022] POST /identity/v3/users => generated 295 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:39.070958 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e973fc-beb2-4d0a-a202-90bc423eda4a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:39.087280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e973fc-beb2-4d0a-a202-90bc423eda4a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:39.096831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31167e-39bc-4163-b6da-1acc20ce53db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:39.097726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31167e-39bc-4163-b6da-1acc20ce53db admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:39.098306 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31167e-39bc-4163-b6da-1acc20ce53db admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:39.098667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31167e-39bc-4163-b6da-1acc20ce53db admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:39.099544 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31167e-39bc-4163-b6da-1acc20ce53db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:39.103469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31167e-39bc-4163-b6da-1acc20ce53db admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:39.150968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1278/2527] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:39.156580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18945e73-d9d6-4edd-a37b-6b226f8154dd admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:39.213974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18945e73-d9d6-4edd-a37b-6b226f8154dd admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:39.224683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab10177-53e6-4e02-9452-ffbf6a78b389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:39.224683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab10177-53e6-4e02-9452-ffbf6a78b389 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:39.224683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab10177-53e6-4e02-9452-ffbf6a78b389 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:39.224683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab10177-53e6-4e02-9452-ffbf6a78b389 admin admin] PATH_INFO: `/v3/projects/0b9dc19992d94f50b2578465bc778446/users/c6c14de1d7c740d5b0ca64699a4d1d61/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:39.274085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab10177-53e6-4e02-9452-ffbf6a78b389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9dc19992d94f50b2578465bc778446, user_id=c6c14de1d7c740d5b0ca64699a4d1d61, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:39.277485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab10177-53e6-4e02-9452-ffbf6a78b389 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:39.280181 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:39.377030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1250/2528] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:39 2022] PUT /identity/v3/projects/0b9dc19992d94f50b2578465bc778446/users/c6c14de1d7c740d5b0ca64699a4d1d61/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:39.381304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31167e-39bc-4163-b6da-1acc20ce53db admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:39.394681 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31167e-39bc-4163-b6da-1acc20ce53db admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:39.480512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd442a-ddd8-4782-8e97-8825bf4a92d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:39.481245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd442a-ddd8-4782-8e97-8825bf4a92d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:39.481559 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd442a-ddd8-4782-8e97-8825bf4a92d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:39.481835 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd442a-ddd8-4782-8e97-8825bf4a92d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:39.482566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd442a-ddd8-4782-8e97-8825bf4a92d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:39.484264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd442a-ddd8-4782-8e97-8825bf4a92d2 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:39.500450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1279/2529] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:39.501591 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab10177-53e6-4e02-9452-ffbf6a78b389 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:39.513961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab10177-53e6-4e02-9452-ffbf6a78b389 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:39.518613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb263f8-f2c0-4ada-ae4c-71547dff1eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:39.519497 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb263f8-f2c0-4ada-ae4c-71547dff1eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:39.519766 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb263f8-f2c0-4ada-ae4c-71547dff1eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:39.520040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb263f8-f2c0-4ada-ae4c-71547dff1eb4 admin admin] PATH_INFO: `/v3/projects/0b9dc19992d94f50b2578465bc778446/users/c6c14de1d7c740d5b0ca64699a4d1d61/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:39.522302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb263f8-f2c0-4ada-ae4c-71547dff1eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9dc19992d94f50b2578465bc778446, user_id=c6c14de1d7c740d5b0ca64699a4d1d61, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:39.525886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb263f8-f2c0-4ada-ae4c-71547dff1eb4 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:39.557271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1251/2530] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:39 2022] PUT /identity/v3/projects/0b9dc19992d94f50b2578465bc778446/users/c6c14de1d7c740d5b0ca64699a4d1d61/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:39.563363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef795e7-6005-42bf-92b4-6dd9813428e2 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:39.563363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef795e7-6005-42bf-92b4-6dd9813428e2 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:39.563363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef795e7-6005-42bf-92b4-6dd9813428e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:39.590655 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-8ef795e7-6005-42bf-92b4-6dd9813428e2 None None] MFA Rules not processed for user `c6c14de1d7c740d5b0ca64699a4d1d61`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:39.592803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8ef795e7-6005-42bf-92b4-6dd9813428e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:39.704762 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1280/2531] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:39.716543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb263f8-f2c0-4ada-ae4c-71547dff1eb4 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:39.718289 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cfb263f8-f2c0-4ada-ae4c-71547dff1eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:39.784330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb263f8-f2c0-4ada-ae4c-71547dff1eb4 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:39.788054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0983d0-31ba-4068-8b6e-301b00bab5d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:39.788696 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0983d0-31ba-4068-8b6e-301b00bab5d9 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:39.788978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0983d0-31ba-4068-8b6e-301b00bab5d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:39.789251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0983d0-31ba-4068-8b6e-301b00bab5d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:39.850793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0983d0-31ba-4068-8b6e-301b00bab5d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:39.852465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0983d0-31ba-4068-8b6e-301b00bab5d9 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:39.865003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1252/2532] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:41.322110 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33f251-57de-435f-849a-4ce268a0bc5f None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:41.322573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33f251-57de-435f-849a-4ce268a0bc5f None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:41.322741 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33f251-57de-435f-849a-4ce268a0bc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:41.329342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:41.358447 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-3b33f251-57de-435f-849a-4ce268a0bc5f None None] MFA Rules not processed for user `4a846f83b7be4a6bb2c6d942c0b3bf94`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:41.360525 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3b33f251-57de-435f-849a-4ce268a0bc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:41.450226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1281/2533] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:41.464447 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0983d0-31ba-4068-8b6e-301b00bab5d9 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:41.466516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6f0983d0-31ba-4068-8b6e-301b00bab5d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:41.553340 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0983d0-31ba-4068-8b6e-301b00bab5d9 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:41.561051 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61b445-9777-48fe-8154-8c814498902e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:41.561638 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61b445-9777-48fe-8154-8c814498902e service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:41.562038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61b445-9777-48fe-8154-8c814498902e service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:41.562408 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61b445-9777-48fe-8154-8c814498902e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:41.564330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ee61b445-9777-48fe-8154-8c814498902e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:41.601446 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:41.636466 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61b445-9777-48fe-8154-8c814498902e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:41.638134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61b445-9777-48fe-8154-8c814498902e service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:41.648065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1253/2534] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:43.695350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33f251-57de-435f-849a-4ce268a0bc5f None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:43.707769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33f251-57de-435f-849a-4ce268a0bc5f None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:43.711959 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2accc-2be5-42e7-94e8-c78114749dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:43.712640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2accc-2be5-42e7-94e8-c78114749dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:43.712924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2accc-2be5-42e7-94e8-c78114749dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:43.713205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2accc-2be5-42e7-94e8-c78114749dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:43.725226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2accc-2be5-42e7-94e8-c78114749dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:43.726791 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2accc-2be5-42e7-94e8-c78114749dc5 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:43.738696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1282/2535] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:45.786397 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cf2c3-7678-4556-8f8d-8d43db8d7fd9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:45.787279 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cf2c3-7678-4556-8f8d-8d43db8d7fd9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:45.787279 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cf2c3-7678-4556-8f8d-8d43db8d7fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:45.806634 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-001cf2c3-7678-4556-8f8d-8d43db8d7fd9 None None] MFA Rules not processed for user `e77aa0d243c04083819ad5fcd855af78`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:45.807888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-001cf2c3-7678-4556-8f8d-8d43db8d7fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:45.820302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1254/2536] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:52.647591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2accc-2be5-42e7-94e8-c78114749dc5 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:52.649036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5ad2accc-2be5-42e7-94e8-c78114749dc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:52.708870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2accc-2be5-42e7-94e8-c78114749dc5 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:52.712488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e538b43-3962-4c3c-b13b-ab5874ebf107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:52.713121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e538b43-3962-4c3c-b13b-ab5874ebf107 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:52.713486 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e538b43-3962-4c3c-b13b-ab5874ebf107 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:52.714600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e538b43-3962-4c3c-b13b-ab5874ebf107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:52.716512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7e538b43-3962-4c3c-b13b-ab5874ebf107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:52.783546 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e538b43-3962-4c3c-b13b-ab5874ebf107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:52.785040 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e538b43-3962-4c3c-b13b-ab5874ebf107 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:52.795666 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1283/2537] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:55.800247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=16 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:57.472817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cf2c3-7678-4556-8f8d-8d43db8d7fd9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:57.474340 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-001cf2c3-7678-4556-8f8d-8d43db8d7fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:57.493987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cf2c3-7678-4556-8f8d-8d43db8d7fd9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:57.501136 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10094de-393b-4244-ac81-4591d24627e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:57.502952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10094de-393b-4244-ac81-4591d24627e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:57.503263 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10094de-393b-4244-ac81-4591d24627e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:57.503544 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10094de-393b-4244-ac81-4591d24627e7 admin admin] PATH_INFO: `/v3/users/e0d9dcb062ad4376866a98edebede7b1` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:57.504979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10094de-393b-4244-ac81-4591d24627e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d9dcb062ad4376866a98edebede7b1)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:57.507003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10094de-393b-4244-ac81-4591d24627e7 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:57.724350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-e10094de-393b-4244-ac81-4591d24627e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d9dcb062ad4376866a98edebede7b1'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.803491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-e10094de-393b-4244-ac81-4591d24627e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d9dcb062ad4376866a98edebede7b1'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.804334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-e10094de-393b-4244-ac81-4591d24627e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d9dcb062ad4376866a98edebede7b1'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.814977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-e10094de-393b-4244-ac81-4591d24627e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d9dcb062ad4376866a98edebede7b1'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.816505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-e10094de-393b-4244-ac81-4591d24627e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d9dcb062ad4376866a98edebede7b1'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.846805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1255/2538] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:06:57 2022] DELETE /identity/v3/users/e0d9dcb062ad4376866a98edebede7b1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:58.168254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e538b43-3962-4c3c-b13b-ab5874ebf107 service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:58.186345 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e538b43-3962-4c3c-b13b-ab5874ebf107 service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:58.232038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:58.283687 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbd954-4931-4ed5-b4d3-50efeb55403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:58.284561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbd954-4931-4ed5-b4d3-50efeb55403a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:58.284839 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbd954-4931-4ed5-b4d3-50efeb55403a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:58.285109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbd954-4931-4ed5-b4d3-50efeb55403a admin admin] PATH_INFO: `/v3/projects/19bf95e9af5a40bbb60619c44250de5b` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:58.286350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbd954-4931-4ed5-b4d3-50efeb55403a admin admin] RBAC: Authorizing `identity:delete_project(project_id=19bf95e9af5a40bbb60619c44250de5b)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:58.288524 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbd954-4931-4ed5-b4d3-50efeb55403a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:58.510972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-8cbbd954-4931-4ed5-b4d3-50efeb55403a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19bf95e9af5a40bbb60619c44250de5b', 'request_id': 'req-8cbbd954-4931-4ed5-b4d3-50efeb55403a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.672591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-8cbbd954-4931-4ed5-b4d3-50efeb55403a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19bf95e9af5a40bbb60619c44250de5b', 'request_id': 'req-8cbbd954-4931-4ed5-b4d3-50efeb55403a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.680715 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-8cbbd954-4931-4ed5-b4d3-50efeb55403a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19bf95e9af5a40bbb60619c44250de5b', 'request_id': 'req-8cbbd954-4931-4ed5-b4d3-50efeb55403a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.696470 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-8cbbd954-4931-4ed5-b4d3-50efeb55403a admin admin] The token cache is being invalidate because project 19bf95e9af5a40bbb60619c44250de5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:58.697037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-8cbbd954-4931-4ed5-b4d3-50efeb55403a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.697480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-8cbbd954-4931-4ed5-b4d3-50efeb55403a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.699596 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1284/2539] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:06:58 2022] DELETE /identity/v3/projects/19bf95e9af5a40bbb60619c44250de5b => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:58.710169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596be2c-0493-4071-aa48-a82db7b75530 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:58.711111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596be2c-0493-4071-aa48-a82db7b75530 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:58.711395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596be2c-0493-4071-aa48-a82db7b75530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:58.738708 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2596be2c-0493-4071-aa48-a82db7b75530 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:58.739865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2596be2c-0493-4071-aa48-a82db7b75530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:58.805202 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1256/2540] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:58.814002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b2850-2153-49c9-9751-20b351f5365c None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:58.814002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b2850-2153-49c9-9751-20b351f5365c None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:58.814002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b2850-2153-49c9-9751-20b351f5365c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:58.835238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-7a9b2850-2153-49c9-9751-20b351f5365c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:58.836562 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7a9b2850-2153-49c9-9751-20b351f5365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:58.844991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1285/2541] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:58.849161 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596be2c-0493-4071-aa48-a82db7b75530 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:58.858850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596be2c-0493-4071-aa48-a82db7b75530 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:58.863882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975b289-cd2c-4e23-90f2-07921fd2bee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:58.864605 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975b289-cd2c-4e23-90f2-07921fd2bee8 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:58.864890 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975b289-cd2c-4e23-90f2-07921fd2bee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:58.865164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975b289-cd2c-4e23-90f2-07921fd2bee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:58.865952 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975b289-cd2c-4e23-90f2-07921fd2bee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:06:58.866260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975b289-cd2c-4e23-90f2-07921fd2bee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:58.867867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975b289-cd2c-4e23-90f2-07921fd2bee8 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:58.880277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1257/2542] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:06:58.884782 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b2850-2153-49c9-9751-20b351f5365c None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:58.895460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b2850-2153-49c9-9751-20b351f5365c None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:58.900919 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7d6aa-852a-4386-8095-411173082f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:58.901786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7d6aa-852a-4386-8095-411173082f1a admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:58.902077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7d6aa-852a-4386-8095-411173082f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:58.902357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7d6aa-852a-4386-8095-411173082f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:58.903064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7d6aa-852a-4386-8095-411173082f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:58.905003 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7d6aa-852a-4386-8095-411173082f1a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:59.108044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1286/2543] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:06:58 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:59.113776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975b289-cd2c-4e23-90f2-07921fd2bee8 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:59.127287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975b289-cd2c-4e23-90f2-07921fd2bee8 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:59.198191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abadc7-3cf0-481b-bd9e-91308ec2da39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:59.198881 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abadc7-3cf0-481b-bd9e-91308ec2da39 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:59.199163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abadc7-3cf0-481b-bd9e-91308ec2da39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:59.199443 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abadc7-3cf0-481b-bd9e-91308ec2da39 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:59.200133 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abadc7-3cf0-481b-bd9e-91308ec2da39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:59.202155 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abadc7-3cf0-481b-bd9e-91308ec2da39 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:59.209038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:59.356791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1258/2544] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:06:59 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:59.363571 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7d6aa-852a-4386-8095-411173082f1a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:59.375920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7d6aa-852a-4386-8095-411173082f1a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:59.381917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554068d-abcb-47b1-a50a-0f0800120efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:59.382772 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554068d-abcb-47b1-a50a-0f0800120efa admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:59.383113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554068d-abcb-47b1-a50a-0f0800120efa admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:59.383384 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554068d-abcb-47b1-a50a-0f0800120efa admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:59.384241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554068d-abcb-47b1-a50a-0f0800120efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:59.386683 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554068d-abcb-47b1-a50a-0f0800120efa admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:59.399420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1287/2545] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:59.406193 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abadc7-3cf0-481b-bd9e-91308ec2da39 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:59.420495 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abadc7-3cf0-481b-bd9e-91308ec2da39 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:59.426116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc5278-d3aa-4720-9ff2-3bbcc7f8f7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:59.426876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc5278-d3aa-4720-9ff2-3bbcc7f8f7cd admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:59.427358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc5278-d3aa-4720-9ff2-3bbcc7f8f7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:59.427935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc5278-d3aa-4720-9ff2-3bbcc7f8f7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:59.429168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc5278-d3aa-4720-9ff2-3bbcc7f8f7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:59.431823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc5278-d3aa-4720-9ff2-3bbcc7f8f7cd admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:59.445458 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1259/2546] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:59.450653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554068d-abcb-47b1-a50a-0f0800120efa admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:59.461268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554068d-abcb-47b1-a50a-0f0800120efa admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:59.466078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7648c7-c120-4643-9138-3072a093698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:59.466986 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7648c7-c120-4643-9138-3072a093698d admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:59.467265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7648c7-c120-4643-9138-3072a093698d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:59.467535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7648c7-c120-4643-9138-3072a093698d admin admin] PATH_INFO: `/v3/projects/dde6e206891449b99a51eac73aae0ac1/users/fe394fc4208c4a359cfefa7d2de35eb0/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:59.487628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7648c7-c120-4643-9138-3072a093698d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde6e206891449b99a51eac73aae0ac1, user_id=fe394fc4208c4a359cfefa7d2de35eb0, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:59.491044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7648c7-c120-4643-9138-3072a093698d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:59.593257 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1288/2547] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:06:59 2022] PUT /identity/v3/projects/dde6e206891449b99a51eac73aae0ac1/users/fe394fc4208c4a359cfefa7d2de35eb0/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:59.603798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e10764-7423-4aa4-993f-98d39b697ba1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:59.604083 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e10764-7423-4aa4-993f-98d39b697ba1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:59.604471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e10764-7423-4aa4-993f-98d39b697ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:59.633728 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b0e10764-7423-4aa4-993f-98d39b697ba1 None None] MFA Rules not processed for user `fe394fc4208c4a359cfefa7d2de35eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:59.634957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b0e10764-7423-4aa4-993f-98d39b697ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:59.702446 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1260/2548] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:06:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:59.715931 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7648c7-c120-4643-9138-3072a093698d admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:59.717527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-9b7648c7-c120-4643-9138-3072a093698d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:59.776034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:59.798010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7648c7-c120-4643-9138-3072a093698d admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:59.804042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0335f4-2bbe-486e-8b85-c23232a2e0c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:59.804729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0335f4-2bbe-486e-8b85-c23232a2e0c9 service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:59.805010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0335f4-2bbe-486e-8b85-c23232a2e0c9 service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:59.805405 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0335f4-2bbe-486e-8b85-c23232a2e0c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:59.814897 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0335f4-2bbe-486e-8b85-c23232a2e0c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:59.816514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0335f4-2bbe-486e-8b85-c23232a2e0c9 service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:59.827203 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1289/2549] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:00.671962 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e10764-7423-4aa4-993f-98d39b697ba1 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:00.673439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b0e10764-7423-4aa4-993f-98d39b697ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:00.757872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e10764-7423-4aa4-993f-98d39b697ba1 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:00.771138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:00.771138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:00.771138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:00.771138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] PATH_INFO: `/v3/users/184756634102427a8467302396a41da4` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:00.771897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=184756634102427a8467302396a41da4)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:00.772533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:01.079894 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '184756634102427a8467302396a41da4'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:01.188236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '184756634102427a8467302396a41da4'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:01.189212 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '184756634102427a8467302396a41da4'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:01.208081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '184756634102427a8467302396a41da4'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:01.208081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '184756634102427a8467302396a41da4'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:01.208081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:01.221149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1261/2550] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:00 2022] DELETE /identity/v3/users/184756634102427a8467302396a41da4 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:01.226278 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf1b47-fbc2-4a88-ab09-b40f7d7d0543 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:01.226977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf1b47-fbc2-4a88-ab09-b40f7d7d0543 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:01.226977 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf1b47-fbc2-4a88-ab09-b40f7d7d0543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:01.248126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4acf1b47-fbc2-4a88-ab09-b40f7d7d0543 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:01.248126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4acf1b47-fbc2-4a88-ab09-b40f7d7d0543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:01.320464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1290/2551] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:01.331129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:01.332498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:01.397725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1818b-e0a4-4409-8835-e250820a6b28 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:01.402937 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538002f8-5e97-47c1-9d9d-efd036db37d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:01.403658 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538002f8-5e97-47c1-9d9d-efd036db37d5 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:01.403942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538002f8-5e97-47c1-9d9d-efd036db37d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:01.404219 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538002f8-5e97-47c1-9d9d-efd036db37d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:01.414248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538002f8-5e97-47c1-9d9d-efd036db37d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:01.415736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538002f8-5e97-47c1-9d9d-efd036db37d5 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:01.426566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1262/2552] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:01.925436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf1b47-fbc2-4a88-ab09-b40f7d7d0543 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:01.925436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4acf1b47-fbc2-4a88-ab09-b40f7d7d0543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:01.940806 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf1b47-fbc2-4a88-ab09-b40f7d7d0543 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:01.954364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:01.954364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:01.954364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:01.954364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] PATH_INFO: `/v3/projects/9f9de6681c4744828e5ab392e17ad3d5` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:01.955296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9de6681c4744828e5ab392e17ad3d5)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:01.957232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:02.084882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9de6681c4744828e5ab392e17ad3d5', 'request_id': 'req-e798c40c-e529-4d84-a88e-7832603f0ae7'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:02.180684 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9de6681c4744828e5ab392e17ad3d5', 'request_id': 'req-e798c40c-e529-4d84-a88e-7832603f0ae7'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:02.192383 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9de6681c4744828e5ab392e17ad3d5', 'request_id': 'req-e798c40c-e529-4d84-a88e-7832603f0ae7'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:02.203845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] The token cache is being invalidate because project 9f9de6681c4744828e5ab392e17ad3d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:02.204381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:02.205077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:02.206692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1291/2553] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:01 2022] DELETE /identity/v3/projects/9f9de6681c4744828e5ab392e17ad3d5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:02.210718 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538002f8-5e97-47c1-9d9d-efd036db37d5 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:02.221220 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538002f8-5e97-47c1-9d9d-efd036db37d5 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:02.293857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf4192-ac35-40e9-9ac6-dd9b4cf2a9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:02.294919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4192-ac35-40e9-9ac6-dd9b4cf2a9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:02.295355 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4192-ac35-40e9-9ac6-dd9b4cf2a9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:02.295738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4192-ac35-40e9-9ac6-dd9b4cf2a9c1 admin admin] PATH_INFO: `/v3/users/c6c14de1d7c740d5b0ca64699a4d1d61` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:02.297763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf4192-ac35-40e9-9ac6-dd9b4cf2a9c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c14de1d7c740d5b0ca64699a4d1d61)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:02.300085 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf4192-ac35-40e9-9ac6-dd9b4cf2a9c1 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:02.569705 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-55bf4192-ac35-40e9-9ac6-dd9b4cf2a9c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c14de1d7c740d5b0ca64699a4d1d61'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:02.701320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-55bf4192-ac35-40e9-9ac6-dd9b4cf2a9c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c14de1d7c740d5b0ca64699a4d1d61'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:02.702521 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-55bf4192-ac35-40e9-9ac6-dd9b4cf2a9c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c14de1d7c740d5b0ca64699a4d1d61'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:02.716566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-55bf4192-ac35-40e9-9ac6-dd9b4cf2a9c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c14de1d7c740d5b0ca64699a4d1d61'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:02.717852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-55bf4192-ac35-40e9-9ac6-dd9b4cf2a9c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c14de1d7c740d5b0ca64699a4d1d61'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:02.747283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1263/2554] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:02 2022] DELETE /identity/v3/users/c6c14de1d7c740d5b0ca64699a4d1d61 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:03.306495 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:03.308655 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:03.341251 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798c40c-e529-4d84-a88e-7832603f0ae7 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:03.426536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f0af0-d269-4ce9-869d-2f647c93edb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:03.427405 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0af0-d269-4ce9-869d-2f647c93edb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:03.427842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0af0-d269-4ce9-869d-2f647c93edb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:03.428312 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0af0-d269-4ce9-869d-2f647c93edb2 admin admin] PATH_INFO: `/v3/projects/0b9dc19992d94f50b2578465bc778446` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:03.429728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f0af0-d269-4ce9-869d-2f647c93edb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9dc19992d94f50b2578465bc778446)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:03.432205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f0af0-d269-4ce9-869d-2f647c93edb2 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:03.435291 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:03.599513 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d72f0af0-d269-4ce9-869d-2f647c93edb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9dc19992d94f50b2578465bc778446', 'request_id': 'req-d72f0af0-d269-4ce9-869d-2f647c93edb2'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:03.690065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d72f0af0-d269-4ce9-869d-2f647c93edb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9dc19992d94f50b2578465bc778446', 'request_id': 'req-d72f0af0-d269-4ce9-869d-2f647c93edb2'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:03.697259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d72f0af0-d269-4ce9-869d-2f647c93edb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9dc19992d94f50b2578465bc778446', 'request_id': 'req-d72f0af0-d269-4ce9-869d-2f647c93edb2'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:03.715174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d72f0af0-d269-4ce9-869d-2f647c93edb2 admin admin] The token cache is being invalidate because project 0b9dc19992d94f50b2578465bc778446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:03.715655 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d72f0af0-d269-4ce9-869d-2f647c93edb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:03.716601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-d72f0af0-d269-4ce9-869d-2f647c93edb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:03.719415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1292/2555] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:03 2022] DELETE /identity/v3/projects/0b9dc19992d94f50b2578465bc778446 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:03.727505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a99f40-6320-40ef-81bb-431de5fc4edd None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:03.728069 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a99f40-6320-40ef-81bb-431de5fc4edd None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:03.728450 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a99f40-6320-40ef-81bb-431de5fc4edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:03.760040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-86a99f40-6320-40ef-81bb-431de5fc4edd None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:03.761948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-86a99f40-6320-40ef-81bb-431de5fc4edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:03.766904 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:03.850286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1264/2556] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:03.864875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31474b91-ac28-413a-936b-31e290eff7c4 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:03.864875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31474b91-ac28-413a-936b-31e290eff7c4 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:03.864875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31474b91-ac28-413a-936b-31e290eff7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:03.892558 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-31474b91-ac28-413a-936b-31e290eff7c4 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:03.894023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-31474b91-ac28-413a-936b-31e290eff7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:03.906272 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1293/2557] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:03.913913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a99f40-6320-40ef-81bb-431de5fc4edd None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:03.925355 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a99f40-6320-40ef-81bb-431de5fc4edd None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:03.930193 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a00c8-d930-40e7-b55d-9b2222294fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:03.930854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a00c8-d930-40e7-b55d-9b2222294fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:03.931135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a00c8-d930-40e7-b55d-9b2222294fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:03.931407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a00c8-d930-40e7-b55d-9b2222294fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:03.932178 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a00c8-d930-40e7-b55d-9b2222294fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:03.933733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a00c8-d930-40e7-b55d-9b2222294fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:03.934745 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a00c8-d930-40e7-b55d-9b2222294fb0 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:03.948172 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1265/2558] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:07:03.952734 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31474b91-ac28-413a-936b-31e290eff7c4 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:03.963158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31474b91-ac28-413a-936b-31e290eff7c4 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:03.970360 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f48f4b-9e49-4c2f-b726-f3d30ecaca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:03.971116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f48f4b-9e49-4c2f-b726-f3d30ecaca16 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:03.971425 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f48f4b-9e49-4c2f-b726-f3d30ecaca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:03.971795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f48f4b-9e49-4c2f-b726-f3d30ecaca16 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:03.973148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f48f4b-9e49-4c2f-b726-f3d30ecaca16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:03.979059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f48f4b-9e49-4c2f-b726-f3d30ecaca16 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:04.118619 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1294/2559] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:03 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:04.122313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a00c8-d930-40e7-b55d-9b2222294fb0 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:04.137702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a00c8-d930-40e7-b55d-9b2222294fb0 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:04.203260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a8dd8-200d-43ee-a45d-d59f6e4c817b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:04.203997 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a8dd8-200d-43ee-a45d-d59f6e4c817b admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:04.204336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a8dd8-200d-43ee-a45d-d59f6e4c817b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:04.204671 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a8dd8-200d-43ee-a45d-d59f6e4c817b admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:04.205452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a8dd8-200d-43ee-a45d-d59f6e4c817b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:04.207567 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a8dd8-200d-43ee-a45d-d59f6e4c817b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:04.374017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1266/2560] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:04 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:04.378512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f48f4b-9e49-4c2f-b726-f3d30ecaca16 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:04.389221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f48f4b-9e49-4c2f-b726-f3d30ecaca16 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:04.394730 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a1d6c-042f-41ae-82fd-64bf8bd0fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:04.395745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a1d6c-042f-41ae-82fd-64bf8bd0fc02 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:04.395920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a1d6c-042f-41ae-82fd-64bf8bd0fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:04.396291 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a1d6c-042f-41ae-82fd-64bf8bd0fc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:04.397489 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a1d6c-042f-41ae-82fd-64bf8bd0fc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:04.412180 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a1d6c-042f-41ae-82fd-64bf8bd0fc02 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:04.412180 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1295/2561] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:04.415967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a8dd8-200d-43ee-a45d-d59f6e4c817b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:04.428879 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a8dd8-200d-43ee-a45d-d59f6e4c817b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:04.435046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25d6be-1907-4ae4-8d62-caac61b1f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:04.435813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25d6be-1907-4ae4-8d62-caac61b1f7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:04.436286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25d6be-1907-4ae4-8d62-caac61b1f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:04.436617 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25d6be-1907-4ae4-8d62-caac61b1f7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:04.437525 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25d6be-1907-4ae4-8d62-caac61b1f7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:04.439273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25d6be-1907-4ae4-8d62-caac61b1f7b7 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:04.451965 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1267/2562] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:04.460091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a1d6c-042f-41ae-82fd-64bf8bd0fc02 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:04.471816 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a1d6c-042f-41ae-82fd-64bf8bd0fc02 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:04.477200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da08e0c-9a85-4285-92b3-959ab6240d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:04.480103 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da08e0c-9a85-4285-92b3-959ab6240d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:04.480103 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da08e0c-9a85-4285-92b3-959ab6240d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:04.480103 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da08e0c-9a85-4285-92b3-959ab6240d09 admin admin] PATH_INFO: `/v3/projects/3935e706ad9f4bf09a47c2115cbc2d67/users/baea6e942d654b46b33185b2f5e5ea1e/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:04.497775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da08e0c-9a85-4285-92b3-959ab6240d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3935e706ad9f4bf09a47c2115cbc2d67, user_id=baea6e942d654b46b33185b2f5e5ea1e, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:04.507721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da08e0c-9a85-4285-92b3-959ab6240d09 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:04.639330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1296/2563] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:04 2022] PUT /identity/v3/projects/3935e706ad9f4bf09a47c2115cbc2d67/users/baea6e942d654b46b33185b2f5e5ea1e/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:04.652932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe1ac8-36c5-47a3-bb57-d7820c985cb9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:04.653281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe1ac8-36c5-47a3-bb57-d7820c985cb9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:04.653654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe1ac8-36c5-47a3-bb57-d7820c985cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:04.684360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ddbe1ac8-36c5-47a3-bb57-d7820c985cb9 None None] MFA Rules not processed for user `baea6e942d654b46b33185b2f5e5ea1e`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:04.685660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ddbe1ac8-36c5-47a3-bb57-d7820c985cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:04.755694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1268/2564] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:04.760174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da08e0c-9a85-4285-92b3-959ab6240d09 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:04.834620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da08e0c-9a85-4285-92b3-959ab6240d09 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:04.840412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065e543-a3f9-4b11-955a-469df5391baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:04.841369 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065e543-a3f9-4b11-955a-469df5391baf admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:04.841803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065e543-a3f9-4b11-955a-469df5391baf admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:04.842289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065e543-a3f9-4b11-955a-469df5391baf admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:04.843215 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065e543-a3f9-4b11-955a-469df5391baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:04.845653 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065e543-a3f9-4b11-955a-469df5391baf admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:04.974710 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1297/2565] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:04 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:04.979214 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe1ac8-36c5-47a3-bb57-d7820c985cb9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:04.991714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe1ac8-36c5-47a3-bb57-d7820c985cb9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:05.054882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d77c5-a2df-4642-b428-a2a5ad1012d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:05.055550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d77c5-a2df-4642-b428-a2a5ad1012d4 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:05.055832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d77c5-a2df-4642-b428-a2a5ad1012d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:05.056108 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d77c5-a2df-4642-b428-a2a5ad1012d4 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:05.056811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d77c5-a2df-4642-b428-a2a5ad1012d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:05.059301 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d77c5-a2df-4642-b428-a2a5ad1012d4 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:05.155919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:05.208150 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1269/2566] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:04 2022] POST /identity/v3/users => generated 296 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:05.212686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065e543-a3f9-4b11-955a-469df5391baf admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:05.224966 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065e543-a3f9-4b11-955a-469df5391baf admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:05.230654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb516dfc-ab24-434c-9784-486c4b5e9ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:05.231325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb516dfc-ab24-434c-9784-486c4b5e9ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:05.231610 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb516dfc-ab24-434c-9784-486c4b5e9ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:05.231890 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb516dfc-ab24-434c-9784-486c4b5e9ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:05.232624 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb516dfc-ab24-434c-9784-486c4b5e9ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:05.234282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb516dfc-ab24-434c-9784-486c4b5e9ce6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:05.240492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:05.246464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1298/2567] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:05.250701 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d77c5-a2df-4642-b428-a2a5ad1012d4 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:05.261728 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d77c5-a2df-4642-b428-a2a5ad1012d4 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:05.266414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde1352-8c18-4a9a-9942-988ee0ede20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:05.267325 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde1352-8c18-4a9a-9942-988ee0ede20d admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:05.267633 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde1352-8c18-4a9a-9942-988ee0ede20d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:05.267947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde1352-8c18-4a9a-9942-988ee0ede20d admin admin] PATH_INFO: `/v3/projects/cd86a8918f9f4201b7a0299b5d1047ce/users/127c407034d94275ba4a272d5dac5307/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:05.284553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde1352-8c18-4a9a-9942-988ee0ede20d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd86a8918f9f4201b7a0299b5d1047ce, user_id=127c407034d94275ba4a272d5dac5307, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:05.287278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde1352-8c18-4a9a-9942-988ee0ede20d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:05.418381 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1270/2568] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:05 2022] PUT /identity/v3/projects/cd86a8918f9f4201b7a0299b5d1047ce/users/127c407034d94275ba4a272d5dac5307/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:05.423385 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb516dfc-ab24-434c-9784-486c4b5e9ce6 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:05.433583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb516dfc-ab24-434c-9784-486c4b5e9ce6 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:05.498213 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f628085-3b5c-46d5-9d23-d61f27615ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:05.499186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f628085-3b5c-46d5-9d23-d61f27615ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:05.499632 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f628085-3b5c-46d5-9d23-d61f27615ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:05.499903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f628085-3b5c-46d5-9d23-d61f27615ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:05.500695 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f628085-3b5c-46d5-9d23-d61f27615ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:05.502444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f628085-3b5c-46d5-9d23-d61f27615ed3 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:05.520308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1299/2569] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:05.524857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde1352-8c18-4a9a-9942-988ee0ede20d admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:05.538154 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde1352-8c18-4a9a-9942-988ee0ede20d admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:05.543655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c49cfd-bf9c-4446-aa18-3b3c82faba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:05.544673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49cfd-bf9c-4446-aa18-3b3c82faba94 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:05.545018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49cfd-bf9c-4446-aa18-3b3c82faba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:05.545353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c49cfd-bf9c-4446-aa18-3b3c82faba94 admin admin] PATH_INFO: `/v3/projects/cd86a8918f9f4201b7a0299b5d1047ce/users/127c407034d94275ba4a272d5dac5307/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:05.547479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c49cfd-bf9c-4446-aa18-3b3c82faba94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd86a8918f9f4201b7a0299b5d1047ce, user_id=127c407034d94275ba4a272d5dac5307, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:05.550266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c49cfd-bf9c-4446-aa18-3b3c82faba94 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:05.563923 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1271/2570] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:05 2022] PUT /identity/v3/projects/cd86a8918f9f4201b7a0299b5d1047ce/users/127c407034d94275ba4a272d5dac5307/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:05.574349 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd498c4b-b519-42f9-aab8-a92ba5632176 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:05.574639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd498c4b-b519-42f9-aab8-a92ba5632176 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:05.574918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd498c4b-b519-42f9-aab8-a92ba5632176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:05.612149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-bd498c4b-b519-42f9-aab8-a92ba5632176 None None] MFA Rules not processed for user `127c407034d94275ba4a272d5dac5307`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:05.614149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-bd498c4b-b519-42f9-aab8-a92ba5632176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:05.717578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1300/2571] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:05.731229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c49cfd-bf9c-4446-aa18-3b3c82faba94 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:05.733704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-96c49cfd-bf9c-4446-aa18-3b3c82faba94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:05.803147 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c49cfd-bf9c-4446-aa18-3b3c82faba94 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:05.807407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e6f39-b2ab-42ea-b4e0-5d41ffdfb11b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:05.808400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e6f39-b2ab-42ea-b4e0-5d41ffdfb11b service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:05.808677 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e6f39-b2ab-42ea-b4e0-5d41ffdfb11b service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:05.809422 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e6f39-b2ab-42ea-b4e0-5d41ffdfb11b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:05.819278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e6f39-b2ab-42ea-b4e0-5d41ffdfb11b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:05.820925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e6f39-b2ab-42ea-b4e0-5d41ffdfb11b service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:05.833069 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1272/2572] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:07.096794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd498c4b-b519-42f9-aab8-a92ba5632176 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:07.100570 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-bd498c4b-b519-42f9-aab8-a92ba5632176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:07.241512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd498c4b-b519-42f9-aab8-a92ba5632176 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:07.252446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd72486-73b0-494e-aaee-7d34662525f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:07.253990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd72486-73b0-494e-aaee-7d34662525f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:07.254588 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd72486-73b0-494e-aaee-7d34662525f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:07.255232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd72486-73b0-494e-aaee-7d34662525f0 admin admin] PATH_INFO: `/v3/users/fe394fc4208c4a359cfefa7d2de35eb0` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:07.256774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd72486-73b0-494e-aaee-7d34662525f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe394fc4208c4a359cfefa7d2de35eb0)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:07.262278 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd72486-73b0-494e-aaee-7d34662525f0 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:07.296882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:07.299993 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e6f39-b2ab-42ea-b4e0-5d41ffdfb11b service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:07.312725 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e6f39-b2ab-42ea-b4e0-5d41ffdfb11b service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:07.318137 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32054ad-8d77-4b04-8fa1-fa709c2ab93d tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '127c407034d94275ba4a272d5dac5307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86a8918f9f4201b7a0299b5d1047ce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:07.318872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32054ad-8d77-4b04-8fa1-fa709c2ab93d tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:07.319158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32054ad-8d77-4b04-8fa1-fa709c2ab93d tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:07.319433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32054ad-8d77-4b04-8fa1-fa709c2ab93d tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:07.320377 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32054ad-8d77-4b04-8fa1-fa709c2ab93d tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:07.320687 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32054ad-8d77-4b04-8fa1-fa709c2ab93d tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:07.322361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32054ad-8d77-4b04-8fa1-fa709c2ab93d tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:07.358057 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1273/2573] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:07:07.360116 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32054ad-8d77-4b04-8fa1-fa709c2ab93d tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:07.379973 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32054ad-8d77-4b04-8fa1-fa709c2ab93d tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:07.387652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fbede-1cd2-40bd-8e72-6fa8d575000c tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '127c407034d94275ba4a272d5dac5307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86a8918f9f4201b7a0299b5d1047ce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:07.388498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fbede-1cd2-40bd-8e72-6fa8d575000c tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:07.388799 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fbede-1cd2-40bd-8e72-6fa8d575000c tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:07.389079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fbede-1cd2-40bd-8e72-6fa8d575000c tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:07.389905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fbede-1cd2-40bd-8e72-6fa8d575000c tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:07.399642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fbede-1cd2-40bd-8e72-6fa8d575000c tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:07.545082 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1274/2574] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:07 2022] POST /identity/v3/projects => generated 355 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:07.549935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fbede-1cd2-40bd-8e72-6fa8d575000c tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:07.596611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:07.642970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2cd72486-73b0-494e-aaee-7d34662525f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe394fc4208c4a359cfefa7d2de35eb0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:07.664734 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fbede-1cd2-40bd-8e72-6fa8d575000c tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:07.672542 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc7691-4624-46b2-b064-d7f5f8941cc3 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '127c407034d94275ba4a272d5dac5307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86a8918f9f4201b7a0299b5d1047ce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:07.673855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc7691-4624-46b2-b064-d7f5f8941cc3 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:07.674392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc7691-4624-46b2-b064-d7f5f8941cc3 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:07.674918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc7691-4624-46b2-b064-d7f5f8941cc3 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:07.676233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc7691-4624-46b2-b064-d7f5f8941cc3 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:07.676808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc7691-4624-46b2-b064-d7f5f8941cc3 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:07.680042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc7691-4624-46b2-b064-d7f5f8941cc3 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:07.696716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1275/2575] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:07:07.751768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc7691-4624-46b2-b064-d7f5f8941cc3 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:07.762866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc7691-4624-46b2-b064-d7f5f8941cc3 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:07.769419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '127c407034d94275ba4a272d5dac5307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd86a8918f9f4201b7a0299b5d1047ce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:07.770366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:07.770731 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:07.771077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] PATH_INFO: `/v3/projects/00c7450673334ad9a98005665f0c883e` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:07.772479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: Authorizing `identity:delete_project(project_id=00c7450673334ad9a98005665f0c883e)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:07.774817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:07.816425 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2cd72486-73b0-494e-aaee-7d34662525f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe394fc4208c4a359cfefa7d2de35eb0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:07.852636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2cd72486-73b0-494e-aaee-7d34662525f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe394fc4208c4a359cfefa7d2de35eb0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:07.853888 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2cd72486-73b0-494e-aaee-7d34662525f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe394fc4208c4a359cfefa7d2de35eb0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:07.855494 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2cd72486-73b0-494e-aaee-7d34662525f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe394fc4208c4a359cfefa7d2de35eb0'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:07.897455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1301/2576] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:07 2022] DELETE /identity/v3/users/fe394fc4208c4a359cfefa7d2de35eb0 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:07.900332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b925eb8-1110-4f37-9805-9939cc2121a5 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:07.900820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b925eb8-1110-4f37-9805-9939cc2121a5 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:07.901336 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b925eb8-1110-4f37-9805-9939cc2121a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:07.928374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4b925eb8-1110-4f37-9805-9939cc2121a5 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:07.930235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4b925eb8-1110-4f37-9805-9939cc2121a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:08.053603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c7450673334ad9a98005665f0c883e', 'request_id': 'req-aec3563d-d9b1-4f73-a0f0-8137736e0627'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:08.066532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1302/2577] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:08.094498 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b925eb8-1110-4f37-9805-9939cc2121a5 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:08.096590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4b925eb8-1110-4f37-9805-9939cc2121a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:08.187587 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c7450673334ad9a98005665f0c883e', 'request_id': 'req-aec3563d-d9b1-4f73-a0f0-8137736e0627'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:08.200428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c7450673334ad9a98005665f0c883e', 'request_id': 'req-aec3563d-d9b1-4f73-a0f0-8137736e0627'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:08.218277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] The token cache is being invalidate because project 00c7450673334ad9a98005665f0c883e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:08.218277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:08.218810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:08.220461 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1276/2578] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:07 2022] DELETE /identity/v3/projects/00c7450673334ad9a98005665f0c883e => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:08.226563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b925eb8-1110-4f37-9805-9939cc2121a5 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:08.343916 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab2fcc-de61-442f-9e7c-0cca402718ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:08.345039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab2fcc-de61-442f-9e7c-0cca402718ae service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:08.345523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab2fcc-de61-442f-9e7c-0cca402718ae service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:08.345815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab2fcc-de61-442f-9e7c-0cca402718ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:08.348767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:08.349266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4bab2fcc-de61-442f-9e7c-0cca402718ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:08.350642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:08.366146 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:08.447162 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab2fcc-de61-442f-9e7c-0cca402718ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:08.449246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab2fcc-de61-442f-9e7c-0cca402718ae service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:08.475819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1303/2579] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:08.484037 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3563d-d9b1-4f73-a0f0-8137736e0627 tempest-VolumeQuotaClassesTest-759137813 tempest-VolumeQuotaClassesTest-759137813-project-admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:08.495187 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:08.496388 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:08.498089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:08.498463 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] PATH_INFO: `/v3/users/da7293ac7a4e4fec8495864e3f59bf4c` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:08.500645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7293ac7a4e4fec8495864e3f59bf4c)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:08.508080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:08.837853 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:08.842330 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7293ac7a4e4fec8495864e3f59bf4c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:08.912163 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7293ac7a4e4fec8495864e3f59bf4c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:08.913413 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7293ac7a4e4fec8495864e3f59bf4c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:08.922134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7293ac7a4e4fec8495864e3f59bf4c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:08.922876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7293ac7a4e4fec8495864e3f59bf4c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:08.949172 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1277/2580] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:08 2022] DELETE /identity/v3/users/da7293ac7a4e4fec8495864e3f59bf4c => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:08.954989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed1c64-fb48-45a7-af55-924c7c8f18ec None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:08.955616 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed1c64-fb48-45a7-af55-924c7c8f18ec None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:08.956102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed1c64-fb48-45a7-af55-924c7c8f18ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:08.985868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-34ed1c64-fb48-45a7-af55-924c7c8f18ec None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:08.987186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-34ed1c64-fb48-45a7-af55-924c7c8f18ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:09.046161 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:09.047863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:09.093437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1304/2581] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:09.102289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed1c64-fb48-45a7-af55-924c7c8f18ec None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:09.103799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-34ed1c64-fb48-45a7-af55-924c7c8f18ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:09.162699 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101340b4-e3b6-413f-95a7-3974662b5c5a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:09.171400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35dedc-21b8-406c-9424-a31a6c1f0f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:09.174763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35dedc-21b8-406c-9424-a31a6c1f0f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.174763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35dedc-21b8-406c-9424-a31a6c1f0f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.174763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35dedc-21b8-406c-9424-a31a6c1f0f93 admin admin] PATH_INFO: `/v3/projects/dde6e206891449b99a51eac73aae0ac1` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.178393 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35dedc-21b8-406c-9424-a31a6c1f0f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde6e206891449b99a51eac73aae0ac1)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:09.178393 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35dedc-21b8-406c-9424-a31a6c1f0f93 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:09.187754 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed1c64-fb48-45a7-af55-924c7c8f18ec None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:09.191537 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cea85-89f8-468d-a21e-4d721157e780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:09.192194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cea85-89f8-468d-a21e-4d721157e780 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.192476 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cea85-89f8-468d-a21e-4d721157e780 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.192753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cea85-89f8-468d-a21e-4d721157e780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.203523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cea85-89f8-468d-a21e-4d721157e780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:09.205620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cea85-89f8-468d-a21e-4d721157e780 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:09.217224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1305/2582] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:09.218246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cea85-89f8-468d-a21e-4d721157e780 service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:09.219957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-731cea85-89f8-468d-a21e-4d721157e780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:09.233654 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cea85-89f8-468d-a21e-4d721157e780 service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:09.239333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59a28d-7d34-4e7c-8deb-276306cba926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:09.240136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59a28d-7d34-4e7c-8deb-276306cba926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.240412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59a28d-7d34-4e7c-8deb-276306cba926 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.240683 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59a28d-7d34-4e7c-8deb-276306cba926 admin admin] PATH_INFO: `/v3/users/baea6e942d654b46b33185b2f5e5ea1e` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.241974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59a28d-7d34-4e7c-8deb-276306cba926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baea6e942d654b46b33185b2f5e5ea1e)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:09.243925 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59a28d-7d34-4e7c-8deb-276306cba926 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:09.337599 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-2f35dedc-21b8-406c-9424-a31a6c1f0f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde6e206891449b99a51eac73aae0ac1', 'request_id': 'req-2f35dedc-21b8-406c-9424-a31a6c1f0f93'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:09.481034 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-2f35dedc-21b8-406c-9424-a31a6c1f0f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde6e206891449b99a51eac73aae0ac1', 'request_id': 'req-2f35dedc-21b8-406c-9424-a31a6c1f0f93'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:09.488844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-2f35dedc-21b8-406c-9424-a31a6c1f0f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde6e206891449b99a51eac73aae0ac1', 'request_id': 'req-2f35dedc-21b8-406c-9424-a31a6c1f0f93'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:09.504832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-2f35dedc-21b8-406c-9424-a31a6c1f0f93 admin admin] The token cache is being invalidate because project dde6e206891449b99a51eac73aae0ac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:09.505120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-2f35dedc-21b8-406c-9424-a31a6c1f0f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:09.505536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-fc59a28d-7d34-4e7c-8deb-276306cba926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baea6e942d654b46b33185b2f5e5ea1e'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:09.505918 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-2f35dedc-21b8-406c-9424-a31a6c1f0f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:09.507951 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1278/2583] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:09 2022] DELETE /identity/v3/projects/dde6e206891449b99a51eac73aae0ac1 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:09.513581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fbd70-62e8-49d4-ae7b-44e509f1e278 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.513864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fbd70-62e8-49d4-ae7b-44e509f1e278 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.514119 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fbd70-62e8-49d4-ae7b-44e509f1e278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.534033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-846fbd70-62e8-49d4-ae7b-44e509f1e278 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:09.535144 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-846fbd70-62e8-49d4-ae7b-44e509f1e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:09.589609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-fc59a28d-7d34-4e7c-8deb-276306cba926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baea6e942d654b46b33185b2f5e5ea1e'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:09.599641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-fc59a28d-7d34-4e7c-8deb-276306cba926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baea6e942d654b46b33185b2f5e5ea1e'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:09.603544 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-fc59a28d-7d34-4e7c-8deb-276306cba926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baea6e942d654b46b33185b2f5e5ea1e'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:09.603544 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-fc59a28d-7d34-4e7c-8deb-276306cba926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baea6e942d654b46b33185b2f5e5ea1e'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:09.607798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1279/2584] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:09.616169 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367356ea-ad18-4104-868c-efbd40712d09 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.616700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367356ea-ad18-4104-868c-efbd40712d09 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.616984 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367356ea-ad18-4104-868c-efbd40712d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.626907 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1306/2585] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:09 2022] DELETE /identity/v3/users/baea6e942d654b46b33185b2f5e5ea1e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:09.631956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133ccb0-6a70-4432-a7c2-b144f67da6bf None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.631956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133ccb0-6a70-4432-a7c2-b144f67da6bf None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.631956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133ccb0-6a70-4432-a7c2-b144f67da6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.637793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-367356ea-ad18-4104-868c-efbd40712d09 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:09.639020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-367356ea-ad18-4104-868c-efbd40712d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:09.658891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-9133ccb0-6a70-4432-a7c2-b144f67da6bf None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:09.660593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-9133ccb0-6a70-4432-a7c2-b144f67da6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:09.726255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1280/2586] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:09.731789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367356ea-ad18-4104-868c-efbd40712d09 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:09.741711 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1307/2587] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:09.743170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367356ea-ad18-4104-868c-efbd40712d09 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:09.749208 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f90be-4ce0-4d6e-b248-7204e7751b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:09.750435 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f90be-4ce0-4d6e-b248-7204e7751b3e admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.750822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f90be-4ce0-4d6e-b248-7204e7751b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.751184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f90be-4ce0-4d6e-b248-7204e7751b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.752064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133ccb0-6a70-4432-a7c2-b144f67da6bf None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:09.752244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f90be-4ce0-4d6e-b248-7204e7751b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:09.752598 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f90be-4ce0-4d6e-b248-7204e7751b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:09.754323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-9133ccb0-6a70-4432-a7c2-b144f67da6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:09.754512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f90be-4ce0-4d6e-b248-7204e7751b3e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:09.774442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1281/2588] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:07:09.779968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f90be-4ce0-4d6e-b248-7204e7751b3e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:09.791913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f90be-4ce0-4d6e-b248-7204e7751b3e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:09.798909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757aa67-1d3a-4e9f-b36c-8d5a5212df3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:09.799678 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757aa67-1d3a-4e9f-b36c-8d5a5212df3d admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.800045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757aa67-1d3a-4e9f-b36c-8d5a5212df3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.800155 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757aa67-1d3a-4e9f-b36c-8d5a5212df3d admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.800830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757aa67-1d3a-4e9f-b36c-8d5a5212df3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:09.802919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757aa67-1d3a-4e9f-b36c-8d5a5212df3d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:09.822276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133ccb0-6a70-4432-a7c2-b144f67da6bf None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:09.826928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef75dca-e9c0-4b42-8515-abb791abab22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:09.827726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef75dca-e9c0-4b42-8515-abb791abab22 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.827962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef75dca-e9c0-4b42-8515-abb791abab22 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.828237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef75dca-e9c0-4b42-8515-abb791abab22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.839177 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef75dca-e9c0-4b42-8515-abb791abab22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:09.840643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef75dca-e9c0-4b42-8515-abb791abab22 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:09.852196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1308/2589] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:09.852196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef75dca-e9c0-4b42-8515-abb791abab22 service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:09.853556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6ef75dca-e9c0-4b42-8515-abb791abab22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:09.867891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef75dca-e9c0-4b42-8515-abb791abab22 service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:09.873094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:09.874009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.874296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.874573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] PATH_INFO: `/v3/projects/b5013291ea9c40dd9b9462fd8abe641b` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.875972 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5013291ea9c40dd9b9462fd8abe641b)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:09.878031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:09.930876 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1282/2590] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:09 2022] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:09.933684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757aa67-1d3a-4e9f-b36c-8d5a5212df3d admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:10.012681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757aa67-1d3a-4e9f-b36c-8d5a5212df3d admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:10.026540 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5013291ea9c40dd9b9462fd8abe641b', 'request_id': 'req-0596e945-d484-4eb8-933a-375708a22d17'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.071062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025dbca-2302-417c-baf6-2d16fcd9ab84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:10.072000 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025dbca-2302-417c-baf6-2d16fcd9ab84 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:10.072288 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025dbca-2302-417c-baf6-2d16fcd9ab84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:10.072567 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025dbca-2302-417c-baf6-2d16fcd9ab84 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:10.073589 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025dbca-2302-417c-baf6-2d16fcd9ab84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:10.075748 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025dbca-2302-417c-baf6-2d16fcd9ab84 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:10.115688 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5013291ea9c40dd9b9462fd8abe641b', 'request_id': 'req-0596e945-d484-4eb8-933a-375708a22d17'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.122424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5013291ea9c40dd9b9462fd8abe641b', 'request_id': 'req-0596e945-d484-4eb8-933a-375708a22d17'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.134649 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] The token cache is being invalidate because project b5013291ea9c40dd9b9462fd8abe641b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:10.135075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.135902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.137560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1309/2591] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:09 2022] DELETE /identity/v3/projects/b5013291ea9c40dd9b9462fd8abe641b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:10.141399 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:10.142817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:10.157230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596e945-d484-4eb8-933a-375708a22d17 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:10.162107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968d259-625c-47ce-a43e-97948a730d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:10.163113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968d259-625c-47ce-a43e-97948a730d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:10.163405 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968d259-625c-47ce-a43e-97948a730d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:10.163686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968d259-625c-47ce-a43e-97948a730d6f admin admin] PATH_INFO: `/v3/users/efe9d56c6f4d4810a7c08725ad633eac` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:10.165037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968d259-625c-47ce-a43e-97948a730d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=efe9d56c6f4d4810a7c08725ad633eac)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:10.167690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968d259-625c-47ce-a43e-97948a730d6f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:10.188223 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1283/2592] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:09 2022] POST /identity/v3/users => generated 282 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:10.192376 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025dbca-2302-417c-baf6-2d16fcd9ab84 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:10.194335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-3025dbca-2302-417c-baf6-2d16fcd9ab84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:10.209611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025dbca-2302-417c-baf6-2d16fcd9ab84 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:10.212844 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d10a0d-573c-47c3-846c-a21a882e2eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:10.214405 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d10a0d-573c-47c3-846c-a21a882e2eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:10.214695 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d10a0d-573c-47c3-846c-a21a882e2eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:10.214976 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d10a0d-573c-47c3-846c-a21a882e2eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:10.215720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d10a0d-573c-47c3-846c-a21a882e2eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:10.217348 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d10a0d-573c-47c3-846c-a21a882e2eb3 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:10.228473 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1284/2593] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:10.233442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d10a0d-573c-47c3-846c-a21a882e2eb3 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:10.243840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d10a0d-573c-47c3-846c-a21a882e2eb3 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:10.249217 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055abba-759b-4d0f-8825-796b3c08b790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:10.249923 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055abba-759b-4d0f-8825-796b3c08b790 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:10.250209 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055abba-759b-4d0f-8825-796b3c08b790 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:10.250486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055abba-759b-4d0f-8825-796b3c08b790 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:10.251205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055abba-759b-4d0f-8825-796b3c08b790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:10.252822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055abba-759b-4d0f-8825-796b3c08b790 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:10.263439 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1285/2594] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:10.267553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055abba-759b-4d0f-8825-796b3c08b790 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:10.277456 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055abba-759b-4d0f-8825-796b3c08b790 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:10.282582 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625bcb6-474f-4246-bc13-77b308d33eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:10.287149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bcb6-474f-4246-bc13-77b308d33eec admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:10.287149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bcb6-474f-4246-bc13-77b308d33eec admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:10.287149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bcb6-474f-4246-bc13-77b308d33eec admin admin] PATH_INFO: `/v3/projects/087db60749fe4dcf82c001d0d954c4f4/users/89eb9c44484c4c199a1970c2f38b22df/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:10.299281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625bcb6-474f-4246-bc13-77b308d33eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=087db60749fe4dcf82c001d0d954c4f4, user_id=89eb9c44484c4c199a1970c2f38b22df, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:10.302241 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625bcb6-474f-4246-bc13-77b308d33eec admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:10.404068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1968d259-625c-47ce-a43e-97948a730d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efe9d56c6f4d4810a7c08725ad633eac'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.408803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:10.412378 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1286/2595] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:10 2022] PUT /identity/v3/projects/087db60749fe4dcf82c001d0d954c4f4/users/89eb9c44484c4c199a1970c2f38b22df/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:10.416907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625bcb6-474f-4246-bc13-77b308d33eec admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:10.418729 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4625bcb6-474f-4246-bc13-77b308d33eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:10.487857 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625bcb6-474f-4246-bc13-77b308d33eec admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:10.492723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:10.493667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:10.493946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:10.494216 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] PATH_INFO: `/v3/projects/3935e706ad9f4bf09a47c2115cbc2d67` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:10.495560 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3935e706ad9f4bf09a47c2115cbc2d67)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:10.497650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:10.498160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1968d259-625c-47ce-a43e-97948a730d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efe9d56c6f4d4810a7c08725ad633eac'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.506783 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1968d259-625c-47ce-a43e-97948a730d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efe9d56c6f4d4810a7c08725ad633eac'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.507523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1968d259-625c-47ce-a43e-97948a730d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efe9d56c6f4d4810a7c08725ad633eac'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.508586 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1968d259-625c-47ce-a43e-97948a730d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efe9d56c6f4d4810a7c08725ad633eac'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.530578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1310/2596] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:10 2022] DELETE /identity/v3/users/efe9d56c6f4d4810a7c08725ad633eac => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:10.532069 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dde103-a01e-471f-aff8-0c0b21c4f740 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:10.532363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dde103-a01e-471f-aff8-0c0b21c4f740 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:10.532670 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dde103-a01e-471f-aff8-0c0b21c4f740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:10.555268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:10.566290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-81dde103-a01e-471f-aff8-0c0b21c4f740 None None] MFA Rules not processed for user `89eb9c44484c4c199a1970c2f38b22df`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:10.567561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-81dde103-a01e-471f-aff8-0c0b21c4f740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:10.643475 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1311/2597] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:10.648800 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dde103-a01e-471f-aff8-0c0b21c4f740 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:10.652226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-81dde103-a01e-471f-aff8-0c0b21c4f740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:10.678759 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3935e706ad9f4bf09a47c2115cbc2d67', 'request_id': 'req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.743659 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dde103-a01e-471f-aff8-0c0b21c4f740 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:10.777194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3935e706ad9f4bf09a47c2115cbc2d67', 'request_id': 'req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.786050 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3935e706ad9f4bf09a47c2115cbc2d67', 'request_id': 'req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.801087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] The token cache is being invalidate because project 3935e706ad9f4bf09a47c2115cbc2d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:10.801410 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.810034 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:10.810034 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1287/2598] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:10 2022] DELETE /identity/v3/projects/3935e706ad9f4bf09a47c2115cbc2d67 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:10.811142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:10.812613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:10.825009 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55454f-4e76-4732-af77-62be86bb3f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:10.826407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55454f-4e76-4732-af77-62be86bb3f1a admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:10.826407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55454f-4e76-4732-af77-62be86bb3f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:10.826407 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55454f-4e76-4732-af77-62be86bb3f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:10.827141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55454f-4e76-4732-af77-62be86bb3f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:10.829572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55454f-4e76-4732-af77-62be86bb3f1a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:10.928460 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eb8a4-2ec2-4e6b-a00b-e9bfdac87847 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:10.936540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:10.938076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:10.938592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:10.939079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] PATH_INFO: `/v3/users/127c407034d94275ba4a272d5dac5307` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:10.941336 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=127c407034d94275ba4a272d5dac5307)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:10.945104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:10.963022 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1312/2599] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:10 2022] POST /identity/v3/projects => generated 361 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:10.968788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55454f-4e76-4732-af77-62be86bb3f1a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:10.971200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ea55454f-4e76-4732-af77-62be86bb3f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:11.053226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55454f-4e76-4732-af77-62be86bb3f1a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:11.058215 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530157b-46de-4839-8f15-eaed395aa991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:11.058896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530157b-46de-4839-8f15-eaed395aa991 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:11.059181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530157b-46de-4839-8f15-eaed395aa991 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:11.059488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530157b-46de-4839-8f15-eaed395aa991 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:11.060180 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530157b-46de-4839-8f15-eaed395aa991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:11.062267 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530157b-46de-4839-8f15-eaed395aa991 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:11.184589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1313/2600] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:10 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:11.184589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530157b-46de-4839-8f15-eaed395aa991 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:11.187646 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6530157b-46de-4839-8f15-eaed395aa991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:11.206437 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530157b-46de-4839-8f15-eaed395aa991 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:11.211838 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:11.212728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:11.213010 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:11.213311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d admin admin] PATH_INFO: `/v3/projects/60c1005ba7a94866a5eecc04136e2046` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:11.214608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c1005ba7a94866a5eecc04136e2046)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:11.216617 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:11.252037 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127c407034d94275ba4a272d5dac5307'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:11.315427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127c407034d94275ba4a272d5dac5307'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:11.316145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127c407034d94275ba4a272d5dac5307'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:11.325656 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127c407034d94275ba4a272d5dac5307'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:11.326006 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127c407034d94275ba4a272d5dac5307'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:11.344482 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:11.347369 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1288/2601] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:10 2022] DELETE /identity/v3/users/127c407034d94275ba4a272d5dac5307 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:11.348582 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:11.350901 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:11.369510 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c1005ba7a94866a5eecc04136e2046', 'request_id': 'req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:11.431196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4c061-46e1-476f-9d81-7ef28cb9c308 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:11.435325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c1005ba7a94866a5eecc04136e2046', 'request_id': 'req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:11.452101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c1005ba7a94866a5eecc04136e2046', 'request_id': 'req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:11.473473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d admin admin] The token cache is being invalidate because project 60c1005ba7a94866a5eecc04136e2046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:11.473833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:11.474565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5b4bb1e4-edd6-4286-9b3c-74c8bc18781d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:11.476400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1314/2602] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:11 2022] DELETE /identity/v3/projects/60c1005ba7a94866a5eecc04136e2046 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:11.481214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fee35-66b4-4054-a0b7-cbfbd3d2ff4d None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:11.481547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fee35-66b4-4054-a0b7-cbfbd3d2ff4d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:11.481809 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fee35-66b4-4054-a0b7-cbfbd3d2ff4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:11.501612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-bc4fee35-66b4-4054-a0b7-cbfbd3d2ff4d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:11.502851 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-bc4fee35-66b4-4054-a0b7-cbfbd3d2ff4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:11.505528 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43493fad-77a5-480c-a589-146a5b738272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:11.506038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43493fad-77a5-480c-a589-146a5b738272 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:11.506038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43493fad-77a5-480c-a589-146a5b738272 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:11.511900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43493fad-77a5-480c-a589-146a5b738272 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:11.511900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43493fad-77a5-480c-a589-146a5b738272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:11.511900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43493fad-77a5-480c-a589-146a5b738272 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:11.513351 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1315/2603] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:11.521423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1289/2604] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:11.522185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866123a-935c-4579-bb46-e69cc59de79d None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:11.522559 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866123a-935c-4579-bb46-e69cc59de79d None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:11.522913 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866123a-935c-4579-bb46-e69cc59de79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:11.525648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43493fad-77a5-480c-a589-146a5b738272 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:11.527938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-43493fad-77a5-480c-a589-146a5b738272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:11.540604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43493fad-77a5-480c-a589-146a5b738272 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:11.543859 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b866123a-935c-4579-bb46-e69cc59de79d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:11.545223 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b866123a-935c-4579-bb46-e69cc59de79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:11.546563 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bb069-2694-4960-810d-88cba45d7690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:11.547498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bb069-2694-4960-810d-88cba45d7690 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:11.547768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bb069-2694-4960-810d-88cba45d7690 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:11.548045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bb069-2694-4960-810d-88cba45d7690 admin admin] PATH_INFO: `/v3/projects/7407fc33ab6a4051a82cb2dff603d563/users/9d5153d21068407bb8af291b947245dc/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:11.554153 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1316/2605] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:11.565662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bb069-2694-4960-810d-88cba45d7690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7407fc33ab6a4051a82cb2dff603d563, user_id=9d5153d21068407bb8af291b947245dc, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:11.568382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bb069-2694-4960-810d-88cba45d7690 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:11.570141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866123a-935c-4579-bb46-e69cc59de79d None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:11.582997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866123a-935c-4579-bb46-e69cc59de79d None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:11.592053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4b0a8-f1e4-4540-bfe5-8bf8faff5b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:11.593210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4b0a8-f1e4-4540-bfe5-8bf8faff5b82 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:11.593836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4b0a8-f1e4-4540-bfe5-8bf8faff5b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:11.594271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4b0a8-f1e4-4540-bfe5-8bf8faff5b82 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:11.595603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4b0a8-f1e4-4540-bfe5-8bf8faff5b82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:11.596142 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4b0a8-f1e4-4540-bfe5-8bf8faff5b82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:11.599329 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4b0a8-f1e4-4540-bfe5-8bf8faff5b82 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:11.627908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1317/2606] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:07:11.629645 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4b0a8-f1e4-4540-bfe5-8bf8faff5b82 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:11.650656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4b0a8-f1e4-4540-bfe5-8bf8faff5b82 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:11.656869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d821f-c330-41aa-9d1d-25f93354317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:11.657759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d821f-c330-41aa-9d1d-25f93354317e admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:11.659045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d821f-c330-41aa-9d1d-25f93354317e admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:11.659307 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d821f-c330-41aa-9d1d-25f93354317e admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:11.660137 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d821f-c330-41aa-9d1d-25f93354317e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:11.662674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d821f-c330-41aa-9d1d-25f93354317e admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:11.673559 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1290/2607] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:11 2022] PUT /identity/v3/projects/7407fc33ab6a4051a82cb2dff603d563/users/9d5153d21068407bb8af291b947245dc/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:11.679238 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bb069-2694-4960-810d-88cba45d7690 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:11.763341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1318/2608] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:11 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:11.769682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d821f-c330-41aa-9d1d-25f93354317e admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:11.799306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bb069-2694-4960-810d-88cba45d7690 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:11.875326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d821f-c330-41aa-9d1d-25f93354317e admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:11.880993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb3172-c028-4b3d-8854-1235f5485213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:11.881879 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb3172-c028-4b3d-8854-1235f5485213 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:11.882166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb3172-c028-4b3d-8854-1235f5485213 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:11.882441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb3172-c028-4b3d-8854-1235f5485213 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:11.883191 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb3172-c028-4b3d-8854-1235f5485213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:11.885274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb3172-c028-4b3d-8854-1235f5485213 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:11.897934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f367035-f5a6-4a5c-8fc5-dd79df999fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:11.897934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367035-f5a6-4a5c-8fc5-dd79df999fad admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:11.897934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367035-f5a6-4a5c-8fc5-dd79df999fad admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:11.897934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367035-f5a6-4a5c-8fc5-dd79df999fad admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:11.903273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f367035-f5a6-4a5c-8fc5-dd79df999fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:11.903273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f367035-f5a6-4a5c-8fc5-dd79df999fad admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:11.914703 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1291/2609] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:11.921344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f367035-f5a6-4a5c-8fc5-dd79df999fad admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:11.934402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:11.937796 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f367035-f5a6-4a5c-8fc5-dd79df999fad admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:11.945817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fe14a-5882-46a0-ad7f-1a0d70279876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:11.946855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe14a-5882-46a0-ad7f-1a0d70279876 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:11.947185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe14a-5882-46a0-ad7f-1a0d70279876 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:11.947506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe14a-5882-46a0-ad7f-1a0d70279876 admin admin] PATH_INFO: `/v3/projects/7407fc33ab6a4051a82cb2dff603d563/users/9d5153d21068407bb8af291b947245dc/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:11.949945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fe14a-5882-46a0-ad7f-1a0d70279876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7407fc33ab6a4051a82cb2dff603d563, user_id=9d5153d21068407bb8af291b947245dc, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:11.952770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fe14a-5882-46a0-ad7f-1a0d70279876 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:11.965842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1292/2610] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:11 2022] PUT /identity/v3/projects/7407fc33ab6a4051a82cb2dff603d563/users/9d5153d21068407bb8af291b947245dc/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:11.986361 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428330-6fd2-4012-b762-65a8d5037d2c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:11.986699 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428330-6fd2-4012-b762-65a8d5037d2c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:11.987046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428330-6fd2-4012-b762-65a8d5037d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:12.019558 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-36428330-6fd2-4012-b762-65a8d5037d2c None None] MFA Rules not processed for user `9d5153d21068407bb8af291b947245dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:12.020803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-36428330-6fd2-4012-b762-65a8d5037d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:12.061751 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1319/2611] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:11 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:12.063090 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb3172-c028-4b3d-8854-1235f5485213 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:12.066438 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3ecb3172-c028-4b3d-8854-1235f5485213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:12.083926 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb3172-c028-4b3d-8854-1235f5485213 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:12.127162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1293/2612] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:11 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:12.128201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36428330-6fd2-4012-b762-65a8d5037d2c None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:12.152185 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a54ac1-2670-458a-885e-1ad56d34c127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:12.153220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a54ac1-2670-458a-885e-1ad56d34c127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:12.153539 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a54ac1-2670-458a-885e-1ad56d34c127 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:12.153815 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a54ac1-2670-458a-885e-1ad56d34c127 admin admin] PATH_INFO: `/v3/projects/cd86a8918f9f4201b7a0299b5d1047ce` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:12.155059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a54ac1-2670-458a-885e-1ad56d34c127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd86a8918f9f4201b7a0299b5d1047ce)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:12.157027 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a54ac1-2670-458a-885e-1ad56d34c127 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:12.201319 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36428330-6fd2-4012-b762-65a8d5037d2c None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:12.206072 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d737c-423b-4bf4-895b-71c4e221c2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:12.206753 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d737c-423b-4bf4-895b-71c4e221c2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:12.207034 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d737c-423b-4bf4-895b-71c4e221c2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:12.207309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d737c-423b-4bf4-895b-71c4e221c2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:12.208047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d737c-423b-4bf4-895b-71c4e221c2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:12.209696 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d737c-423b-4bf4-895b-71c4e221c2f4 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:12.220620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1294/2613] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:12.224270 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d737c-423b-4bf4-895b-71c4e221c2f4 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:12.224270 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c03d737c-423b-4bf4-895b-71c4e221c2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:12.292380 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d737c-423b-4bf4-895b-71c4e221c2f4 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:12.296909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043dbfe-55c5-408d-9e52-26875893d199 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:12.297795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043dbfe-55c5-408d-9e52-26875893d199 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:12.298128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043dbfe-55c5-408d-9e52-26875893d199 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:12.298486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043dbfe-55c5-408d-9e52-26875893d199 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:12.316547 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043dbfe-55c5-408d-9e52-26875893d199 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:12.318283 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f7a54ac1-2670-458a-885e-1ad56d34c127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd86a8918f9f4201b7a0299b5d1047ce', 'request_id': 'req-f7a54ac1-2670-458a-885e-1ad56d34c127'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:12.318977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043dbfe-55c5-408d-9e52-26875893d199 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:12.337795 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1295/2614] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:12 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:12.340062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043dbfe-55c5-408d-9e52-26875893d199 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:12.356747 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043dbfe-55c5-408d-9e52-26875893d199 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:12.403702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f7a54ac1-2670-458a-885e-1ad56d34c127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd86a8918f9f4201b7a0299b5d1047ce', 'request_id': 'req-f7a54ac1-2670-458a-885e-1ad56d34c127'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:12.416206 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f7a54ac1-2670-458a-885e-1ad56d34c127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd86a8918f9f4201b7a0299b5d1047ce', 'request_id': 'req-f7a54ac1-2670-458a-885e-1ad56d34c127'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:12.436840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f7a54ac1-2670-458a-885e-1ad56d34c127 admin admin] The token cache is being invalidate because project cd86a8918f9f4201b7a0299b5d1047ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:12.437982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f7a54ac1-2670-458a-885e-1ad56d34c127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:12.438520 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca45522-eac3-4fe2-8d4f-156fff0ed156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:12.438755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f7a54ac1-2670-458a-885e-1ad56d34c127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:12.439334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45522-eac3-4fe2-8d4f-156fff0ed156 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:12.439685 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45522-eac3-4fe2-8d4f-156fff0ed156 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:12.440076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45522-eac3-4fe2-8d4f-156fff0ed156 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:12.440892 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca45522-eac3-4fe2-8d4f-156fff0ed156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:12.441840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1320/2615] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:12 2022] DELETE /identity/v3/projects/cd86a8918f9f4201b7a0299b5d1047ce => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:12.442947 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca45522-eac3-4fe2-8d4f-156fff0ed156 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:12.453116 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a246-9f70-42c4-a9e0-a87733578c43 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:12.453875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a246-9f70-42c4-a9e0-a87733578c43 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:12.454378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a246-9f70-42c4-a9e0-a87733578c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:12.456333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1296/2616] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:12.461204 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca45522-eac3-4fe2-8d4f-156fff0ed156 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:12.463858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-eca45522-eac3-4fe2-8d4f-156fff0ed156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:12.483160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca45522-eac3-4fe2-8d4f-156fff0ed156 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:12.491552 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646d713-9362-4bce-86d1-7fddd7977d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:12.492772 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646d713-9362-4bce-86d1-7fddd7977d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:12.493220 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646d713-9362-4bce-86d1-7fddd7977d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:12.493564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-56c5a246-9f70-42c4-a9e0-a87733578c43 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:12.493866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646d713-9362-4bce-86d1-7fddd7977d94 admin admin] PATH_INFO: `/v3/projects/9c6ae1cf6c8e4b2d9ef92a251d2dd591/users/79a2fe76b0a24817ace8d9a36588375d/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:12.496457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-56c5a246-9f70-42c4-a9e0-a87733578c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:12.514503 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1321/2617] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:12.516667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7774e6-0eaa-4af8-b0e4-b22f6aaca329 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:12.517172 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7774e6-0eaa-4af8-b0e4-b22f6aaca329 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:12.517674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7774e6-0eaa-4af8-b0e4-b22f6aaca329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:12.525559 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646d713-9362-4bce-86d1-7fddd7977d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6ae1cf6c8e4b2d9ef92a251d2dd591, user_id=79a2fe76b0a24817ace8d9a36588375d, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:12.531683 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646d713-9362-4bce-86d1-7fddd7977d94 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:12.541210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6a7774e6-0eaa-4af8-b0e4-b22f6aaca329 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:12.542643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6a7774e6-0eaa-4af8-b0e4-b22f6aaca329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:12.552869 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1322/2618] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:12.558485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7774e6-0eaa-4af8-b0e4-b22f6aaca329 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:12.570102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7774e6-0eaa-4af8-b0e4-b22f6aaca329 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:12.576946 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d11b0-39d5-49a5-920f-b7791f54a07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:12.577859 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d11b0-39d5-49a5-920f-b7791f54a07f admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:12.578313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d11b0-39d5-49a5-920f-b7791f54a07f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:12.578744 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d11b0-39d5-49a5-920f-b7791f54a07f admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:12.579765 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d11b0-39d5-49a5-920f-b7791f54a07f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:12.580231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d11b0-39d5-49a5-920f-b7791f54a07f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:12.582226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d11b0-39d5-49a5-920f-b7791f54a07f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:12.597348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1323/2619] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:07:12.603363 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d11b0-39d5-49a5-920f-b7791f54a07f admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:12.623729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d11b0-39d5-49a5-920f-b7791f54a07f admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:12.633771 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a22760-3228-433a-b087-c214fcc1f104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:12.634924 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a22760-3228-433a-b087-c214fcc1f104 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:12.635982 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a22760-3228-433a-b087-c214fcc1f104 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:12.636469 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a22760-3228-433a-b087-c214fcc1f104 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:12.637593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a22760-3228-433a-b087-c214fcc1f104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:12.641062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a22760-3228-433a-b087-c214fcc1f104 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:12.654850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1297/2620] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:12 2022] PUT /identity/v3/projects/9c6ae1cf6c8e4b2d9ef92a251d2dd591/users/79a2fe76b0a24817ace8d9a36588375d/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:12.656096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646d713-9362-4bce-86d1-7fddd7977d94 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:12.659092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2646d713-9362-4bce-86d1-7fddd7977d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:12.727948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646d713-9362-4bce-86d1-7fddd7977d94 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:12.732417 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d902b0c-be6d-449f-aa78-4e0578b47591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:12.733118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d902b0c-be6d-449f-aa78-4e0578b47591 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:12.733433 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d902b0c-be6d-449f-aa78-4e0578b47591 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:12.733713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d902b0c-be6d-449f-aa78-4e0578b47591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:12.735659 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1d902b0c-be6d-449f-aa78-4e0578b47591 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:12.746401 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:12.784957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1324/2621] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:12 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:12.787424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e57fe3-1f3b-4110-8701-65f1e91e4656 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:12.788317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e57fe3-1f3b-4110-8701-65f1e91e4656 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:12.788833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e57fe3-1f3b-4110-8701-65f1e91e4656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:12.808958 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d902b0c-be6d-449f-aa78-4e0578b47591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:12.810425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d902b0c-be6d-449f-aa78-4e0578b47591 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:12.822077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1298/2622] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:12 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:12.823448 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d902b0c-be6d-449f-aa78-4e0578b47591 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:12.860130 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-16e57fe3-1f3b-4110-8701-65f1e91e4656 None None] MFA Rules not processed for user `79a2fe76b0a24817ace8d9a36588375d`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:12.862032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-16e57fe3-1f3b-4110-8701-65f1e91e4656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:12.944598 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d902b0c-be6d-449f-aa78-4e0578b47591 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:12.980559 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:12.992385 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1325/2623] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:13.001220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e57fe3-1f3b-4110-8701-65f1e91e4656 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:13.040516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec54bf-08a5-40c3-bbc3-216a17239fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:13.041287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec54bf-08a5-40c3-bbc3-216a17239fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.042150 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec54bf-08a5-40c3-bbc3-216a17239fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.042428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec54bf-08a5-40c3-bbc3-216a17239fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.043242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec54bf-08a5-40c3-bbc3-216a17239fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:13.046064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec54bf-08a5-40c3-bbc3-216a17239fc2 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:13.136928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e57fe3-1f3b-4110-8701-65f1e91e4656 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:13.145255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb5db4-f603-4945-9d36-155a9eb10b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:13.146847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb5db4-f603-4945-9d36-155a9eb10b82 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.146970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb5db4-f603-4945-9d36-155a9eb10b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.147399 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb5db4-f603-4945-9d36-155a9eb10b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.148709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb5db4-f603-4945-9d36-155a9eb10b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:13.152820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb5db4-f603-4945-9d36-155a9eb10b82 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:13.219624 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1299/2624] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:12 2022] POST /identity/v3/users => generated 291 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:13.223473 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec54bf-08a5-40c3-bbc3-216a17239fc2 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:13.235393 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec54bf-08a5-40c3-bbc3-216a17239fc2 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:13.241175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6826f-2fa6-4984-8ece-61068d3c2b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:13.242058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6826f-2fa6-4984-8ece-61068d3c2b66 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.242465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6826f-2fa6-4984-8ece-61068d3c2b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.242634 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6826f-2fa6-4984-8ece-61068d3c2b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.243403 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6826f-2fa6-4984-8ece-61068d3c2b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:13.245113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6826f-2fa6-4984-8ece-61068d3c2b66 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:13.256067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1300/2625] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:13.260243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6826f-2fa6-4984-8ece-61068d3c2b66 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:13.277058 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1326/2626] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:12 2022] POST /identity/v3/projects => generated 381 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:13.278253 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb5db4-f603-4945-9d36-155a9eb10b82 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:13.283419 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6826f-2fa6-4984-8ece-61068d3c2b66 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:13.399310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb5db4-f603-4945-9d36-155a9eb10b82 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:13.405506 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317b494-5022-4283-abcb-02cfe3bd2b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:13.406408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317b494-5022-4283-abcb-02cfe3bd2b1f admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.406768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317b494-5022-4283-abcb-02cfe3bd2b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.407120 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317b494-5022-4283-abcb-02cfe3bd2b1f admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.407887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317b494-5022-4283-abcb-02cfe3bd2b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:13.410503 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317b494-5022-4283-abcb-02cfe3bd2b1f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:13.421930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd95c8-c198-48a8-9757-20ffd01b713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:13.422618 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd95c8-c198-48a8-9757-20ffd01b713b admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.422907 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd95c8-c198-48a8-9757-20ffd01b713b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.423459 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd95c8-c198-48a8-9757-20ffd01b713b admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.424026 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd95c8-c198-48a8-9757-20ffd01b713b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:13.425664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd95c8-c198-48a8-9757-20ffd01b713b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:13.438313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1301/2627] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:13.442735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd95c8-c198-48a8-9757-20ffd01b713b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:13.454502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd95c8-c198-48a8-9757-20ffd01b713b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:13.460485 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8b869-fe82-476b-a110-dbc33c87eeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:13.461637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8b869-fe82-476b-a110-dbc33c87eeb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.461980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8b869-fe82-476b-a110-dbc33c87eeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.462297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8b869-fe82-476b-a110-dbc33c87eeb4 admin admin] PATH_INFO: `/v3/projects/7625260adc464ec9994447cff05a1fc1/users/cb98e8d742b34e6ab1a970e5a1d2fe18/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.481103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8b869-fe82-476b-a110-dbc33c87eeb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7625260adc464ec9994447cff05a1fc1, user_id=cb98e8d742b34e6ab1a970e5a1d2fe18, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:13.483851 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8b869-fe82-476b-a110-dbc33c87eeb4 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:13.500014 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1327/2628] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:13 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:13.504286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317b494-5022-4283-abcb-02cfe3bd2b1f admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:13.514754 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317b494-5022-4283-abcb-02cfe3bd2b1f admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:13.519794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bb33c-04e4-4a4a-a10a-c7d4d52c8222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:13.520461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bb33c-04e4-4a4a-a10a-c7d4d52c8222 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.520793 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bb33c-04e4-4a4a-a10a-c7d4d52c8222 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.521039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bb33c-04e4-4a4a-a10a-c7d4d52c8222 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.521797 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bb33c-04e4-4a4a-a10a-c7d4d52c8222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:13.525461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bb33c-04e4-4a4a-a10a-c7d4d52c8222 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:13.534191 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1328/2629] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:13.538508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bb33c-04e4-4a4a-a10a-c7d4d52c8222 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:13.549126 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bb33c-04e4-4a4a-a10a-c7d4d52c8222 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:13.554337 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d6715-25c0-4c3c-b865-509318bc7280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:13.555240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d6715-25c0-4c3c-b865-509318bc7280 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.555527 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d6715-25c0-4c3c-b865-509318bc7280 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.555808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d6715-25c0-4c3c-b865-509318bc7280 admin admin] PATH_INFO: `/v3/projects/d59008de20f4480b8cf06cc4f0a125fd/users/a4cccf48544b40a48d52ec10705243ac/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.573212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d6715-25c0-4c3c-b865-509318bc7280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59008de20f4480b8cf06cc4f0a125fd, user_id=a4cccf48544b40a48d52ec10705243ac, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:13.575922 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d6715-25c0-4c3c-b865-509318bc7280 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:13.586225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1302/2630] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:13 2022] PUT /identity/v3/projects/7625260adc464ec9994447cff05a1fc1/users/cb98e8d742b34e6ab1a970e5a1d2fe18/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:13.600636 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77788a05-312a-436d-8302-b184bac1c8e9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.600845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77788a05-312a-436d-8302-b184bac1c8e9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.601453 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77788a05-312a-436d-8302-b184bac1c8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.631883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-77788a05-312a-436d-8302-b184bac1c8e9 None None] MFA Rules not processed for user `cb98e8d742b34e6ab1a970e5a1d2fe18`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:13.633126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-77788a05-312a-436d-8302-b184bac1c8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:13.666615 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1329/2631] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:13 2022] PUT /identity/v3/projects/d59008de20f4480b8cf06cc4f0a125fd/users/a4cccf48544b40a48d52ec10705243ac/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:13.670608 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d6715-25c0-4c3c-b865-509318bc7280 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:13.701053 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1303/2632] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:13.705585 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77788a05-312a-436d-8302-b184bac1c8e9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:13.735904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d6715-25c0-4c3c-b865-509318bc7280 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:13.740957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cfaea-d2a5-4913-8000-0e34429241f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:13.741708 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cfaea-d2a5-4913-8000-0e34429241f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.741997 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cfaea-d2a5-4913-8000-0e34429241f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.742268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cfaea-d2a5-4913-8000-0e34429241f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.742995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cfaea-d2a5-4913-8000-0e34429241f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:13.744612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cfaea-d2a5-4913-8000-0e34429241f5 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:13.756546 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1330/2633] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:13.761897 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cfaea-d2a5-4913-8000-0e34429241f5 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:13.771726 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cfaea-d2a5-4913-8000-0e34429241f5 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:13.774035 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77788a05-312a-436d-8302-b184bac1c8e9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:13.777036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f11f0-7a6c-41a5-9b45-3b5ed97d2d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:13.777960 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f11f0-7a6c-41a5-9b45-3b5ed97d2d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.778245 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f11f0-7a6c-41a5-9b45-3b5ed97d2d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.778522 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f11f0-7a6c-41a5-9b45-3b5ed97d2d21 admin admin] PATH_INFO: `/v3/projects/d59008de20f4480b8cf06cc4f0a125fd/users/a4cccf48544b40a48d52ec10705243ac/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.779469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f0b26-bed5-49cd-bfa6-5e5180c253ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:13.780222 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f0b26-bed5-49cd-bfa6-5e5180c253ba admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.780515 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f0b26-bed5-49cd-bfa6-5e5180c253ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.780635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f11f0-7a6c-41a5-9b45-3b5ed97d2d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59008de20f4480b8cf06cc4f0a125fd, user_id=a4cccf48544b40a48d52ec10705243ac, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:13.780821 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f0b26-bed5-49cd-bfa6-5e5180c253ba admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.781752 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f0b26-bed5-49cd-bfa6-5e5180c253ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:13.783265 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f11f0-7a6c-41a5-9b45-3b5ed97d2d21 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:13.783443 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f0b26-bed5-49cd-bfa6-5e5180c253ba admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:13.794817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1331/2634] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:13 2022] PUT /identity/v3/projects/d59008de20f4480b8cf06cc4f0a125fd/users/a4cccf48544b40a48d52ec10705243ac/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:13.805106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3645005-2a95-4955-9b8c-3e44a6be65b3 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.805399 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3645005-2a95-4955-9b8c-3e44a6be65b3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.805716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3645005-2a95-4955-9b8c-3e44a6be65b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.835223 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-d3645005-2a95-4955-9b8c-3e44a6be65b3 None None] MFA Rules not processed for user `a4cccf48544b40a48d52ec10705243ac`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:13.836422 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d3645005-2a95-4955-9b8c-3e44a6be65b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:13.897496 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1304/2635] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:13 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:13.901144 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f0b26-bed5-49cd-bfa6-5e5180c253ba admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:13.924194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1332/2636] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:13.933659 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3645005-2a95-4955-9b8c-3e44a6be65b3 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:13.980754 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f0b26-bed5-49cd-bfa6-5e5180c253ba admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:13.988481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f6568-4bb7-4686-a768-25d615df1693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:13.989666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f6568-4bb7-4686-a768-25d615df1693 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:13.990176 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f6568-4bb7-4686-a768-25d615df1693 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:13.990646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f6568-4bb7-4686-a768-25d615df1693 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:13.991899 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f6568-4bb7-4686-a768-25d615df1693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:13.994847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f6568-4bb7-4686-a768-25d615df1693 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:14.005781 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3645005-2a95-4955-9b8c-3e44a6be65b3 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:14.017318 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:14.068939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93048172-f07c-449d-92ad-cacad3bd8de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:14.070089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93048172-f07c-449d-92ad-cacad3bd8de7 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:14.070578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93048172-f07c-449d-92ad-cacad3bd8de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:14.071066 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93048172-f07c-449d-92ad-cacad3bd8de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:14.134427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1305/2637] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:13 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:14.139249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f6568-4bb7-4686-a768-25d615df1693 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:14.145473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93048172-f07c-449d-92ad-cacad3bd8de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:14.147387 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93048172-f07c-449d-92ad-cacad3bd8de7 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:14.150524 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f6568-4bb7-4686-a768-25d615df1693 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:14.158314 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1333/2638] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:14.158803 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b99277-135d-4a37-860b-5b98bc351c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:14.160014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b99277-135d-4a37-860b-5b98bc351c1a admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:14.160512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b99277-135d-4a37-860b-5b98bc351c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:14.160833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b99277-135d-4a37-860b-5b98bc351c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:14.162272 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b99277-135d-4a37-860b-5b98bc351c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:14.165235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b99277-135d-4a37-860b-5b98bc351c1a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:14.187546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1306/2639] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:14.189889 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93048172-f07c-449d-92ad-cacad3bd8de7 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:14.202423 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93048172-f07c-449d-92ad-cacad3bd8de7 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:14.207032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28ae7-047b-4dbb-a24f-5c25bc610df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:14.208144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28ae7-047b-4dbb-a24f-5c25bc610df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:14.208390 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28ae7-047b-4dbb-a24f-5c25bc610df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:14.208710 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28ae7-047b-4dbb-a24f-5c25bc610df6 admin admin] PATH_INFO: `/v3/projects/d207dcaad24847a1a4bb1f8813cc954e/users/e91a3029117f4c8eaf971ffa442a016e/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:14.225079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b28ae7-047b-4dbb-a24f-5c25bc610df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d207dcaad24847a1a4bb1f8813cc954e, user_id=e91a3029117f4c8eaf971ffa442a016e, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:14.227834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b28ae7-047b-4dbb-a24f-5c25bc610df6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:14.367603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1334/2640] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:14 2022] PUT /identity/v3/projects/d207dcaad24847a1a4bb1f8813cc954e/users/e91a3029117f4c8eaf971ffa442a016e/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:14.368735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b99277-135d-4a37-860b-5b98bc351c1a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:14.371974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28ae7-047b-4dbb-a24f-5c25bc610df6 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:14.389854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b99277-135d-4a37-860b-5b98bc351c1a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:14.443008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:14.472600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650292aa-ebcf-43ef-a873-070ea5b256b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:14.473713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650292aa-ebcf-43ef-a873-070ea5b256b5 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:14.473885 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650292aa-ebcf-43ef-a873-070ea5b256b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:14.474264 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650292aa-ebcf-43ef-a873-070ea5b256b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:14.489485 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28ae7-047b-4dbb-a24f-5c25bc610df6 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:14.495099 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f33a71-1a55-4f7e-93bf-3f895a09f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:14.496000 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f33a71-1a55-4f7e-93bf-3f895a09f8dc admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:14.496406 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f33a71-1a55-4f7e-93bf-3f895a09f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:14.496684 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f33a71-1a55-4f7e-93bf-3f895a09f8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:14.497566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f33a71-1a55-4f7e-93bf-3f895a09f8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:14.499194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f33a71-1a55-4f7e-93bf-3f895a09f8dc admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:14.511033 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1335/2641] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:14.516514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f33a71-1a55-4f7e-93bf-3f895a09f8dc admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:14.528100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f33a71-1a55-4f7e-93bf-3f895a09f8dc admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:14.534281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e18ed4-9bbf-402c-a61d-e9c604ae21a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:14.535547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e18ed4-9bbf-402c-a61d-e9c604ae21a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:14.536032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e18ed4-9bbf-402c-a61d-e9c604ae21a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:14.536356 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e18ed4-9bbf-402c-a61d-e9c604ae21a4 admin admin] PATH_INFO: `/v3/projects/d207dcaad24847a1a4bb1f8813cc954e/users/e91a3029117f4c8eaf971ffa442a016e/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:14.539049 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e18ed4-9bbf-402c-a61d-e9c604ae21a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d207dcaad24847a1a4bb1f8813cc954e, user_id=e91a3029117f4c8eaf971ffa442a016e, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:14.542764 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e18ed4-9bbf-402c-a61d-e9c604ae21a4 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:14.550925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650292aa-ebcf-43ef-a873-070ea5b256b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:14.556938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650292aa-ebcf-43ef-a873-070ea5b256b5 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:14.563006 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1336/2642] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:14 2022] PUT /identity/v3/projects/d207dcaad24847a1a4bb1f8813cc954e/users/e91a3029117f4c8eaf971ffa442a016e/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:14.582276 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb47c-9a6e-40b4-9ce3-3446713029c8 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:14.582758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb47c-9a6e-40b4-9ce3-3446713029c8 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:14.583226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb47c-9a6e-40b4-9ce3-3446713029c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:14.585444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1307/2643] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:14.629743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6e6bb47c-9a6e-40b4-9ce3-3446713029c8 None None] MFA Rules not processed for user `e91a3029117f4c8eaf971ffa442a016e`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:14.631942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6e6bb47c-9a6e-40b4-9ce3-3446713029c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:14.720441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1337/2644] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:14.783558 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650292aa-ebcf-43ef-a873-070ea5b256b5 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:14.793358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650292aa-ebcf-43ef-a873-070ea5b256b5 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:14.868894 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c324a-9425-4f51-96e0-faa8d803c2ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:14.870327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c324a-9425-4f51-96e0-faa8d803c2ca service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:14.870610 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c324a-9425-4f51-96e0-faa8d803c2ca service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:14.870881 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c324a-9425-4f51-96e0-faa8d803c2ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:14.885823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c324a-9425-4f51-96e0-faa8d803c2ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:14.887284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c324a-9425-4f51-96e0-faa8d803c2ca service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:14.899430 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1308/2645] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:15.509364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bb47c-9a6e-40b4-9ce3-3446713029c8 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:15.646015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:15.659065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bb47c-9a6e-40b4-9ce3-3446713029c8 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:15.659065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a54e6c-8aca-4678-9357-7c3ec85971f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:15.659065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a54e6c-8aca-4678-9357-7c3ec85971f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:15.659065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a54e6c-8aca-4678-9357-7c3ec85971f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:15.659845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a54e6c-8aca-4678-9357-7c3ec85971f5 admin admin] PATH_INFO: `/v3/users/79a2fe76b0a24817ace8d9a36588375d` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:15.659845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a54e6c-8aca-4678-9357-7c3ec85971f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a2fe76b0a24817ace8d9a36588375d)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:15.662948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a54e6c-8aca-4678-9357-7c3ec85971f5 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:15.966208 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c324a-9425-4f51-96e0-faa8d803c2ca service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:15.977713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c324a-9425-4f51-96e0-faa8d803c2ca service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:15.990254 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:15.991788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:15.992292 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:15.992784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] PATH_INFO: `/v3/users/cb98e8d742b34e6ab1a970e5a1d2fe18` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:15.995079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb98e8d742b34e6ab1a970e5a1d2fe18)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:15.998619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:16.008112 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-28a54e6c-8aca-4678-9357-7c3ec85971f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a2fe76b0a24817ace8d9a36588375d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.096040 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-28a54e6c-8aca-4678-9357-7c3ec85971f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a2fe76b0a24817ace8d9a36588375d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.106098 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-28a54e6c-8aca-4678-9357-7c3ec85971f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a2fe76b0a24817ace8d9a36588375d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.106915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-28a54e6c-8aca-4678-9357-7c3ec85971f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a2fe76b0a24817ace8d9a36588375d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.107698 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-28a54e6c-8aca-4678-9357-7c3ec85971f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a2fe76b0a24817ace8d9a36588375d'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.132231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1338/2646] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:15 2022] DELETE /identity/v3/users/79a2fe76b0a24817ace8d9a36588375d => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:16.139714 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abd68e-6dd5-4f14-bc6e-2449023ad43b None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:16.140090 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abd68e-6dd5-4f14-bc6e-2449023ad43b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:16.140372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abd68e-6dd5-4f14-bc6e-2449023ad43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:16.160961 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-81abd68e-6dd5-4f14-bc6e-2449023ad43b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:16.162241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-81abd68e-6dd5-4f14-bc6e-2449023ad43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:16.230765 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1339/2647] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:16.240701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abd68e-6dd5-4f14-bc6e-2449023ad43b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:16.242565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-81abd68e-6dd5-4f14-bc6e-2449023ad43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:16.259226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb98e8d742b34e6ab1a970e5a1d2fe18'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.303727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abd68e-6dd5-4f14-bc6e-2449023ad43b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:16.308802 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d301df4-0eaf-43c6-a75a-02a30d65c139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:16.309664 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d301df4-0eaf-43c6-a75a-02a30d65c139 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:16.310055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d301df4-0eaf-43c6-a75a-02a30d65c139 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:16.310429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d301df4-0eaf-43c6-a75a-02a30d65c139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:16.325803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d301df4-0eaf-43c6-a75a-02a30d65c139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:16.328439 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d301df4-0eaf-43c6-a75a-02a30d65c139 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:16.347294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1340/2648] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:16.377823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb98e8d742b34e6ab1a970e5a1d2fe18'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.378819 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb98e8d742b34e6ab1a970e5a1d2fe18'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.388479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb98e8d742b34e6ab1a970e5a1d2fe18'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.389190 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb98e8d742b34e6ab1a970e5a1d2fe18'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.412018 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:16.414475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1309/2649] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:15 2022] DELETE /identity/v3/users/cb98e8d742b34e6ab1a970e5a1d2fe18 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:16.421685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da4d6b-59da-4de6-affd-34497c9a1ac7 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:16.422512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da4d6b-59da-4de6-affd-34497c9a1ac7 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:16.423141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da4d6b-59da-4de6-affd-34497c9a1ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:16.451778 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-d4da4d6b-59da-4de6-affd-34497c9a1ac7 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:16.453104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d4da4d6b-59da-4de6-affd-34497c9a1ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:16.530578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1341/2650] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:16.544726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:16.546293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:16.647164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5305e-15ed-4a29-97ea-339ab750853f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:16.654987 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe43890-4489-422d-82f2-a59ef7719b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:16.656112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe43890-4489-422d-82f2-a59ef7719b16 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:16.656408 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe43890-4489-422d-82f2-a59ef7719b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:16.657429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe43890-4489-422d-82f2-a59ef7719b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:16.669607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe43890-4489-422d-82f2-a59ef7719b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:16.675028 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe43890-4489-422d-82f2-a59ef7719b16 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:16.687405 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1310/2651] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:17.266403 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da4d6b-59da-4de6-affd-34497c9a1ac7 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:17.268772 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d4da4d6b-59da-4de6-affd-34497c9a1ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:17.286287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe43890-4489-422d-82f2-a59ef7719b16 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:17.287819 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cbe43890-4489-422d-82f2-a59ef7719b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:17.297291 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da4d6b-59da-4de6-affd-34497c9a1ac7 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:17.309700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:17.311216 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:17.311739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:17.312214 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] PATH_INFO: `/v3/projects/9c6ae1cf6c8e4b2d9ef92a251d2dd591` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:17.313059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe43890-4489-422d-82f2-a59ef7719b16 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:17.315264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6ae1cf6c8e4b2d9ef92a251d2dd591)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:17.319923 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab4fd5-25ad-4430-b4ce-57bcff509b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:17.321607 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab4fd5-25ad-4430-b4ce-57bcff509b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:17.322127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab4fd5-25ad-4430-b4ce-57bcff509b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:17.323109 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab4fd5-25ad-4430-b4ce-57bcff509b4e admin admin] PATH_INFO: `/v3/users/89eb9c44484c4c199a1970c2f38b22df` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:17.324941 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab4fd5-25ad-4430-b4ce-57bcff509b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89eb9c44484c4c199a1970c2f38b22df)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:17.325356 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:17.327646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab4fd5-25ad-4430-b4ce-57bcff509b4e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:17.593613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-17ab4fd5-25ad-4430-b4ce-57bcff509b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89eb9c44484c4c199a1970c2f38b22df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.599260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6ae1cf6c8e4b2d9ef92a251d2dd591', 'request_id': 'req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.729329 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-17ab4fd5-25ad-4430-b4ce-57bcff509b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89eb9c44484c4c199a1970c2f38b22df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.730763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-17ab4fd5-25ad-4430-b4ce-57bcff509b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89eb9c44484c4c199a1970c2f38b22df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.743516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-17ab4fd5-25ad-4430-b4ce-57bcff509b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89eb9c44484c4c199a1970c2f38b22df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.745016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-17ab4fd5-25ad-4430-b4ce-57bcff509b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89eb9c44484c4c199a1970c2f38b22df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.776606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1311/2652] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:17 2022] DELETE /identity/v3/users/89eb9c44484c4c199a1970c2f38b22df => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:17.776606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a0b24-eba3-4df5-a9f3-39eab88786d1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:17.776606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a0b24-eba3-4df5-a9f3-39eab88786d1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:17.776606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a0b24-eba3-4df5-a9f3-39eab88786d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:17.798986 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-dc3a0b24-eba3-4df5-a9f3-39eab88786d1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:17.802150 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-dc3a0b24-eba3-4df5-a9f3-39eab88786d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:17.827526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6ae1cf6c8e4b2d9ef92a251d2dd591', 'request_id': 'req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.848079 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6ae1cf6c8e4b2d9ef92a251d2dd591', 'request_id': 'req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.879303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] The token cache is being invalidate because project 9c6ae1cf6c8e4b2d9ef92a251d2dd591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:17.881049 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.882929 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.888788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1342/2653] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:17 2022] DELETE /identity/v3/projects/9c6ae1cf6c8e4b2d9ef92a251d2dd591 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:17.895358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:17.901085 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:17.986978 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1312/2654] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:18.013965 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a0b24-eba3-4df5-a9f3-39eab88786d1 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:18.018351 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-dc3a0b24-eba3-4df5-a9f3-39eab88786d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:18.042385 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:18.089535 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:18.142330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ffa2e-b9bf-4b97-af3f-2de1d3b15176 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:18.152004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:18.153692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:18.154366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:18.154841 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] PATH_INFO: `/v3/users/a4cccf48544b40a48d52ec10705243ac` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:18.157290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cccf48544b40a48d52ec10705243ac)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:18.161311 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:18.230897 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a0b24-eba3-4df5-a9f3-39eab88786d1 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:18.240794 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba81e7-9915-4410-b726-47f233833ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:18.242100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba81e7-9915-4410-b726-47f233833ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:18.242694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba81e7-9915-4410-b726-47f233833ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:18.243394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba81e7-9915-4410-b726-47f233833ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:18.264763 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba81e7-9915-4410-b726-47f233833ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:18.268546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba81e7-9915-4410-b726-47f233833ee7 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:18.293255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1313/2655] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:18.433810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba81e7-9915-4410-b726-47f233833ee7 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:18.435283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b0ba81e7-9915-4410-b726-47f233833ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:18.457850 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba81e7-9915-4410-b726-47f233833ee7 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:18.469423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:18.470645 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:18.471232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:18.471444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] PATH_INFO: `/v3/projects/7625260adc464ec9994447cff05a1fc1` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:18.475249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7625260adc464ec9994447cff05a1fc1)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:18.486712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:18.516115 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cccf48544b40a48d52ec10705243ac'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.603161 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cccf48544b40a48d52ec10705243ac'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.614101 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cccf48544b40a48d52ec10705243ac'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.619688 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cccf48544b40a48d52ec10705243ac'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.621779 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cccf48544b40a48d52ec10705243ac'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.654064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7625260adc464ec9994447cff05a1fc1', 'request_id': 'req-10574fde-6401-4047-8e19-5c0eee02bcf6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.661005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1343/2656] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:17 2022] DELETE /identity/v3/users/a4cccf48544b40a48d52ec10705243ac => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:18.745625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7625260adc464ec9994447cff05a1fc1', 'request_id': 'req-10574fde-6401-4047-8e19-5c0eee02bcf6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.756233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7625260adc464ec9994447cff05a1fc1', 'request_id': 'req-10574fde-6401-4047-8e19-5c0eee02bcf6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.766934 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] The token cache is being invalidate because project 7625260adc464ec9994447cff05a1fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:18.767362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.768244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.770277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1314/2657] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:18 2022] DELETE /identity/v3/projects/7625260adc464ec9994447cff05a1fc1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:18.774431 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:18.776573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:18.861278 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980ff61-3c11-4aa7-961e-c495cf27780a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:18.870061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:18.870061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:18.870061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:18.870061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] PATH_INFO: `/v3/users/e91a3029117f4c8eaf971ffa442a016e` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:18.870767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91a3029117f4c8eaf971ffa442a016e)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:18.873023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:18.908862 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:18.914706 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:18.982088 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10574fde-6401-4047-8e19-5c0eee02bcf6 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:19.036027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb99d5-99d0-4343-badf-90c486e89e40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:19.036675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb99d5-99d0-4343-badf-90c486e89e40 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:19.036955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb99d5-99d0-4343-badf-90c486e89e40 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:19.037237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb99d5-99d0-4343-badf-90c486e89e40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:19.039131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-05cb99d5-99d0-4343-badf-90c486e89e40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:19.145055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91a3029117f4c8eaf971ffa442a016e'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:19.157518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb99d5-99d0-4343-badf-90c486e89e40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:19.160363 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb99d5-99d0-4343-badf-90c486e89e40 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:19.180823 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1315/2658] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:19.235145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb99d5-99d0-4343-badf-90c486e89e40 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:19.237015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-05cb99d5-99d0-4343-badf-90c486e89e40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:19.252695 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91a3029117f4c8eaf971ffa442a016e'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:19.261593 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb99d5-99d0-4343-badf-90c486e89e40 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:19.265904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91a3029117f4c8eaf971ffa442a016e'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:19.267229 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:19.267456 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91a3029117f4c8eaf971ffa442a016e'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:19.268371 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:19.268666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:19.270383 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91a3029117f4c8eaf971ffa442a016e'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:19.270554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] PATH_INFO: `/v3/projects/087db60749fe4dcf82c001d0d954c4f4` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:19.272042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] RBAC: Authorizing `identity:delete_project(project_id=087db60749fe4dcf82c001d0d954c4f4)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:19.274165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:19.342132 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1344/2659] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:18 2022] DELETE /identity/v3/users/e91a3029117f4c8eaf971ffa442a016e => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:19.356273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:19.414235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '087db60749fe4dcf82c001d0d954c4f4', 'request_id': 'req-28420da2-a150-44b7-882b-c9fb2279415d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:19.494917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:19.497333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:19.500021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '087db60749fe4dcf82c001d0d954c4f4', 'request_id': 'req-28420da2-a150-44b7-882b-c9fb2279415d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:19.534655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '087db60749fe4dcf82c001d0d954c4f4', 'request_id': 'req-28420da2-a150-44b7-882b-c9fb2279415d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:19.569011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] The token cache is being invalidate because project 087db60749fe4dcf82c001d0d954c4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:19.569655 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:19.571149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:19.572609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1316/2660] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:19 2022] DELETE /identity/v3/projects/087db60749fe4dcf82c001d0d954c4f4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:19.578626 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:19.580540 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:19.671968 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a068ef7-726b-47bd-8811-c4d3fa79199f admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:19.691042 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28420da2-a150-44b7-882b-c9fb2279415d admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:19.696423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3675e-bd0b-4697-8bd7-5675fd795978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:19.697333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3675e-bd0b-4697-8bd7-5675fd795978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:19.697693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3675e-bd0b-4697-8bd7-5675fd795978 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:19.698183 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3675e-bd0b-4697-8bd7-5675fd795978 admin admin] PATH_INFO: `/v3/users/9d5153d21068407bb8af291b947245dc` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:19.699793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3675e-bd0b-4697-8bd7-5675fd795978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5153d21068407bb8af291b947245dc)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:19.701849 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3675e-bd0b-4697-8bd7-5675fd795978 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:19.744060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c126da8-f803-4fe3-8e78-b613fe8fee63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:19.745643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c126da8-f803-4fe3-8e78-b613fe8fee63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:19.745932 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c126da8-f803-4fe3-8e78-b613fe8fee63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:19.746201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c126da8-f803-4fe3-8e78-b613fe8fee63 admin admin] PATH_INFO: `/v3/projects/d59008de20f4480b8cf06cc4f0a125fd` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:19.747522 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c126da8-f803-4fe3-8e78-b613fe8fee63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59008de20f4480b8cf06cc4f0a125fd)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:19.749808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c126da8-f803-4fe3-8e78-b613fe8fee63 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:20.006302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b5c3675e-bd0b-4697-8bd7-5675fd795978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5153d21068407bb8af291b947245dc'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.021514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6c126da8-f803-4fe3-8e78-b613fe8fee63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59008de20f4480b8cf06cc4f0a125fd', 'request_id': 'req-6c126da8-f803-4fe3-8e78-b613fe8fee63'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.058075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:20.106574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b5c3675e-bd0b-4697-8bd7-5675fd795978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5153d21068407bb8af291b947245dc'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.107619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b5c3675e-bd0b-4697-8bd7-5675fd795978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5153d21068407bb8af291b947245dc'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.117877 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b5c3675e-bd0b-4697-8bd7-5675fd795978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5153d21068407bb8af291b947245dc'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.118921 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b5c3675e-bd0b-4697-8bd7-5675fd795978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5153d21068407bb8af291b947245dc'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.141235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1317/2661] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:19 2022] DELETE /identity/v3/users/9d5153d21068407bb8af291b947245dc => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:20.188887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6c126da8-f803-4fe3-8e78-b613fe8fee63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59008de20f4480b8cf06cc4f0a125fd', 'request_id': 'req-6c126da8-f803-4fe3-8e78-b613fe8fee63'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.205606 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6c126da8-f803-4fe3-8e78-b613fe8fee63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59008de20f4480b8cf06cc4f0a125fd', 'request_id': 'req-6c126da8-f803-4fe3-8e78-b613fe8fee63'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.262429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6c126da8-f803-4fe3-8e78-b613fe8fee63 admin admin] The token cache is being invalidate because project d59008de20f4480b8cf06cc4f0a125fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:20.263040 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6c126da8-f803-4fe3-8e78-b613fe8fee63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.264381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6c126da8-f803-4fe3-8e78-b613fe8fee63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.279480 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1345/2662] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:19 2022] DELETE /identity/v3/projects/d59008de20f4480b8cf06cc4f0a125fd => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:20.280138 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff93e8-5acb-4dce-91c7-baea64ed476b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.280642 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff93e8-5acb-4dce-91c7-baea64ed476b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.281367 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff93e8-5acb-4dce-91c7-baea64ed476b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.329480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-37ff93e8-5acb-4dce-91c7-baea64ed476b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:20.332709 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-37ff93e8-5acb-4dce-91c7-baea64ed476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:20.378092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:20.501479 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1318/2663] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:20.508507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5f9ff-1b48-4318-af9c-5a0917b351ae None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.508507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5f9ff-1b48-4318-af9c-5a0917b351ae None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.508507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5f9ff-1b48-4318-af9c-5a0917b351ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.529291 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6df5f9ff-1b48-4318-af9c-5a0917b351ae None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:20.530452 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6df5f9ff-1b48-4318-af9c-5a0917b351ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:20.542810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1346/2664] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:20.547441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff93e8-5acb-4dce-91c7-baea64ed476b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:20.564501 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff93e8-5acb-4dce-91c7-baea64ed476b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:20.571023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28083def-01fb-4bb4-a5eb-527fa214c00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:20.573834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083def-01fb-4bb4-a5eb-527fa214c00f admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.573834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083def-01fb-4bb4-a5eb-527fa214c00f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.573834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083def-01fb-4bb4-a5eb-527fa214c00f admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.574602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28083def-01fb-4bb4-a5eb-527fa214c00f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:20.575242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28083def-01fb-4bb4-a5eb-527fa214c00f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:20.577493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28083def-01fb-4bb4-a5eb-527fa214c00f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:20.593571 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1319/2665] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:07:20.599330 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5f9ff-1b48-4318-af9c-5a0917b351ae None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:20.611158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5f9ff-1b48-4318-af9c-5a0917b351ae None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:20.620080 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a549b16-cf0b-4eba-bd0d-35f09cbe328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:20.621031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a549b16-cf0b-4eba-bd0d-35f09cbe328d admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.622449 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a549b16-cf0b-4eba-bd0d-35f09cbe328d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.623056 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a549b16-cf0b-4eba-bd0d-35f09cbe328d admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.624119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a549b16-cf0b-4eba-bd0d-35f09cbe328d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:20.627450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a549b16-cf0b-4eba-bd0d-35f09cbe328d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:20.673929 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28083def-01fb-4bb4-a5eb-527fa214c00f admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:20.676974 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-28083def-01fb-4bb4-a5eb-527fa214c00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:20.693755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28083def-01fb-4bb4-a5eb-527fa214c00f admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:20.702291 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:20.704258 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.704762 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.705122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] PATH_INFO: `/v3/projects/d207dcaad24847a1a4bb1f8813cc954e` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.706802 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d207dcaad24847a1a4bb1f8813cc954e)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:20.709160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:20.729989 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1347/2666] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:20 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:20.735727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a549b16-cf0b-4eba-bd0d-35f09cbe328d admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:20.809013 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:20.883210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a549b16-cf0b-4eba-bd0d-35f09cbe328d admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:20.888749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632082e-17bc-4b32-b09d-4733e061237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:20.889466 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632082e-17bc-4b32-b09d-4733e061237a admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.889753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632082e-17bc-4b32-b09d-4733e061237a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.890028 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632082e-17bc-4b32-b09d-4733e061237a admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.890718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632082e-17bc-4b32-b09d-4733e061237a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:20.892952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632082e-17bc-4b32-b09d-4733e061237a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:20.927769 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd207dcaad24847a1a4bb1f8813cc954e', 'request_id': 'req-61d087f0-09c6-4112-91fe-2bbc5e01e223'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:21.100577 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1348/2667] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:20 2022] POST /identity/v3/users => generated 292 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:21.102100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632082e-17bc-4b32-b09d-4733e061237a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:21.106478 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a632082e-17bc-4b32-b09d-4733e061237a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:21.110886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd207dcaad24847a1a4bb1f8813cc954e', 'request_id': 'req-61d087f0-09c6-4112-91fe-2bbc5e01e223'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:21.119103 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd207dcaad24847a1a4bb1f8813cc954e', 'request_id': 'req-61d087f0-09c6-4112-91fe-2bbc5e01e223'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:21.134166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632082e-17bc-4b32-b09d-4733e061237a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:21.157205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] The token cache is being invalidate because project d207dcaad24847a1a4bb1f8813cc954e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:21.157205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:21.157205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:21.157205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1320/2668] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:20 2022] DELETE /identity/v3/projects/d207dcaad24847a1a4bb1f8813cc954e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:21.157205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:21.157721 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:21.230328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:21.231350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.231659 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.232044 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] PATH_INFO: `/v3/projects/7407fc33ab6a4051a82cb2dff603d563` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.233779 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7407fc33ab6a4051a82cb2dff603d563)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:21.238505 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:21.254315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d087f0-09c6-4112-91fe-2bbc5e01e223 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:21.262211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78208a7-1f52-45ed-b9f9-3f28ae6991a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:21.262900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78208a7-1f52-45ed-b9f9-3f28ae6991a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.263182 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78208a7-1f52-45ed-b9f9-3f28ae6991a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.263465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78208a7-1f52-45ed-b9f9-3f28ae6991a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.264217 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78208a7-1f52-45ed-b9f9-3f28ae6991a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:21.265910 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78208a7-1f52-45ed-b9f9-3f28ae6991a9 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:21.281660 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1321/2669] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:21.283481 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a0377-8187-4aa1-b9c1-a4b91b6a0e23 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.283946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a0377-8187-4aa1-b9c1-a4b91b6a0e23 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.284374 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a0377-8187-4aa1-b9c1-a4b91b6a0e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.327444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-963a0377-8187-4aa1-b9c1-a4b91b6a0e23 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:21.330033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-963a0377-8187-4aa1-b9c1-a4b91b6a0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:21.341362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1322/2670] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:21.346623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a0377-8187-4aa1-b9c1-a4b91b6a0e23 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:21.359431 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a0377-8187-4aa1-b9c1-a4b91b6a0e23 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:21.363080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:21.367569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e961a8-e5fe-4cfa-b470-0f76cb30356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:21.368337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e961a8-e5fe-4cfa-b470-0f76cb30356b admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.368719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e961a8-e5fe-4cfa-b470-0f76cb30356b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.369067 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e961a8-e5fe-4cfa-b470-0f76cb30356b admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.370031 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e961a8-e5fe-4cfa-b470-0f76cb30356b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:21.371886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e961a8-e5fe-4cfa-b470-0f76cb30356b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:21.384226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1323/2671] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:21.385450 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00292c-0ce8-4b9b-99b1-a02dfbcad852 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.385744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00292c-0ce8-4b9b-99b1-a02dfbcad852 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.386112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00292c-0ce8-4b9b-99b1-a02dfbcad852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.410268 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-cb00292c-0ce8-4b9b-99b1-a02dfbcad852 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:21.411502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cb00292c-0ce8-4b9b-99b1-a02dfbcad852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:21.429097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1324/2672] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:21.429097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00292c-0ce8-4b9b-99b1-a02dfbcad852 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:21.436574 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7407fc33ab6a4051a82cb2dff603d563', 'request_id': 'req-0d020b53-3b0d-4b04-94f4-00a655a47fd3'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:21.437790 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00292c-0ce8-4b9b-99b1-a02dfbcad852 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:21.504425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924d94d-6540-4150-8c8b-4dcb6e4e141f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:21.505335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924d94d-6540-4150-8c8b-4dcb6e4e141f admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.505678 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924d94d-6540-4150-8c8b-4dcb6e4e141f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.505960 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924d94d-6540-4150-8c8b-4dcb6e4e141f admin admin] PATH_INFO: `/v3/projects/1534e49f7596468f8ce99bbeb4b13e6f/users/c29502565f6742f9a334c44a77eb80f0/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.523003 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924d94d-6540-4150-8c8b-4dcb6e4e141f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1534e49f7596468f8ce99bbeb4b13e6f, user_id=c29502565f6742f9a334c44a77eb80f0, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:21.527120 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924d94d-6540-4150-8c8b-4dcb6e4e141f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:21.542015 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7407fc33ab6a4051a82cb2dff603d563', 'request_id': 'req-0d020b53-3b0d-4b04-94f4-00a655a47fd3'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:21.559895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7407fc33ab6a4051a82cb2dff603d563', 'request_id': 'req-0d020b53-3b0d-4b04-94f4-00a655a47fd3'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:21.582324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] The token cache is being invalidate because project 7407fc33ab6a4051a82cb2dff603d563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:21.582794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:21.583787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:21.585984 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1349/2673] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:21 2022] DELETE /identity/v3/projects/7407fc33ab6a4051a82cb2dff603d563 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:21.592575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:21.592575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:21.616006 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d020b53-3b0d-4b04-94f4-00a655a47fd3 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:21.633614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1325/2674] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:21 2022] PUT /identity/v3/projects/1534e49f7596468f8ce99bbeb4b13e6f/users/c29502565f6742f9a334c44a77eb80f0/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:21.633614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b641fc-09ab-4481-8898-6981626dc9ea None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.633614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b641fc-09ab-4481-8898-6981626dc9ea None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.633614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b641fc-09ab-4481-8898-6981626dc9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.654263 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-53b641fc-09ab-4481-8898-6981626dc9ea None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:21.655612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-53b641fc-09ab-4481-8898-6981626dc9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:21.712404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9a14f-2919-49ed-9cca-3ae69eb5f622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:21.712404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9a14f-2919-49ed-9cca-3ae69eb5f622 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.712404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9a14f-2919-49ed-9cca-3ae69eb5f622 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.712404 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9a14f-2919-49ed-9cca-3ae69eb5f622 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.713845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9a14f-2919-49ed-9cca-3ae69eb5f622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:21.714163 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9a14f-2919-49ed-9cca-3ae69eb5f622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:21.715848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9a14f-2919-49ed-9cca-3ae69eb5f622 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:21.734526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1350/2675] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:07:21.736127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51b61-5ade-4dae-a0ac-3db2a51ff470 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.736476 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51b61-5ade-4dae-a0ac-3db2a51ff470 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.736758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51b61-5ade-4dae-a0ac-3db2a51ff470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.738395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1326/2676] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:21.744541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b641fc-09ab-4481-8898-6981626dc9ea None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:21.755871 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b641fc-09ab-4481-8898-6981626dc9ea None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:21.761622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4632b2e-18c0-4f69-8cac-8616c5c32a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:21.762314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4632b2e-18c0-4f69-8cac-8616c5c32a40 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.762663 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4632b2e-18c0-4f69-8cac-8616c5c32a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.762858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4632b2e-18c0-4f69-8cac-8616c5c32a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.763575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4632b2e-18c0-4f69-8cac-8616c5c32a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:21.765606 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4632b2e-18c0-4f69-8cac-8616c5c32a40 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:21.781255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-e8b51b61-5ade-4dae-a0ac-3db2a51ff470 None None] MFA Rules not processed for user `c29502565f6742f9a334c44a77eb80f0`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:21.782593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e8b51b61-5ade-4dae-a0ac-3db2a51ff470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:21.868728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1351/2677] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:21.870701 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88d2c6-3bfa-454b-ba35-d81493b87b3e None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.873024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88d2c6-3bfa-454b-ba35-d81493b87b3e None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.873024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88d2c6-3bfa-454b-ba35-d81493b87b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.890849 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-3f88d2c6-3bfa-454b-ba35-d81493b87b3e None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:21.892046 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3f88d2c6-3bfa-454b-ba35-d81493b87b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:21.900680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1352/2678] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:21.901621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88d2c6-3bfa-454b-ba35-d81493b87b3e None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:21.902955 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3f88d2c6-3bfa-454b-ba35-d81493b87b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:21.905716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1327/2679] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:21 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:21.906670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4632b2e-18c0-4f69-8cac-8616c5c32a40 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:21.916943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88d2c6-3bfa-454b-ba35-d81493b87b3e None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:21.984088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36e87c-5b54-4305-aec2-e354324ab6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:21.984088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36e87c-5b54-4305-aec2-e354324ab6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.984088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36e87c-5b54-4305-aec2-e354324ab6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.984088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36e87c-5b54-4305-aec2-e354324ab6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.984468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36e87c-5b54-4305-aec2-e354324ab6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:21.984570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4632b2e-18c0-4f69-8cac-8616c5c32a40 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:21.984949 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36e87c-5b54-4305-aec2-e354324ab6e1 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:21.990311 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359a37b-67dd-46d7-8413-99e1fc1bbe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:21.991284 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359a37b-67dd-46d7-8413-99e1fc1bbe58 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.991569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359a37b-67dd-46d7-8413-99e1fc1bbe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.991851 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359a37b-67dd-46d7-8413-99e1fc1bbe58 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.992746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359a37b-67dd-46d7-8413-99e1fc1bbe58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:21.995158 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359a37b-67dd-46d7-8413-99e1fc1bbe58 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.114317 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1353/2680] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:21 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:22.115308 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36e87c-5b54-4305-aec2-e354324ab6e1 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.119874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:22.208035 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36e87c-5b54-4305-aec2-e354324ab6e1 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.216266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1328/2681] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:21 2022] POST /identity/v3/users => generated 288 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:22.216266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359a37b-67dd-46d7-8413-99e1fc1bbe58 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.217144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a69a88-9727-4e34-9ee1-28b6c1f1e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.218077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a69a88-9727-4e34-9ee1-28b6c1f1e114 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.218556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a69a88-9727-4e34-9ee1-28b6c1f1e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.218833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a69a88-9727-4e34-9ee1-28b6c1f1e114 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.219588 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a69a88-9727-4e34-9ee1-28b6c1f1e114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:22.219903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a69a88-9727-4e34-9ee1-28b6c1f1e114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.221605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a69a88-9727-4e34-9ee1-28b6c1f1e114 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.228600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359a37b-67dd-46d7-8413-99e1fc1bbe58 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.234099 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf729699-2e34-4aa6-8667-34392a72c174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.234737 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf729699-2e34-4aa6-8667-34392a72c174 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.235040 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf729699-2e34-4aa6-8667-34392a72c174 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.235307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf729699-2e34-4aa6-8667-34392a72c174 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.236164 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf729699-2e34-4aa6-8667-34392a72c174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.238482 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf729699-2e34-4aa6-8667-34392a72c174 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.243455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1354/2682] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:07:22.243455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a69a88-9727-4e34-9ee1-28b6c1f1e114 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.251686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a69a88-9727-4e34-9ee1-28b6c1f1e114 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.259188 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a39dbf-8d0e-4b5e-b75b-32c79e17c3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.259188 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a39dbf-8d0e-4b5e-b75b-32c79e17c3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.260727 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a39dbf-8d0e-4b5e-b75b-32c79e17c3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.261238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a39dbf-8d0e-4b5e-b75b-32c79e17c3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.262836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a39dbf-8d0e-4b5e-b75b-32c79e17c3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.266186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a39dbf-8d0e-4b5e-b75b-32c79e17c3f5 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.292759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1355/2683] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:22.292759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a39dbf-8d0e-4b5e-b75b-32c79e17c3f5 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.308239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a39dbf-8d0e-4b5e-b75b-32c79e17c3f5 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.316038 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299e08b-7f53-4ee2-ba56-daba45c240af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.316718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299e08b-7f53-4ee2-ba56-daba45c240af admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.317004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299e08b-7f53-4ee2-ba56-daba45c240af admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.317282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299e08b-7f53-4ee2-ba56-daba45c240af admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.318074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299e08b-7f53-4ee2-ba56-daba45c240af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.320059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299e08b-7f53-4ee2-ba56-daba45c240af admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.384338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1329/2684] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:22 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:22.386629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf729699-2e34-4aa6-8667-34392a72c174 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.397617 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf729699-2e34-4aa6-8667-34392a72c174 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.407502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdb8fc-6dae-4420-95a8-587dd252b804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.408748 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdb8fc-6dae-4420-95a8-587dd252b804 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.409165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdb8fc-6dae-4420-95a8-587dd252b804 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.409648 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdb8fc-6dae-4420-95a8-587dd252b804 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.411062 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdb8fc-6dae-4420-95a8-587dd252b804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.414256 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdb8fc-6dae-4420-95a8-587dd252b804 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.437550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1330/2685] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:22.437550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdb8fc-6dae-4420-95a8-587dd252b804 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.447168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdb8fc-6dae-4420-95a8-587dd252b804 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.452503 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f0f7b-a75d-4728-b34f-14815f57551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.453188 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0f7b-a75d-4728-b34f-14815f57551d admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.453498 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0f7b-a75d-4728-b34f-14815f57551d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.453770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0f7b-a75d-4728-b34f-14815f57551d admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.454505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f0f7b-a75d-4728-b34f-14815f57551d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.456125 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f0f7b-a75d-4728-b34f-14815f57551d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.461443 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1356/2686] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:22 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:22.462254 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299e08b-7f53-4ee2-ba56-daba45c240af admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.471214 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1331/2687] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:22.472711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f0f7b-a75d-4728-b34f-14815f57551d admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.484619 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f0f7b-a75d-4728-b34f-14815f57551d admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.547205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299e08b-7f53-4ee2-ba56-daba45c240af admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.550723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423af901-33b9-40b2-96c5-9f373a5730e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.552305 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423af901-33b9-40b2-96c5-9f373a5730e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.552516 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423af901-33b9-40b2-96c5-9f373a5730e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.552788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423af901-33b9-40b2-96c5-9f373a5730e3 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.553641 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423af901-33b9-40b2-96c5-9f373a5730e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.553979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfe79b-c1b5-4199-9c4f-123b89d8a112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.555439 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfe79b-c1b5-4199-9c4f-123b89d8a112 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.555751 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfe79b-c1b5-4199-9c4f-123b89d8a112 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.556125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfe79b-c1b5-4199-9c4f-123b89d8a112 admin admin] PATH_INFO: `/v3/projects/af85e10bb47e426f88716ffee21647d2/users/c5c2cfe5fd634ff2a367dca5c711a036/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.556747 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423af901-33b9-40b2-96c5-9f373a5730e3 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.585557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfe79b-c1b5-4199-9c4f-123b89d8a112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af85e10bb47e426f88716ffee21647d2, user_id=c5c2cfe5fd634ff2a367dca5c711a036, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.590625 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfe79b-c1b5-4199-9c4f-123b89d8a112 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.694643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1357/2688] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:22 2022] PUT /identity/v3/projects/af85e10bb47e426f88716ffee21647d2/users/c5c2cfe5fd634ff2a367dca5c711a036/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:22.695426 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfe79b-c1b5-4199-9c4f-123b89d8a112 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.706426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1332/2689] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:22 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:22.708052 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322c36d-8162-41a9-9e90-ace4b22b8720 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.708441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322c36d-8162-41a9-9e90-ace4b22b8720 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.708822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322c36d-8162-41a9-9e90-ace4b22b8720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.744937 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-5322c36d-8162-41a9-9e90-ace4b22b8720 None None] MFA Rules not processed for user `c5c2cfe5fd634ff2a367dca5c711a036`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:22.746137 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5322c36d-8162-41a9-9e90-ace4b22b8720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:22.775000 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:22.782690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfe79b-c1b5-4199-9c4f-123b89d8a112 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.787686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0317c00-c26a-428c-994a-fb283ff8826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.788736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0317c00-c26a-428c-994a-fb283ff8826d admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.789198 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0317c00-c26a-428c-994a-fb283ff8826d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.789446 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0317c00-c26a-428c-994a-fb283ff8826d admin admin] PATH_INFO: `/v3/projects/9e3d0a27d05c4fd2a4637c1ca715f5cf/users/c0c021e2ae8443b8bab0edf7395da443/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.811127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0317c00-c26a-428c-994a-fb283ff8826d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3d0a27d05c4fd2a4637c1ca715f5cf, user_id=c0c021e2ae8443b8bab0edf7395da443, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.814032 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0317c00-c26a-428c-994a-fb283ff8826d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.836879 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1333/2690] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:22.837565 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322c36d-8162-41a9-9e90-ace4b22b8720 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.852889 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322c36d-8162-41a9-9e90-ace4b22b8720 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.859625 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c8f67-0500-4b93-a493-880a2ffcd3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.860695 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c8f67-0500-4b93-a493-880a2ffcd3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.861039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c8f67-0500-4b93-a493-880a2ffcd3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.861317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c8f67-0500-4b93-a493-880a2ffcd3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.863438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c8f67-0500-4b93-a493-880a2ffcd3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.864221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c8f67-0500-4b93-a493-880a2ffcd3d2 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.878597 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1334/2691] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:22.879617 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c8f67-0500-4b93-a493-880a2ffcd3d2 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.881652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-715c8f67-0500-4b93-a493-880a2ffcd3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:22.895350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1358/2692] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:22 2022] PUT /identity/v3/projects/9e3d0a27d05c4fd2a4637c1ca715f5cf/users/c0c021e2ae8443b8bab0edf7395da443/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:22.897995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0317c00-c26a-428c-994a-fb283ff8826d admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.987787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c8f67-0500-4b93-a493-880a2ffcd3d2 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.988348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0317c00-c26a-428c-994a-fb283ff8826d admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.993639 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0dac0-42a5-4128-9344-9686db7621f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.994728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0dac0-42a5-4128-9344-9686db7621f1 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.995273 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0dac0-42a5-4128-9344-9686db7621f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.995717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0dac0-42a5-4128-9344-9686db7621f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.996634 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0dac0-42a5-4128-9344-9686db7621f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.998662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0dac0-42a5-4128-9344-9686db7621f1 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:23.013230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1359/2693] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:23.014019 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0dac0-42a5-4128-9344-9686db7621f1 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:23.030533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0dac0-42a5-4128-9344-9686db7621f1 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:23.036364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d622e-13f4-4cd3-a337-412029c89a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:23.037238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d622e-13f4-4cd3-a337-412029c89a97 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:23.042291 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d622e-13f4-4cd3-a337-412029c89a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:23.044992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d622e-13f4-4cd3-a337-412029c89a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:23.044992 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d622e-13f4-4cd3-a337-412029c89a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:23.046436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d622e-13f4-4cd3-a337-412029c89a97 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:23.063646 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1360/2694] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:23.063646 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d622e-13f4-4cd3-a337-412029c89a97 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:23.080471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d622e-13f4-4cd3-a337-412029c89a97 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:23.087362 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b1d27-a48f-4a0a-8031-7c8e66ae7d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:23.088334 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1d27-a48f-4a0a-8031-7c8e66ae7d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:23.088686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1d27-a48f-4a0a-8031-7c8e66ae7d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:23.088902 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1d27-a48f-4a0a-8031-7c8e66ae7d95 admin admin] PATH_INFO: `/v3/projects/ae06852c7c634001877e13aa5bd83c1e/users/21059b6f08f54ec0a33dd7516497c39f/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:23.090232 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a995048-c1b2-4a87-8e0f-26c094462b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:23.090899 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a995048-c1b2-4a87-8e0f-26c094462b1e service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:23.091347 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a995048-c1b2-4a87-8e0f-26c094462b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:23.092996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a995048-c1b2-4a87-8e0f-26c094462b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:23.154375 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b1d27-a48f-4a0a-8031-7c8e66ae7d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae06852c7c634001877e13aa5bd83c1e, user_id=21059b6f08f54ec0a33dd7516497c39f, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:23.159749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b1d27-a48f-4a0a-8031-7c8e66ae7d95 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:23.187508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a995048-c1b2-4a87-8e0f-26c094462b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:23.189680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a995048-c1b2-4a87-8e0f-26c094462b1e service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:23.201637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1335/2695] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:23.202484 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a995048-c1b2-4a87-8e0f-26c094462b1e service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:23.214618 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a995048-c1b2-4a87-8e0f-26c094462b1e service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:23.220608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146f8ac-b322-47a6-8928-e8853c252e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:23.221574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146f8ac-b322-47a6-8928-e8853c252e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:23.221873 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146f8ac-b322-47a6-8928-e8853c252e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:23.222153 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146f8ac-b322-47a6-8928-e8853c252e27 admin admin] PATH_INFO: `/v3/projects/9e3d0a27d05c4fd2a4637c1ca715f5cf/users/c0c021e2ae8443b8bab0edf7395da443/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:23.224478 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146f8ac-b322-47a6-8928-e8853c252e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3d0a27d05c4fd2a4637c1ca715f5cf, user_id=c0c021e2ae8443b8bab0edf7395da443, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:23.227713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146f8ac-b322-47a6-8928-e8853c252e27 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:23.241780 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1336/2696] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:23 2022] PUT /identity/v3/projects/9e3d0a27d05c4fd2a4637c1ca715f5cf/users/c0c021e2ae8443b8bab0edf7395da443/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:23.252315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934a390-a0fe-4068-9d31-28983e7680c6 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:23.252550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934a390-a0fe-4068-9d31-28983e7680c6 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:23.252822 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934a390-a0fe-4068-9d31-28983e7680c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:23.267226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:23.274023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1361/2697] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:23 2022] PUT /identity/v3/projects/ae06852c7c634001877e13aa5bd83c1e/users/21059b6f08f54ec0a33dd7516497c39f/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:23.285117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9de5d4-c30c-4d93-8ad4-7b2f20616fc1 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:23.285880 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9de5d4-c30c-4d93-8ad4-7b2f20616fc1 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:23.287220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9de5d4-c30c-4d93-8ad4-7b2f20616fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:23.297333 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7934a390-a0fe-4068-9d31-28983e7680c6 None None] MFA Rules not processed for user `c0c021e2ae8443b8bab0edf7395da443`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:23.298776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7934a390-a0fe-4068-9d31-28983e7680c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:23.341060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-1b9de5d4-c30c-4d93-8ad4-7b2f20616fc1 None None] MFA Rules not processed for user `21059b6f08f54ec0a33dd7516497c39f`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:23.342545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1b9de5d4-c30c-4d93-8ad4-7b2f20616fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:23.445806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1337/2698] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:23.449864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1362/2699] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:23.457962 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934a390-a0fe-4068-9d31-28983e7680c6 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:23.458473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9de5d4-c30c-4d93-8ad4-7b2f20616fc1 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:23.459990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1b9de5d4-c30c-4d93-8ad4-7b2f20616fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:23.541597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9de5d4-c30c-4d93-8ad4-7b2f20616fc1 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:23.563531 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c5403-c210-4591-847a-cf8e87c6a5b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:23.566295 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5403-c210-4591-847a-cf8e87c6a5b3 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:23.567381 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5403-c210-4591-847a-cf8e87c6a5b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:23.567614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934a390-a0fe-4068-9d31-28983e7680c6 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:23.568432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5403-c210-4591-847a-cf8e87c6a5b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:23.577700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc3dc8-9dd1-4e96-9df8-5421b3769e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:23.578720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc3dc8-9dd1-4e96-9df8-5421b3769e9c admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:23.579194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc3dc8-9dd1-4e96-9df8-5421b3769e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:23.579681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc3dc8-9dd1-4e96-9df8-5421b3769e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:23.580470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc3dc8-9dd1-4e96-9df8-5421b3769e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:23.584056 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc3dc8-9dd1-4e96-9df8-5421b3769e9c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:23.667013 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c5403-c210-4591-847a-cf8e87c6a5b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:23.668850 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c5403-c210-4591-847a-cf8e87c6a5b3 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:23.680813 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1363/2700] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:23.696302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1338/2701] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:23 2022] POST /identity/v3/projects => generated 367 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:23.701848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c5403-c210-4591-847a-cf8e87c6a5b3 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:23.731645 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c5403-c210-4591-847a-cf8e87c6a5b3 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:23.827733 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010eb00-d610-42b3-afd4-c4c6c12c7da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:23.828440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010eb00-d610-42b3-afd4-c4c6c12c7da4 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:23.828686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010eb00-d610-42b3-afd4-c4c6c12c7da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:23.829757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010eb00-d610-42b3-afd4-c4c6c12c7da4 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:23.830511 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010eb00-d610-42b3-afd4-c4c6c12c7da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:23.832635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010eb00-d610-42b3-afd4-c4c6c12c7da4 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:23.997894 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1364/2702] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:23 2022] POST /identity/v3/users => generated 290 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:24.001427 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc3dc8-9dd1-4e96-9df8-5421b3769e9c admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:24.014469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc3dc8-9dd1-4e96-9df8-5421b3769e9c admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:24.019307 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032d3cc-75c8-4e40-b32b-0748f975d565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:24.019981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032d3cc-75c8-4e40-b32b-0748f975d565 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:24.020266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032d3cc-75c8-4e40-b32b-0748f975d565 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:24.020541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032d3cc-75c8-4e40-b32b-0748f975d565 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:24.021269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032d3cc-75c8-4e40-b32b-0748f975d565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:24.022954 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032d3cc-75c8-4e40-b32b-0748f975d565 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:24.040415 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1339/2703] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:24.044657 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010eb00-d610-42b3-afd4-c4c6c12c7da4 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:24.063045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010eb00-d610-42b3-afd4-c4c6c12c7da4 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:24.068086 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2965e3-665a-41f7-a759-9b42eea1a728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:24.069017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2965e3-665a-41f7-a759-9b42eea1a728 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:24.071076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2965e3-665a-41f7-a759-9b42eea1a728 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:24.071076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2965e3-665a-41f7-a759-9b42eea1a728 admin admin] PATH_INFO: `/v3/projects/1d5f8d52964f40aa85c4dbc74bf2a473/users/74adb15e679743879fb4caaa2c1c5bb9/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:24.087998 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2965e3-665a-41f7-a759-9b42eea1a728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5f8d52964f40aa85c4dbc74bf2a473, user_id=74adb15e679743879fb4caaa2c1c5bb9, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:24.094796 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2965e3-665a-41f7-a759-9b42eea1a728 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:24.196904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1365/2704] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:24 2022] PUT /identity/v3/projects/1d5f8d52964f40aa85c4dbc74bf2a473/users/74adb15e679743879fb4caaa2c1c5bb9/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:24.201681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032d3cc-75c8-4e40-b32b-0748f975d565 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:24.212365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032d3cc-75c8-4e40-b32b-0748f975d565 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:24.271276 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:24.281998 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f21d18-49ed-4ba3-81dc-9d43870d2f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:24.282680 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21d18-49ed-4ba3-81dc-9d43870d2f52 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:24.282972 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21d18-49ed-4ba3-81dc-9d43870d2f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:24.283252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21d18-49ed-4ba3-81dc-9d43870d2f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:24.283980 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f21d18-49ed-4ba3-81dc-9d43870d2f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:24.285661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f21d18-49ed-4ba3-81dc-9d43870d2f52 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:24.296454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1340/2705] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:24.300779 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2965e3-665a-41f7-a759-9b42eea1a728 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:24.316109 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2965e3-665a-41f7-a759-9b42eea1a728 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:24.320955 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f7db-9d08-4a4c-91f4-9ce8482aa89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:24.321914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f7db-9d08-4a4c-91f4-9ce8482aa89a admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:24.322725 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f7db-9d08-4a4c-91f4-9ce8482aa89a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:24.323017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f7db-9d08-4a4c-91f4-9ce8482aa89a admin admin] PATH_INFO: `/v3/projects/1d5f8d52964f40aa85c4dbc74bf2a473/users/74adb15e679743879fb4caaa2c1c5bb9/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:24.325144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154f7db-9d08-4a4c-91f4-9ce8482aa89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5f8d52964f40aa85c4dbc74bf2a473, user_id=74adb15e679743879fb4caaa2c1c5bb9, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:24.327957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154f7db-9d08-4a4c-91f4-9ce8482aa89a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:24.339236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1366/2706] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:24 2022] PUT /identity/v3/projects/1d5f8d52964f40aa85c4dbc74bf2a473/users/74adb15e679743879fb4caaa2c1c5bb9/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:24.349555 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebd915-27d2-40cd-8a21-07f19d115f56 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:24.349846 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebd915-27d2-40cd-8a21-07f19d115f56 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:24.350280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebd915-27d2-40cd-8a21-07f19d115f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:24.380598 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-1cebd915-27d2-40cd-8a21-07f19d115f56 None None] MFA Rules not processed for user `74adb15e679743879fb4caaa2c1c5bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:24.382185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1cebd915-27d2-40cd-8a21-07f19d115f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:24.451678 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1341/2707] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:24.463689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f7db-9d08-4a4c-91f4-9ce8482aa89a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:24.527179 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f7db-9d08-4a4c-91f4-9ce8482aa89a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:24.531899 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e0658-44d9-49b1-9a10-26a375dfcb98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:24.532529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0658-44d9-49b1-9a10-26a375dfcb98 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:24.532840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0658-44d9-49b1-9a10-26a375dfcb98 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:24.534366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0658-44d9-49b1-9a10-26a375dfcb98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:24.545599 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e0658-44d9-49b1-9a10-26a375dfcb98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:24.547076 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e0658-44d9-49b1-9a10-26a375dfcb98 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:24.557656 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1367/2708] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:24 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:24.713055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebd915-27d2-40cd-8a21-07f19d115f56 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:24.723738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebd915-27d2-40cd-8a21-07f19d115f56 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:24.727475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab81eb-bcc3-4e15-bbf0-bfc13c9c7d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:24.729199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab81eb-bcc3-4e15-bbf0-bfc13c9c7d4e service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:24.729199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab81eb-bcc3-4e15-bbf0-bfc13c9c7d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:24.729199 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab81eb-bcc3-4e15-bbf0-bfc13c9c7d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:24.796300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab81eb-bcc3-4e15-bbf0-bfc13c9c7d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:24.797774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab81eb-bcc3-4e15-bbf0-bfc13c9c7d4e service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:24.813979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1342/2709] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:24.894647 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:25.739957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:26.437023 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:27.172295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:27.558065 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:28.044448 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:28.457339 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7457689-8bb2-40ba-a45b-a48630669529 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:28.457980 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7457689-8bb2-40ba-a45b-a48630669529 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:28.458124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7457689-8bb2-40ba-a45b-a48630669529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:28.477161 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-c7457689-8bb2-40ba-a45b-a48630669529 None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:28.480462 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c7457689-8bb2-40ba-a45b-a48630669529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:28.506548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:28.555757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1368/2710] 10.222.0.39 () {58 vars in 967 bytes} [Tue May 31 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:28.793306 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab81eb-bcc3-4e15-bbf0-bfc13c9c7d4e service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:28.794609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f0ab81eb-bcc3-4e15-bbf0-bfc13c9c7d4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:28.888373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab81eb-bcc3-4e15-bbf0-bfc13c9c7d4e service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:28.894364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263baa1b-bf9c-48de-8220-4a29fa17800d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:28.900577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263baa1b-bf9c-48de-8220-4a29fa17800d service swift] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:28.900577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263baa1b-bf9c-48de-8220-4a29fa17800d service swift] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:28.900577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263baa1b-bf9c-48de-8220-4a29fa17800d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:28.904720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263baa1b-bf9c-48de-8220-4a29fa17800d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:28.906369 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263baa1b-bf9c-48de-8220-4a29fa17800d service swift] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:28.915815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1343/2711] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:07:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:07:29.328006 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:29.575445 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7457689-8bb2-40ba-a45b-a48630669529 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:29.584975 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7457689-8bb2-40ba-a45b-a48630669529 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:29.589128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5133709-980b-445b-9c2d-f5967a05fc74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:29.590366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5133709-980b-445b-9c2d-f5967a05fc74 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:29.590366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5133709-980b-445b-9c2d-f5967a05fc74 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:29.590366 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5133709-980b-445b-9c2d-f5967a05fc74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:29.665447 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5133709-980b-445b-9c2d-f5967a05fc74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:29.666903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5133709-980b-445b-9c2d-f5967a05fc74 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:29.677173 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1369/2712] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:29.722688 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:29.966579 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:30.475040 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:30.549237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263baa1b-bf9c-48de-8220-4a29fa17800d service swift] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:30.571365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:30.630134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263baa1b-bf9c-48de-8220-4a29fa17800d service swift] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:30.634768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:30.635667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:30.635946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:30.636221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] PATH_INFO: `/v3/users/21059b6f08f54ec0a33dd7516497c39f` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:30.637512 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=21059b6f08f54ec0a33dd7516497c39f)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:30.639455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:30.889081 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21059b6f08f54ec0a33dd7516497c39f'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:30.964852 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21059b6f08f54ec0a33dd7516497c39f'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:30.965856 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21059b6f08f54ec0a33dd7516497c39f'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:30.975965 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21059b6f08f54ec0a33dd7516497c39f'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:30.977653 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21059b6f08f54ec0a33dd7516497c39f'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:31.001990 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1344/2713] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:30 2022] DELETE /identity/v3/users/21059b6f08f54ec0a33dd7516497c39f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:31.006897 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1398e7-9ba0-4d9f-a97d-5bf98ae7e074 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:31.007395 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1398e7-9ba0-4d9f-a97d-5bf98ae7e074 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:31.007543 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1398e7-9ba0-4d9f-a97d-5bf98ae7e074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:31.032915 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6b1398e7-9ba0-4d9f-a97d-5bf98ae7e074 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:31.034732 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6b1398e7-9ba0-4d9f-a97d-5bf98ae7e074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:31.094139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:31.102171 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1370/2714] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:31.113634 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:31.115373 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:31.184827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb4e6b-4827-4fd1-b224-1eb662741f5b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:31.188470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8929b9b-e2f9-432a-9e9f-a50c2302d307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:31.189122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8929b9b-e2f9-432a-9e9f-a50c2302d307 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:31.189426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8929b9b-e2f9-432a-9e9f-a50c2302d307 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:31.189707 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8929b9b-e2f9-432a-9e9f-a50c2302d307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:31.202200 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8929b9b-e2f9-432a-9e9f-a50c2302d307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:31.203694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8929b9b-e2f9-432a-9e9f-a50c2302d307 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:31.215028 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1345/2715] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:31.374022 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:31.812521 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1398e7-9ba0-4d9f-a97d-5bf98ae7e074 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:31.813705 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6b1398e7-9ba0-4d9f-a97d-5bf98ae7e074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:31.834212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1398e7-9ba0-4d9f-a97d-5bf98ae7e074 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:31.850950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:31.852193 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:31.852638 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:31.853070 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] PATH_INFO: `/v3/projects/ae06852c7c634001877e13aa5bd83c1e` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:31.855628 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae06852c7c634001877e13aa5bd83c1e)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:31.857854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:32.080536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae06852c7c634001877e13aa5bd83c1e', 'request_id': 'req-e5e3498e-518d-4993-8718-1a051898bce1'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.161288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:32.179161 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae06852c7c634001877e13aa5bd83c1e', 'request_id': 'req-e5e3498e-518d-4993-8718-1a051898bce1'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.187555 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae06852c7c634001877e13aa5bd83c1e', 'request_id': 'req-e5e3498e-518d-4993-8718-1a051898bce1'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.201221 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] The token cache is being invalidate because project ae06852c7c634001877e13aa5bd83c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:32.201544 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.202247 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.203938 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1371/2716] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:31 2022] DELETE /identity/v3/projects/ae06852c7c634001877e13aa5bd83c1e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:32.207945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8929b9b-e2f9-432a-9e9f-a50c2302d307 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:32.217712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8929b9b-e2f9-432a-9e9f-a50c2302d307 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:32.285012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac16ca6-f62e-4a8a-879f-c499b59078cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:32.285946 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac16ca6-f62e-4a8a-879f-c499b59078cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:32.286228 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac16ca6-f62e-4a8a-879f-c499b59078cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:32.286502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac16ca6-f62e-4a8a-879f-c499b59078cc admin admin] PATH_INFO: `/v3/users/74adb15e679743879fb4caaa2c1c5bb9` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:32.287932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac16ca6-f62e-4a8a-879f-c499b59078cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=74adb15e679743879fb4caaa2c1c5bb9)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:32.290329 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac16ca6-f62e-4a8a-879f-c499b59078cc admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:32.407266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:32.586577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3ac16ca6-f62e-4a8a-879f-c499b59078cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74adb15e679743879fb4caaa2c1c5bb9'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.779001 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3ac16ca6-f62e-4a8a-879f-c499b59078cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74adb15e679743879fb4caaa2c1c5bb9'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.780528 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3ac16ca6-f62e-4a8a-879f-c499b59078cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74adb15e679743879fb4caaa2c1c5bb9'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.804157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3ac16ca6-f62e-4a8a-879f-c499b59078cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74adb15e679743879fb4caaa2c1c5bb9'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.805152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3ac16ca6-f62e-4a8a-879f-c499b59078cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74adb15e679743879fb4caaa2c1c5bb9'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.842975 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1346/2717] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:32 2022] DELETE /identity/v3/users/74adb15e679743879fb4caaa2c1c5bb9 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:33.405289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:33.422055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:33.465226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3498e-518d-4993-8718-1a051898bce1 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:33.578247 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:33.579220 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:33.583288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:33.583288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f admin admin] PATH_INFO: `/v3/projects/1d5f8d52964f40aa85c4dbc74bf2a473` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:33.583288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5f8d52964f40aa85c4dbc74bf2a473)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:33.583981 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:33.718246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5f8d52964f40aa85c4dbc74bf2a473', 'request_id': 'req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:33.727923 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:33.823579 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5f8d52964f40aa85c4dbc74bf2a473', 'request_id': 'req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:33.835136 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5f8d52964f40aa85c4dbc74bf2a473', 'request_id': 'req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:33.847817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f admin admin] The token cache is being invalidate because project 1d5f8d52964f40aa85c4dbc74bf2a473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:33.848310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:33.849258 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-32995607-e6cd-42b1-ad3b-e87e3a46fe2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:33.851372 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1372/2718] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:33 2022] DELETE /identity/v3/projects/1d5f8d52964f40aa85c4dbc74bf2a473 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:33.858784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0964f8-2e9c-46d6-9f51-1a3b5a876288 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:33.859749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0964f8-2e9c-46d6-9f51-1a3b5a876288 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:33.860338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0964f8-2e9c-46d6-9f51-1a3b5a876288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:33.886391 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-5c0964f8-2e9c-46d6-9f51-1a3b5a876288 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:33.887938 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5c0964f8-2e9c-46d6-9f51-1a3b5a876288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:33.961994 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1347/2719] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:33.970868 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6390a9-4cdd-42d4-8dce-b40875aff4ac None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:33.971166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6390a9-4cdd-42d4-8dce-b40875aff4ac None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:33.971450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6390a9-4cdd-42d4-8dce-b40875aff4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:33.983089 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:33.996395 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-be6390a9-4cdd-42d4-8dce-b40875aff4ac None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:34.004161 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-be6390a9-4cdd-42d4-8dce-b40875aff4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:34.016523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1373/2720] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:34.029412 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0964f8-2e9c-46d6-9f51-1a3b5a876288 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:34.041781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0964f8-2e9c-46d6-9f51-1a3b5a876288 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:34.048019 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460495e8-21a0-42d0-b878-7d6c1aa30b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:34.049124 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460495e8-21a0-42d0-b878-7d6c1aa30b74 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:34.049493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460495e8-21a0-42d0-b878-7d6c1aa30b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:34.049769 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460495e8-21a0-42d0-b878-7d6c1aa30b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:34.050760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460495e8-21a0-42d0-b878-7d6c1aa30b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:34.051094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460495e8-21a0-42d0-b878-7d6c1aa30b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:34.052820 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460495e8-21a0-42d0-b878-7d6c1aa30b74 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:34.069800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1348/2721] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:07:34.074882 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6390a9-4cdd-42d4-8dce-b40875aff4ac None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:34.084383 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6390a9-4cdd-42d4-8dce-b40875aff4ac None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:34.089768 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed525102-ec27-4227-9ba6-7fe6db812950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:34.090436 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed525102-ec27-4227-9ba6-7fe6db812950 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:34.090719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed525102-ec27-4227-9ba6-7fe6db812950 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:34.090995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed525102-ec27-4227-9ba6-7fe6db812950 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:34.091689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed525102-ec27-4227-9ba6-7fe6db812950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:34.093663 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed525102-ec27-4227-9ba6-7fe6db812950 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:34.239613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1374/2722] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:34 2022] POST /identity/v3/projects => generated 399 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:34.241665 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460495e8-21a0-42d0-b878-7d6c1aa30b74 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:34.256149 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460495e8-21a0-42d0-b878-7d6c1aa30b74 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:34.358760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e3dc-4eb1-4962-b231-5a341bbe2d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:34.358760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e3dc-4eb1-4962-b231-5a341bbe2d42 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:34.358760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e3dc-4eb1-4962-b231-5a341bbe2d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:34.358760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e3dc-4eb1-4962-b231-5a341bbe2d42 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:34.362310 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09e3dc-4eb1-4962-b231-5a341bbe2d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:34.362310 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09e3dc-4eb1-4962-b231-5a341bbe2d42 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:34.499099 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1349/2723] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:34 2022] POST /identity/v3/users => generated 300 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:34.503310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed525102-ec27-4227-9ba6-7fe6db812950 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:34.525121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed525102-ec27-4227-9ba6-7fe6db812950 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:34.531029 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad983e-d16c-4c14-b8e2-a4b59fae3981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:34.531721 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad983e-d16c-4c14-b8e2-a4b59fae3981 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:34.532350 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad983e-d16c-4c14-b8e2-a4b59fae3981 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:34.532859 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad983e-d16c-4c14-b8e2-a4b59fae3981 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:34.534017 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad983e-d16c-4c14-b8e2-a4b59fae3981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:34.535943 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad983e-d16c-4c14-b8e2-a4b59fae3981 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:34.548955 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1375/2724] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:34.553308 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e3dc-4eb1-4962-b231-5a341bbe2d42 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:34.565960 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e3dc-4eb1-4962-b231-5a341bbe2d42 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:34.571191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71c639-097b-4b09-b024-7c9c982d76d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:34.571949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c639-097b-4b09-b024-7c9c982d76d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:34.575400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c639-097b-4b09-b024-7c9c982d76d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:34.575400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c639-097b-4b09-b024-7c9c982d76d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:34.575400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71c639-097b-4b09-b024-7c9c982d76d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:34.575400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71c639-097b-4b09-b024-7c9c982d76d8 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:34.589076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1350/2725] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:34.593341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad983e-d16c-4c14-b8e2-a4b59fae3981 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:34.604367 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad983e-d16c-4c14-b8e2-a4b59fae3981 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:34.611259 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9450eae-714d-4368-9c2c-5d195f4b8119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:34.612759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9450eae-714d-4368-9c2c-5d195f4b8119 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:34.613158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9450eae-714d-4368-9c2c-5d195f4b8119 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:34.613587 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9450eae-714d-4368-9c2c-5d195f4b8119 admin admin] PATH_INFO: `/v3/projects/d5ac29f8cba642e987df2de5cdd46428/users/3786ccd1c7ca4271b03cf507b717e000/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:34.632383 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9450eae-714d-4368-9c2c-5d195f4b8119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ac29f8cba642e987df2de5cdd46428, user_id=3786ccd1c7ca4271b03cf507b717e000, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:34.636831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9450eae-714d-4368-9c2c-5d195f4b8119 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:34.782635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1376/2726] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:34 2022] PUT /identity/v3/projects/d5ac29f8cba642e987df2de5cdd46428/users/3786ccd1c7ca4271b03cf507b717e000/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:34.800984 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e128964-9b33-4ef2-8952-77bc7dde0cba None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:34.801561 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e128964-9b33-4ef2-8952-77bc7dde0cba None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:34.802084 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e128964-9b33-4ef2-8952-77bc7dde0cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:34.845865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-8e128964-9b33-4ef2-8952-77bc7dde0cba None None] MFA Rules not processed for user `3786ccd1c7ca4271b03cf507b717e000`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:34.847128 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8e128964-9b33-4ef2-8952-77bc7dde0cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:34.935122 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1351/2727] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:34.940008 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9450eae-714d-4368-9c2c-5d195f4b8119 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:35.009440 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9450eae-714d-4368-9c2c-5d195f4b8119 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:35.014068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc25a4-55e4-4779-92ee-a08ae8eb876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:35.014737 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc25a4-55e4-4779-92ee-a08ae8eb876d admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.015021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc25a4-55e4-4779-92ee-a08ae8eb876d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.015299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc25a4-55e4-4779-92ee-a08ae8eb876d admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.016016 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc25a4-55e4-4779-92ee-a08ae8eb876d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:35.017993 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc25a4-55e4-4779-92ee-a08ae8eb876d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:35.158205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1377/2728] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:34 2022] POST /identity/v3/projects => generated 399 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:35.162678 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e128964-9b33-4ef2-8952-77bc7dde0cba None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:35.175339 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e128964-9b33-4ef2-8952-77bc7dde0cba None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:35.262673 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac726f8-d0d6-4962-b288-57f449794e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:35.263750 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac726f8-d0d6-4962-b288-57f449794e3e admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.264467 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac726f8-d0d6-4962-b288-57f449794e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.264854 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac726f8-d0d6-4962-b288-57f449794e3e admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.265770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac726f8-d0d6-4962-b288-57f449794e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:35.267842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac726f8-d0d6-4962-b288-57f449794e3e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:35.406637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1352/2729] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:35 2022] POST /identity/v3/users => generated 306 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:35.409898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc25a4-55e4-4779-92ee-a08ae8eb876d admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:35.421486 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc25a4-55e4-4779-92ee-a08ae8eb876d admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:35.434432 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf7193-efd2-4b42-82f5-2aa49a0648a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:35.435140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf7193-efd2-4b42-82f5-2aa49a0648a6 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.435427 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf7193-efd2-4b42-82f5-2aa49a0648a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.436292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf7193-efd2-4b42-82f5-2aa49a0648a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.436465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf7193-efd2-4b42-82f5-2aa49a0648a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:35.438374 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf7193-efd2-4b42-82f5-2aa49a0648a6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:35.450708 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1378/2730] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:35.455221 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac726f8-d0d6-4962-b288-57f449794e3e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:35.466620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac726f8-d0d6-4962-b288-57f449794e3e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:35.472848 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594df937-b4e8-4454-bd39-e356e0003cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:35.473912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594df937-b4e8-4454-bd39-e356e0003cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.474282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594df937-b4e8-4454-bd39-e356e0003cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.474867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594df937-b4e8-4454-bd39-e356e0003cd0 admin admin] PATH_INFO: `/v3/projects/3c8d527577c64973bd68f60d1159430a/users/919b772e43754360975f3f8de1db2098/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.494713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594df937-b4e8-4454-bd39-e356e0003cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8d527577c64973bd68f60d1159430a, user_id=919b772e43754360975f3f8de1db2098, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:35.497583 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594df937-b4e8-4454-bd39-e356e0003cd0 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:35.590219 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1353/2731] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:35 2022] PUT /identity/v3/projects/3c8d527577c64973bd68f60d1159430a/users/919b772e43754360975f3f8de1db2098/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:35.594395 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf7193-efd2-4b42-82f5-2aa49a0648a6 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:35.612316 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf7193-efd2-4b42-82f5-2aa49a0648a6 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:35.677082 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:35.692488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420d1ae-6d12-411c-9df7-cc14cdcc5b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:35.693326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420d1ae-6d12-411c-9df7-cc14cdcc5b66 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.693641 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420d1ae-6d12-411c-9df7-cc14cdcc5b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.694091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420d1ae-6d12-411c-9df7-cc14cdcc5b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.695519 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420d1ae-6d12-411c-9df7-cc14cdcc5b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:35.697627 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420d1ae-6d12-411c-9df7-cc14cdcc5b66 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:35.713140 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1379/2732] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:35.719279 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594df937-b4e8-4454-bd39-e356e0003cd0 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:35.731338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594df937-b4e8-4454-bd39-e356e0003cd0 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:35.741726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004d31f-30b2-4ec1-9a78-475d3c55b1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:35.741726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004d31f-30b2-4ec1-9a78-475d3c55b1f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.741726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004d31f-30b2-4ec1-9a78-475d3c55b1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.741726 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004d31f-30b2-4ec1-9a78-475d3c55b1f9 admin admin] PATH_INFO: `/v3/projects/3c8d527577c64973bd68f60d1159430a/users/919b772e43754360975f3f8de1db2098/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.743027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004d31f-30b2-4ec1-9a78-475d3c55b1f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8d527577c64973bd68f60d1159430a, user_id=919b772e43754360975f3f8de1db2098, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:35.746532 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004d31f-30b2-4ec1-9a78-475d3c55b1f9 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:35.758864 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1354/2733] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:35 2022] PUT /identity/v3/projects/3c8d527577c64973bd68f60d1159430a/users/919b772e43754360975f3f8de1db2098/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:35.770671 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15385213-c8b7-4b3d-a043-e53ab0b3d330 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.770914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15385213-c8b7-4b3d-a043-e53ab0b3d330 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.771490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15385213-c8b7-4b3d-a043-e53ab0b3d330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.803866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-15385213-c8b7-4b3d-a043-e53ab0b3d330 None None] MFA Rules not processed for user `919b772e43754360975f3f8de1db2098`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:35.805192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-15385213-c8b7-4b3d-a043-e53ab0b3d330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:35.896039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1380/2734] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:35.904528 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004d31f-30b2-4ec1-9a78-475d3c55b1f9 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:35.906406 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2004d31f-30b2-4ec1-9a78-475d3c55b1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:35.968730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:35.994957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004d31f-30b2-4ec1-9a78-475d3c55b1f9 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:35.999274 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0888a4-a2d1-497d-a3d2-f1c215055497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:35.999959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0888a4-a2d1-497d-a3d2-f1c215055497 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:36.000320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0888a4-a2d1-497d-a3d2-f1c215055497 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:36.000470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0888a4-a2d1-497d-a3d2-f1c215055497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:36.011511 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0888a4-a2d1-497d-a3d2-f1c215055497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:36.012863 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0888a4-a2d1-497d-a3d2-f1c215055497 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:36.023499 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1355/2735] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:36.330936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15385213-c8b7-4b3d-a043-e53ab0b3d330 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:36.347984 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15385213-c8b7-4b3d-a043-e53ab0b3d330 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:36.348974 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362099c-2494-4632-857a-6074f2509dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:36.349668 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362099c-2494-4632-857a-6074f2509dec service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:36.349995 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362099c-2494-4632-857a-6074f2509dec service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:36.350534 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362099c-2494-4632-857a-6074f2509dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:36.414859 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0888a4-a2d1-497d-a3d2-f1c215055497 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:36.416776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ab0888a4-a2d1-497d-a3d2-f1c215055497 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:36.425172 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362099c-2494-4632-857a-6074f2509dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:36.427776 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362099c-2494-4632-857a-6074f2509dec service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:36.437836 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1381/2736] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:36.508979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0888a4-a2d1-497d-a3d2-f1c215055497 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:36.513843 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:36.514749 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:36.515177 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:36.515469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] PATH_INFO: `/v3/users/c29502565f6742f9a334c44a77eb80f0` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:36.516713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29502565f6742f9a334c44a77eb80f0)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:36.518693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:36.940126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29502565f6742f9a334c44a77eb80f0'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:37.046152 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29502565f6742f9a334c44a77eb80f0'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:37.047303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29502565f6742f9a334c44a77eb80f0'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:37.060984 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29502565f6742f9a334c44a77eb80f0'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:37.063088 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29502565f6742f9a334c44a77eb80f0'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:37.096181 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1356/2737] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:36 2022] DELETE /identity/v3/users/c29502565f6742f9a334c44a77eb80f0 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:37.101001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b2c6a-9dbb-4fab-9755-4bd140fb8ba3 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:37.101971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b2c6a-9dbb-4fab-9755-4bd140fb8ba3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:37.102286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b2c6a-9dbb-4fab-9755-4bd140fb8ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:37.136791 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-221b2c6a-9dbb-4fab-9755-4bd140fb8ba3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:37.138268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-221b2c6a-9dbb-4fab-9755-4bd140fb8ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:37.238291 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1382/2738] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:37.248537 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:37.250165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:37.362369 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f61248-12c9-46d8-a6a7-ea3ad210088a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:37.369313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0b409-50d2-4a7b-888c-2111510d0753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:37.370090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0b409-50d2-4a7b-888c-2111510d0753 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:37.370611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0b409-50d2-4a7b-888c-2111510d0753 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:37.371217 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0b409-50d2-4a7b-888c-2111510d0753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:37.383274 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0b409-50d2-4a7b-888c-2111510d0753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:37.385798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0b409-50d2-4a7b-888c-2111510d0753 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:37.408499 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1357/2739] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:37.447991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:37.796824 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:37.982368 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b2c6a-9dbb-4fab-9755-4bd140fb8ba3 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:37.984240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-221b2c6a-9dbb-4fab-9755-4bd140fb8ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:38.003068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b2c6a-9dbb-4fab-9755-4bd140fb8ba3 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:38.022786 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:38.023831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:38.024222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:38.024603 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] PATH_INFO: `/v3/projects/1534e49f7596468f8ce99bbeb4b13e6f` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:38.029416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1534e49f7596468f8ce99bbeb4b13e6f)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:38.031692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:38.308767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1534e49f7596468f8ce99bbeb4b13e6f', 'request_id': 'req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:38.412324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1534e49f7596468f8ce99bbeb4b13e6f', 'request_id': 'req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:38.424939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1534e49f7596468f8ce99bbeb4b13e6f', 'request_id': 'req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:38.456914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] The token cache is being invalidate because project 1534e49f7596468f8ce99bbeb4b13e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:38.479204 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:38.479204 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:38.479204 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1383/2740] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:37 2022] DELETE /identity/v3/projects/1534e49f7596468f8ce99bbeb4b13e6f => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:38.479550 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0b409-50d2-4a7b-888c-2111510d0753 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:38.507900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0b409-50d2-4a7b-888c-2111510d0753 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:38.644553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:38.647523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:38.647523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:38.647523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] PATH_INFO: `/v3/users/c0c021e2ae8443b8bab0edf7395da443` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:38.648318 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c021e2ae8443b8bab0edf7395da443)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:38.651851 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:38.963399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c021e2ae8443b8bab0edf7395da443'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:39.051337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:39.136782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c021e2ae8443b8bab0edf7395da443'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:39.136782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c021e2ae8443b8bab0edf7395da443'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:39.144405 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c021e2ae8443b8bab0edf7395da443'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:39.146004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c021e2ae8443b8bab0edf7395da443'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:39.183014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1358/2741] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:38 2022] DELETE /identity/v3/users/c0c021e2ae8443b8bab0edf7395da443 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:39.637556 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:39.639187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:39.659918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcb4a1-1dd3-4fec-983d-c0779e4f0491 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:39.730410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:39.739541 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:39.740497 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:39.740777 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:39.741052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] PATH_INFO: `/v3/users/683dec78a9094dd4861bd1ba0cd4e5b5` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:39.742444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=683dec78a9094dd4861bd1ba0cd4e5b5)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:39.744554 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:39.816814 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:39.817885 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:39.838667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf7e8b-613c-4743-ab28-4ad3aca29589 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:39.847261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5d363-1cb4-441a-875d-05b249631fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:39.850888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d363-1cb4-441a-875d-05b249631fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:39.850888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d363-1cb4-441a-875d-05b249631fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:39.850888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d363-1cb4-441a-875d-05b249631fbc admin admin] PATH_INFO: `/v3/projects/9e3d0a27d05c4fd2a4637c1ca715f5cf` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:39.850888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5d363-1cb4-441a-875d-05b249631fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3d0a27d05c4fd2a4637c1ca715f5cf)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:39.853828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5d363-1cb4-441a-875d-05b249631fbc admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:39.982455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '683dec78a9094dd4861bd1ba0cd4e5b5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.027597 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f6f5d363-1cb4-441a-875d-05b249631fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3d0a27d05c4fd2a4637c1ca715f5cf', 'request_id': 'req-f6f5d363-1cb4-441a-875d-05b249631fbc'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.116424 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '683dec78a9094dd4861bd1ba0cd4e5b5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.125941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '683dec78a9094dd4861bd1ba0cd4e5b5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.126750 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '683dec78a9094dd4861bd1ba0cd4e5b5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.129717 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '683dec78a9094dd4861bd1ba0cd4e5b5'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.157906 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1384/2742] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:39 2022] DELETE /identity/v3/users/683dec78a9094dd4861bd1ba0cd4e5b5 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:40.206218 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f6f5d363-1cb4-441a-875d-05b249631fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3d0a27d05c4fd2a4637c1ca715f5cf', 'request_id': 'req-f6f5d363-1cb4-441a-875d-05b249631fbc'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.216465 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:40.221357 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:40.223016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f6f5d363-1cb4-441a-875d-05b249631fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3d0a27d05c4fd2a4637c1ca715f5cf', 'request_id': 'req-f6f5d363-1cb4-441a-875d-05b249631fbc'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.245956 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f6f5d363-1cb4-441a-875d-05b249631fbc admin admin] The token cache is being invalidate because project 9e3d0a27d05c4fd2a4637c1ca715f5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:40.246437 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f6f5d363-1cb4-441a-875d-05b249631fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.247542 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f6f5d363-1cb4-441a-875d-05b249631fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.250637 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1359/2743] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:39 2022] DELETE /identity/v3/projects/9e3d0a27d05c4fd2a4637c1ca715f5cf => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:40.261530 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6bb97-0189-4121-8625-6c42a2335cb7 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:40.262139 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6bb97-0189-4121-8625-6c42a2335cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:40.262574 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6bb97-0189-4121-8625-6c42a2335cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:40.292428 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-88a6bb97-0189-4121-8625-6c42a2335cb7 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:40.293967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-88a6bb97-0189-4121-8625-6c42a2335cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:40.356520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fd926-583e-4904-9026-22e210792e5b admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:40.365600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:40.367891 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:40.368408 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:40.369157 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] PATH_INFO: `/v3/users/c5c2cfe5fd634ff2a367dca5c711a036` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:40.371801 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c2cfe5fd634ff2a367dca5c711a036)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:40.376508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:40.394175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1360/2744] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:40.408996 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf30ff4-2825-4c6d-85ec-f4fd006d59c1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:40.410819 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf30ff4-2825-4c6d-85ec-f4fd006d59c1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:40.410819 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf30ff4-2825-4c6d-85ec-f4fd006d59c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:40.432711 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-0cf30ff4-2825-4c6d-85ec-f4fd006d59c1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:40.434098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0cf30ff4-2825-4c6d-85ec-f4fd006d59c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:40.442827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1361/2745] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:40.449769 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf30ff4-2825-4c6d-85ec-f4fd006d59c1 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:40.464561 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf30ff4-2825-4c6d-85ec-f4fd006d59c1 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:40.473059 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9395eeb-ce54-4f96-b1ab-0d6e1e517f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:40.474254 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9395eeb-ce54-4f96-b1ab-0d6e1e517f94 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:40.474793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9395eeb-ce54-4f96-b1ab-0d6e1e517f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:40.475313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9395eeb-ce54-4f96-b1ab-0d6e1e517f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:40.476738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9395eeb-ce54-4f96-b1ab-0d6e1e517f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:40.477245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9395eeb-ce54-4f96-b1ab-0d6e1e517f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:40.481015 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9395eeb-ce54-4f96-b1ab-0d6e1e517f94 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:40.501029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1362/2746] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:07:40.507278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9395eeb-ce54-4f96-b1ab-0d6e1e517f94 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:40.527391 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9395eeb-ce54-4f96-b1ab-0d6e1e517f94 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:40.535249 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e9349-4346-4376-aa47-d6f81b3c4fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:40.536310 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e9349-4346-4376-aa47-d6f81b3c4fab admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:40.536769 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e9349-4346-4376-aa47-d6f81b3c4fab admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:40.537305 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e9349-4346-4376-aa47-d6f81b3c4fab admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:40.538616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e9349-4346-4376-aa47-d6f81b3c4fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:40.542277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e9349-4346-4376-aa47-d6f81b3c4fab admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:40.630135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c2cfe5fd634ff2a367dca5c711a036'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.658353 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1363/2747] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:40 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:40.659692 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e9349-4346-4376-aa47-d6f81b3c4fab admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:40.661925 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-414e9349-4346-4376-aa47-d6f81b3c4fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:40.728138 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c2cfe5fd634ff2a367dca5c711a036'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.742094 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c2cfe5fd634ff2a367dca5c711a036'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.742817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c2cfe5fd634ff2a367dca5c711a036'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.743564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c2cfe5fd634ff2a367dca5c711a036'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:40.754866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e9349-4346-4376-aa47-d6f81b3c4fab admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:40.762055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:40.763736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:40.764041 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:40.764564 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] PATH_INFO: `/v3/projects/afe531fc6b8f4fe7ae2b07aa117947d7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:40.766788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe531fc6b8f4fe7ae2b07aa117947d7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:40.769309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:40.775376 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1385/2748] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:40 2022] DELETE /identity/v3/users/c5c2cfe5fd634ff2a367dca5c711a036 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:40.780187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:40.780187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:40.871677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6a76e-f626-4604-9408-5554c717e098 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:40.877985 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54c8f8-e181-4603-8c85-fbd5fe43f994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:40.879215 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54c8f8-e181-4603-8c85-fbd5fe43f994 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:40.879712 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54c8f8-e181-4603-8c85-fbd5fe43f994 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:40.880217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54c8f8-e181-4603-8c85-fbd5fe43f994 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:40.881548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54c8f8-e181-4603-8c85-fbd5fe43f994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:40.886115 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54c8f8-e181-4603-8c85-fbd5fe43f994 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:40.939847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe531fc6b8f4fe7ae2b07aa117947d7', 'request_id': 'req-977d1f8a-709e-476b-82f6-2b2f09f8ea49'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:41.032652 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1386/2749] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:40 2022] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:41.034092 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3c3f-750e-43e1-9fc0-719185467708 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:41.034457 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3c3f-750e-43e1-9fc0-719185467708 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:41.034795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3c3f-750e-43e1-9fc0-719185467708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:41.053933 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-be4a3c3f-750e-43e1-9fc0-719185467708 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:41.055180 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-be4a3c3f-750e-43e1-9fc0-719185467708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:41.057667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe531fc6b8f4fe7ae2b07aa117947d7', 'request_id': 'req-977d1f8a-709e-476b-82f6-2b2f09f8ea49'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:41.065703 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe531fc6b8f4fe7ae2b07aa117947d7', 'request_id': 'req-977d1f8a-709e-476b-82f6-2b2f09f8ea49'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:41.083233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] The token cache is being invalidate because project afe531fc6b8f4fe7ae2b07aa117947d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:41.083694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:41.084988 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:41.087541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1364/2750] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:40 2022] DELETE /identity/v3/projects/afe531fc6b8f4fe7ae2b07aa117947d7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:41.091275 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:41.091275 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:41.139863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1387/2751] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:41.140812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a3c3f-750e-43e1-9fc0-719185467708 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:41.142377 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-be4a3c3f-750e-43e1-9fc0-719185467708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:41.158181 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a3c3f-750e-43e1-9fc0-719185467708 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:41.166418 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:41.167990 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:41.168508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:41.169011 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] PATH_INFO: `/v3/users/dc87003326e84c849020deb7d983c29a` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:41.171266 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc87003326e84c849020deb7d983c29a)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:41.175299 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:41.182717 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d1f8a-709e-476b-82f6-2b2f09f8ea49 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:41.189944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b2030-82e1-4e50-a0f9-f23e7c789e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:41.191126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b2030-82e1-4e50-a0f9-f23e7c789e92 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:41.191705 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b2030-82e1-4e50-a0f9-f23e7c789e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:41.192320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b2030-82e1-4e50-a0f9-f23e7c789e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:41.193580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b2030-82e1-4e50-a0f9-f23e7c789e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:41.196287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b2030-82e1-4e50-a0f9-f23e7c789e92 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:41.207464 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:41.216744 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1365/2752] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:41.217893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b2030-82e1-4e50-a0f9-f23e7c789e92 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:41.220720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7e4b2030-82e1-4e50-a0f9-f23e7c789e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:41.291215 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b2030-82e1-4e50-a0f9-f23e7c789e92 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:41.296374 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19a168-1b40-4a3e-8048-8089c414428c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:41.297530 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19a168-1b40-4a3e-8048-8089c414428c service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:41.297948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19a168-1b40-4a3e-8048-8089c414428c service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:41.298367 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19a168-1b40-4a3e-8048-8089c414428c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:41.315012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19a168-1b40-4a3e-8048-8089c414428c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:41.317824 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19a168-1b40-4a3e-8048-8089c414428c service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:41.333893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1366/2753] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:41.335008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19a168-1b40-4a3e-8048-8089c414428c service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:41.346474 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19a168-1b40-4a3e-8048-8089c414428c service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:41.351549 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911e341-d00c-4d87-9b5a-93438d3aff26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:41.352287 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911e341-d00c-4d87-9b5a-93438d3aff26 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:41.352558 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911e341-d00c-4d87-9b5a-93438d3aff26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:41.352827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911e341-d00c-4d87-9b5a-93438d3aff26 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:41.354095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911e341-d00c-4d87-9b5a-93438d3aff26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:41.355720 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911e341-d00c-4d87-9b5a-93438d3aff26 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:41.367165 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1367/2754] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:41.372259 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911e341-d00c-4d87-9b5a-93438d3aff26 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:41.382826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911e341-d00c-4d87-9b5a-93438d3aff26 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:41.389441 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba4af2-17cf-4005-923c-db7f5f41661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:41.389746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba4af2-17cf-4005-923c-db7f5f41661e admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:41.391467 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba4af2-17cf-4005-923c-db7f5f41661e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:41.391467 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba4af2-17cf-4005-923c-db7f5f41661e admin admin] PATH_INFO: `/v3/projects/992ff7cc55154c0f8685e02c6b019976/users/58e3e20daad142ceb40bf38bb8e09944/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:41.408729 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba4af2-17cf-4005-923c-db7f5f41661e admin admin] RBAC: Authorizing `identity:create_grant(project_id=992ff7cc55154c0f8685e02c6b019976, user_id=58e3e20daad142ceb40bf38bb8e09944, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:41.411756 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba4af2-17cf-4005-923c-db7f5f41661e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:41.439544 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc87003326e84c849020deb7d983c29a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:41.503423 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1368/2755] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:41 2022] PUT /identity/v3/projects/992ff7cc55154c0f8685e02c6b019976/users/58e3e20daad142ceb40bf38bb8e09944/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:41.516452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b702495-7cb9-4728-b1b2-0da994c16613 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:41.516738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b702495-7cb9-4728-b1b2-0da994c16613 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:41.517019 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b702495-7cb9-4728-b1b2-0da994c16613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:41.527758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc87003326e84c849020deb7d983c29a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:41.536289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc87003326e84c849020deb7d983c29a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:41.547230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc87003326e84c849020deb7d983c29a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:41.547230 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc87003326e84c849020deb7d983c29a'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:41.554239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7b702495-7cb9-4728-b1b2-0da994c16613 None None] MFA Rules not processed for user `58e3e20daad142ceb40bf38bb8e09944`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:41.555613 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7b702495-7cb9-4728-b1b2-0da994c16613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:41.562187 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1388/2756] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:41 2022] DELETE /identity/v3/users/dc87003326e84c849020deb7d983c29a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:41.646622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1369/2757] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:41.662380 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:41.663896 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:41.768967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f916d-2493-4e4f-b066-cc995f3cd3e4 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:41.778635 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ce47a-d754-4905-b451-eb3b3470ae44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:41.779780 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ce47a-d754-4905-b451-eb3b3470ae44 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:41.780704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ce47a-d754-4905-b451-eb3b3470ae44 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:41.781487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ce47a-d754-4905-b451-eb3b3470ae44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:41.830971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:41.869680 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ce47a-d754-4905-b451-eb3b3470ae44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:41.871163 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ce47a-d754-4905-b451-eb3b3470ae44 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:41.888153 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b702495-7cb9-4728-b1b2-0da994c16613 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:41.889847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7b702495-7cb9-4728-b1b2-0da994c16613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:41.899055 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1389/2758] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:41.901876 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ce47a-d754-4905-b451-eb3b3470ae44 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:41.906178 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d70ce47a-d754-4905-b451-eb3b3470ae44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:41.994470 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b702495-7cb9-4728-b1b2-0da994c16613 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:42.029137 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ce47a-d754-4905-b451-eb3b3470ae44 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:42.034389 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:42.035286 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:42.035569 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:42.035847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] PATH_INFO: `/v3/projects/cbcd99342eea413db36a475f3419c8fd` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:42.037176 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbcd99342eea413db36a475f3419c8fd)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:42.039193 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:42.083755 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab3692-fe9e-413f-bd6b-3e903f882cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:42.084806 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab3692-fe9e-413f-bd6b-3e903f882cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:42.085095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab3692-fe9e-413f-bd6b-3e903f882cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:42.085407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab3692-fe9e-413f-bd6b-3e903f882cb8 admin admin] PATH_INFO: `/v3/projects/af85e10bb47e426f88716ffee21647d2` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:42.086776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab3692-fe9e-413f-bd6b-3e903f882cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af85e10bb47e426f88716ffee21647d2)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:42.088828 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab3692-fe9e-413f-bd6b-3e903f882cb8 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:42.203240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbcd99342eea413db36a475f3419c8fd', 'request_id': 'req-1319b3d5-b13c-47ce-ac2f-f29aa885576b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.234054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-75ab3692-fe9e-413f-bd6b-3e903f882cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af85e10bb47e426f88716ffee21647d2', 'request_id': 'req-75ab3692-fe9e-413f-bd6b-3e903f882cb8'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.287168 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbcd99342eea413db36a475f3419c8fd', 'request_id': 'req-1319b3d5-b13c-47ce-ac2f-f29aa885576b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.294114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbcd99342eea413db36a475f3419c8fd', 'request_id': 'req-1319b3d5-b13c-47ce-ac2f-f29aa885576b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.306177 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] The token cache is being invalidate because project cbcd99342eea413db36a475f3419c8fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:42.306464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.307149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.308877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1390/2759] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:41 2022] DELETE /identity/v3/projects/cbcd99342eea413db36a475f3419c8fd => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:42.309770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:42.311107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:42.348159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-75ab3692-fe9e-413f-bd6b-3e903f882cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af85e10bb47e426f88716ffee21647d2', 'request_id': 'req-75ab3692-fe9e-413f-bd6b-3e903f882cb8'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.355832 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-75ab3692-fe9e-413f-bd6b-3e903f882cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af85e10bb47e426f88716ffee21647d2', 'request_id': 'req-75ab3692-fe9e-413f-bd6b-3e903f882cb8'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.371416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-75ab3692-fe9e-413f-bd6b-3e903f882cb8 admin admin] The token cache is being invalidate because project af85e10bb47e426f88716ffee21647d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:42.371780 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-75ab3692-fe9e-413f-bd6b-3e903f882cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.372586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-75ab3692-fe9e-413f-bd6b-3e903f882cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.379903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1370/2760] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:41 2022] DELETE /identity/v3/projects/af85e10bb47e426f88716ffee21647d2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:42.381830 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704f154-0a62-4904-a070-ab28b0b4277b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:42.382242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704f154-0a62-4904-a070-ab28b0b4277b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:42.382562 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704f154-0a62-4904-a070-ab28b0b4277b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:42.416826 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c704f154-0a62-4904-a070-ab28b0b4277b None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:42.419261 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c704f154-0a62-4904-a070-ab28b0b4277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:42.462827 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319b3d5-b13c-47ce-ac2f-f29aa885576b admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:42.521272 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1371/2761] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:42.522977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704f154-0a62-4904-a070-ab28b0b4277b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:42.526747 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c704f154-0a62-4904-a070-ab28b0b4277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:42.543961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704f154-0a62-4904-a070-ab28b0b4277b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:42.550086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b386b-6769-4070-bf10-d3369a034be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:42.551297 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b386b-6769-4070-bf10-d3369a034be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:42.551590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b386b-6769-4070-bf10-d3369a034be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:42.551877 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b386b-6769-4070-bf10-d3369a034be5 admin admin] PATH_INFO: `/v3/users/3786ccd1c7ca4271b03cf507b717e000` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:42.553515 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b386b-6769-4070-bf10-d3369a034be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3786ccd1c7ca4271b03cf507b717e000)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:42.555582 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b386b-6769-4070-bf10-d3369a034be5 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:42.584016 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:42.585290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:42.586772 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:42.586772 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] PATH_INFO: `/v3/users/58e3e20daad142ceb40bf38bb8e09944` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:42.588613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e3e20daad142ceb40bf38bb8e09944)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:42.591605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:42.717239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:42.800434 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-353b386b-6769-4070-bf10-d3369a034be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3786ccd1c7ca4271b03cf507b717e000'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.839475 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e3e20daad142ceb40bf38bb8e09944'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.932021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-353b386b-6769-4070-bf10-d3369a034be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3786ccd1c7ca4271b03cf507b717e000'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.932647 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-353b386b-6769-4070-bf10-d3369a034be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3786ccd1c7ca4271b03cf507b717e000'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.941314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-353b386b-6769-4070-bf10-d3369a034be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3786ccd1c7ca4271b03cf507b717e000'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.942092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-353b386b-6769-4070-bf10-d3369a034be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3786ccd1c7ca4271b03cf507b717e000'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:42.960966 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1372/2762] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:42 2022] DELETE /identity/v3/users/3786ccd1c7ca4271b03cf507b717e000 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:42.962315 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b9773-8091-4238-ab6f-b92cf2369d9d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:42.962604 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b9773-8091-4238-ab6f-b92cf2369d9d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:42.962882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b9773-8091-4238-ab6f-b92cf2369d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:42.983248 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-766b9773-8091-4238-ab6f-b92cf2369d9d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:42.984390 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-766b9773-8091-4238-ab6f-b92cf2369d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:43.047049 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1373/2763] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:43.048381 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fab37-28f3-424f-86d9-d107658b768f None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:43.048696 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fab37-28f3-424f-86d9-d107658b768f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:43.048957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fab37-28f3-424f-86d9-d107658b768f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:43.068302 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-fd6fab37-28f3-424f-86d9-d107658b768f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:43.069611 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fd6fab37-28f3-424f-86d9-d107658b768f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:43.078351 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e3e20daad142ceb40bf38bb8e09944'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:43.078781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1374/2764] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:43.079731 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fab37-28f3-424f-86d9-d107658b768f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:43.087932 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e3e20daad142ceb40bf38bb8e09944'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:43.088758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e3e20daad142ceb40bf38bb8e09944'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:43.089499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e3e20daad142ceb40bf38bb8e09944'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:43.090997 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fab37-28f3-424f-86d9-d107658b768f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:43.096881 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b55fd-bc4e-4ef2-9277-c7950a3a0f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:43.097661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b55fd-bc4e-4ef2-9277-c7950a3a0f00 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:43.098282 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b55fd-bc4e-4ef2-9277-c7950a3a0f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:43.098402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b55fd-bc4e-4ef2-9277-c7950a3a0f00 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:43.099429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b55fd-bc4e-4ef2-9277-c7950a3a0f00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:43.099554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b55fd-bc4e-4ef2-9277-c7950a3a0f00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:43.101309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b55fd-bc4e-4ef2-9277-c7950a3a0f00 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:43.115521 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1375/2765] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:07:43.119240 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b55fd-bc4e-4ef2-9277-c7950a3a0f00 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:43.120883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e05b55fd-bc4e-4ef2-9277-c7950a3a0f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:43.127418 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1391/2766] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:42 2022] DELETE /identity/v3/users/58e3e20daad142ceb40bf38bb8e09944 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:43.129238 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:43.132420 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:43.189615 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b55fd-bc4e-4ef2-9277-c7950a3a0f00 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:43.271543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3e12c-e97a-4736-b5d3-acc5feed5a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:43.272395 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3e12c-e97a-4736-b5d3-acc5feed5a07 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:43.272984 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3e12c-e97a-4736-b5d3-acc5feed5a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:43.273529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3e12c-e97a-4736-b5d3-acc5feed5a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:43.276872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5ff3e12c-e97a-4736-b5d3-acc5feed5a07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:43.325091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:43.379025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f40c2d-176b-4fdd-9656-166595629e00 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:43.383848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311a13f-139e-461a-a808-411ecbb3189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:43.385328 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311a13f-139e-461a-a808-411ecbb3189c admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:43.385512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311a13f-139e-461a-a808-411ecbb3189c admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:43.389704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311a13f-139e-461a-a808-411ecbb3189c admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:43.389704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311a13f-139e-461a-a808-411ecbb3189c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:43.389704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311a13f-139e-461a-a808-411ecbb3189c admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:43.391473 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3e12c-e97a-4736-b5d3-acc5feed5a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:43.394252 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3e12c-e97a-4736-b5d3-acc5feed5a07 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:43.410456 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1376/2767] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:43.411957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16a232-31ce-424c-ae87-e4e9e157f7c2 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:43.412332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16a232-31ce-424c-ae87-e4e9e157f7c2 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:43.412801 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16a232-31ce-424c-ae87-e4e9e157f7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:43.433160 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-fe16a232-31ce-424c-ae87-e4e9e157f7c2 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:43.434629 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fe16a232-31ce-424c-ae87-e4e9e157f7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:43.443108 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1377/2768] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:43.456131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16a232-31ce-424c-ae87-e4e9e157f7c2 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:43.457717 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fe16a232-31ce-424c-ae87-e4e9e157f7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:43.474562 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16a232-31ce-424c-ae87-e4e9e157f7c2 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:43.481012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a71c6c-09f9-4ed1-938a-9c1cbc33e565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:43.482187 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a71c6c-09f9-4ed1-938a-9c1cbc33e565 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:43.482693 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a71c6c-09f9-4ed1-938a-9c1cbc33e565 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:43.483206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a71c6c-09f9-4ed1-938a-9c1cbc33e565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:43.499117 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a71c6c-09f9-4ed1-938a-9c1cbc33e565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:43.500696 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a71c6c-09f9-4ed1-938a-9c1cbc33e565 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:43.514659 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1378/2769] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:43.541666 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1392/2770] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:43 2022] POST /identity/v3/projects => generated 371 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:43.546327 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a71c6c-09f9-4ed1-938a-9c1cbc33e565 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:43.556981 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a71c6c-09f9-4ed1-938a-9c1cbc33e565 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:43.623027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e36fe-c1b1-40d3-9d7a-3c11e50c6c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:43.623827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e36fe-c1b1-40d3-9d7a-3c11e50c6c2c admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:43.624206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e36fe-c1b1-40d3-9d7a-3c11e50c6c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:43.624621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e36fe-c1b1-40d3-9d7a-3c11e50c6c2c admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:43.625281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e36fe-c1b1-40d3-9d7a-3c11e50c6c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:43.627334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e36fe-c1b1-40d3-9d7a-3c11e50c6c2c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:43.768429 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1379/2771] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:43 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:43.772835 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311a13f-139e-461a-a808-411ecbb3189c admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:43.784591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311a13f-139e-461a-a808-411ecbb3189c admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:43.789468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee4d4c-bca8-4727-9dab-0ea7c239e102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:43.790159 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee4d4c-bca8-4727-9dab-0ea7c239e102 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:43.790471 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee4d4c-bca8-4727-9dab-0ea7c239e102 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:43.790914 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee4d4c-bca8-4727-9dab-0ea7c239e102 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:43.791672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee4d4c-bca8-4727-9dab-0ea7c239e102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:43.793320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee4d4c-bca8-4727-9dab-0ea7c239e102 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:43.806303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1393/2772] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:43.815286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e36fe-c1b1-40d3-9d7a-3c11e50c6c2c admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:43.827382 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e36fe-c1b1-40d3-9d7a-3c11e50c6c2c admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:43.834886 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e7f0d-22bd-47f7-aca5-03cd74aa27e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:43.835403 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e7f0d-22bd-47f7-aca5-03cd74aa27e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:43.835688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e7f0d-22bd-47f7-aca5-03cd74aa27e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:43.836515 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e7f0d-22bd-47f7-aca5-03cd74aa27e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:43.837955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e7f0d-22bd-47f7-aca5-03cd74aa27e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:43.839664 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e7f0d-22bd-47f7-aca5-03cd74aa27e6 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:43.851259 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1380/2773] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:43.855444 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee4d4c-bca8-4727-9dab-0ea7c239e102 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:43.867729 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee4d4c-bca8-4727-9dab-0ea7c239e102 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:43.898337 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:43.898963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd0c21-79a0-4d0e-98a2-7f770425f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:43.899942 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd0c21-79a0-4d0e-98a2-7f770425f833 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:43.900878 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd0c21-79a0-4d0e-98a2-7f770425f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:43.901165 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd0c21-79a0-4d0e-98a2-7f770425f833 admin admin] PATH_INFO: `/v3/projects/e284a0e80e454de29363977940f7187a/users/0ff2fbdb9c0f479497942aebf8989a20/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:43.934742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd0c21-79a0-4d0e-98a2-7f770425f833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e284a0e80e454de29363977940f7187a, user_id=0ff2fbdb9c0f479497942aebf8989a20, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:43.941270 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd0c21-79a0-4d0e-98a2-7f770425f833 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:43.953369 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:43.993010 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e7f0d-22bd-47f7-aca5-03cd74aa27e6 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:43.996195 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7f6e7f0d-22bd-47f7-aca5-03cd74aa27e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:44.032452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e7f0d-22bd-47f7-aca5-03cd74aa27e6 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:44.043267 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:44.044352 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.044840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.045666 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d admin admin] PATH_INFO: `/v3/projects/d5ac29f8cba642e987df2de5cdd46428` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.048100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ac29f8cba642e987df2de5cdd46428)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:44.050738 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:44.124067 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1394/2774] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:43 2022] PUT /identity/v3/projects/e284a0e80e454de29363977940f7187a/users/0ff2fbdb9c0f479497942aebf8989a20/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:44.187026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd0c21-79a0-4d0e-98a2-7f770425f833 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:44.189787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-cddd0c21-79a0-4d0e-98a2-7f770425f833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:44.253746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ac29f8cba642e987df2de5cdd46428', 'request_id': 'req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.277021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:44.284864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd0c21-79a0-4d0e-98a2-7f770425f833 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:44.355441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:44.356325 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.356612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.356892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] PATH_INFO: `/v3/projects/992ff7cc55154c0f8685e02c6b019976` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.358202 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=992ff7cc55154c0f8685e02c6b019976)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:44.360110 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:44.390066 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ac29f8cba642e987df2de5cdd46428', 'request_id': 'req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.400829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ac29f8cba642e987df2de5cdd46428', 'request_id': 'req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.413790 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d admin admin] The token cache is being invalidate because project d5ac29f8cba642e987df2de5cdd46428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:44.414087 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.414841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ce282b42-efd6-4beb-8384-1e2a7fb1fe9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.416454 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1381/2775] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:43 2022] DELETE /identity/v3/projects/d5ac29f8cba642e987df2de5cdd46428 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:44.417960 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5781a1c-22f3-4b4b-888f-004b2cbd6e96 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.418250 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5781a1c-22f3-4b4b-888f-004b2cbd6e96 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.418531 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5781a1c-22f3-4b4b-888f-004b2cbd6e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.448075 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a5781a1c-22f3-4b4b-888f-004b2cbd6e96 None None] MFA Rules not processed for user `0ff2fbdb9c0f479497942aebf8989a20`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:44.449293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a5781a1c-22f3-4b4b-888f-004b2cbd6e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:44.525894 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992ff7cc55154c0f8685e02c6b019976', 'request_id': 'req-2b1d1d3e-92b5-4115-b32c-115d80511065'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.537793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1382/2776] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:44.537793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5781a1c-22f3-4b4b-888f-004b2cbd6e96 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:44.537793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a5781a1c-22f3-4b4b-888f-004b2cbd6e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:44.552402 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5781a1c-22f3-4b4b-888f-004b2cbd6e96 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:44.616173 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dd5fa-5565-4ef8-9c6d-645aded9a496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:44.616418 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992ff7cc55154c0f8685e02c6b019976', 'request_id': 'req-2b1d1d3e-92b5-4115-b32c-115d80511065'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.616982 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dd5fa-5565-4ef8-9c6d-645aded9a496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.617285 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dd5fa-5565-4ef8-9c6d-645aded9a496 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.617576 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dd5fa-5565-4ef8-9c6d-645aded9a496 admin admin] PATH_INFO: `/v3/users/919b772e43754360975f3f8de1db2098` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.620362 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dd5fa-5565-4ef8-9c6d-645aded9a496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=919b772e43754360975f3f8de1db2098)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:44.622398 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dd5fa-5565-4ef8-9c6d-645aded9a496 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:44.624895 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992ff7cc55154c0f8685e02c6b019976', 'request_id': 'req-2b1d1d3e-92b5-4115-b32c-115d80511065'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.647909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] The token cache is being invalidate because project 992ff7cc55154c0f8685e02c6b019976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:44.647909 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.648640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.650932 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1395/2777] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:44 2022] DELETE /identity/v3/projects/992ff7cc55154c0f8685e02c6b019976 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:44.652547 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:44.653848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:44.655837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:44.720487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d1d3e-92b5-4115-b32c-115d80511065 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:44.724362 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63580427-e382-40bd-9036-01f473b9d898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:44.725018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63580427-e382-40bd-9036-01f473b9d898 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.725564 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63580427-e382-40bd-9036-01f473b9d898 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.728358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63580427-e382-40bd-9036-01f473b9d898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.728358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-63580427-e382-40bd-9036-01f473b9d898 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:44.795281 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63580427-e382-40bd-9036-01f473b9d898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:44.796957 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63580427-e382-40bd-9036-01f473b9d898 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:44.807068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1396/2778] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:44.808613 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ecb65-dc8a-48c5-8a34-3ffd0b576129 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.808999 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ecb65-dc8a-48c5-8a34-3ffd0b576129 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.809410 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ecb65-dc8a-48c5-8a34-3ffd0b576129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.812917 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-088dd5fa-5565-4ef8-9c6d-645aded9a496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919b772e43754360975f3f8de1db2098'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.830232 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-476ecb65-dc8a-48c5-8a34-3ffd0b576129 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:44.831623 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-476ecb65-dc8a-48c5-8a34-3ffd0b576129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:44.840697 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1397/2779] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:44.848609 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae89d7-f818-4594-b10c-e3ee58558d14 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.848907 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae89d7-f818-4594-b10c-e3ee58558d14 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.849235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae89d7-f818-4594-b10c-e3ee58558d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.869089 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-21ae89d7-f818-4594-b10c-e3ee58558d14 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:44.870260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-21ae89d7-f818-4594-b10c-e3ee58558d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:44.880892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1398/2780] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:44.885767 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae89d7-f818-4594-b10c-e3ee58558d14 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:44.892510 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-088dd5fa-5565-4ef8-9c6d-645aded9a496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919b772e43754360975f3f8de1db2098'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.895557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:44.895775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae89d7-f818-4594-b10c-e3ee58558d14 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:44.900881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9fded-b930-42fa-bc8e-261004049955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:44.901763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9fded-b930-42fa-bc8e-261004049955 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.902047 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9fded-b930-42fa-bc8e-261004049955 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.902323 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9fded-b930-42fa-bc8e-261004049955 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.902569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-088dd5fa-5565-4ef8-9c6d-645aded9a496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919b772e43754360975f3f8de1db2098'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.903054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9fded-b930-42fa-bc8e-261004049955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:44.903358 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9fded-b930-42fa-bc8e-261004049955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:44.905031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9fded-b930-42fa-bc8e-261004049955 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:44.916438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-088dd5fa-5565-4ef8-9c6d-645aded9a496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919b772e43754360975f3f8de1db2098'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.918808 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-088dd5fa-5565-4ef8-9c6d-645aded9a496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919b772e43754360975f3f8de1db2098'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:44.924822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1399/2781] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:07:44.925842 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9fded-b930-42fa-bc8e-261004049955 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:44.929209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1cf9fded-b930-42fa-bc8e-261004049955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:44.944996 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9fded-b930-42fa-bc8e-261004049955 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:44.945782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1383/2782] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:44 2022] DELETE /identity/v3/users/919b772e43754360975f3f8de1db2098 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:45.019847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6a96-9bdc-4906-afd0-0b7a67549781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:45.021026 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6a96-9bdc-4906-afd0-0b7a67549781 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:45.021303 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6a96-9bdc-4906-afd0-0b7a67549781 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:45.021642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6a96-9bdc-4906-afd0-0b7a67549781 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:45.022332 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b6a96-9bdc-4906-afd0-0b7a67549781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:45.024327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b6a96-9bdc-4906-afd0-0b7a67549781 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:45.256937 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1400/2783] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:44 2022] POST /identity/v3/projects => generated 359 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:45.262303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dd5fa-5565-4ef8-9c6d-645aded9a496 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:45.276684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dd5fa-5565-4ef8-9c6d-645aded9a496 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:45.328509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:45.360365 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5b9ca-db1b-44f7-9241-9326d58e854a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:45.361338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5b9ca-db1b-44f7-9241-9326d58e854a admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:45.362125 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5b9ca-db1b-44f7-9241-9326d58e854a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:45.362405 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5b9ca-db1b-44f7-9241-9326d58e854a admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:45.363126 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5b9ca-db1b-44f7-9241-9326d58e854a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:45.365342 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5b9ca-db1b-44f7-9241-9326d58e854a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:45.479761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1384/2784] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:45 2022] POST /identity/v3/users => generated 280 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:45.480642 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6a96-9bdc-4906-afd0-0b7a67549781 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:45.501545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6a96-9bdc-4906-afd0-0b7a67549781 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:45.508736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926abad-41ce-4325-b931-b239e108ea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:45.511053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926abad-41ce-4325-b931-b239e108ea37 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:45.511682 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926abad-41ce-4325-b931-b239e108ea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:45.512082 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926abad-41ce-4325-b931-b239e108ea37 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:45.513452 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926abad-41ce-4325-b931-b239e108ea37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:45.516135 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926abad-41ce-4325-b931-b239e108ea37 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:45.532375 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1401/2785] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:45.536632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5b9ca-db1b-44f7-9241-9326d58e854a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:45.548245 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5b9ca-db1b-44f7-9241-9326d58e854a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:45.553654 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9896b84-d3a0-4eab-8b47-b59ce5e19e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:45.554476 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896b84-d3a0-4eab-8b47-b59ce5e19e65 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:45.554761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896b84-d3a0-4eab-8b47-b59ce5e19e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:45.555039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896b84-d3a0-4eab-8b47-b59ce5e19e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:45.555781 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9896b84-d3a0-4eab-8b47-b59ce5e19e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:45.557475 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9896b84-d3a0-4eab-8b47-b59ce5e19e65 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:45.568632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1385/2786] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:45.573294 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926abad-41ce-4325-b931-b239e108ea37 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:45.583887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926abad-41ce-4325-b931-b239e108ea37 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:45.589327 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5b6bd-762d-4c41-b68f-ad2161086fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:45.590248 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5b6bd-762d-4c41-b68f-ad2161086fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:45.590526 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5b6bd-762d-4c41-b68f-ad2161086fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:45.590829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5b6bd-762d-4c41-b68f-ad2161086fb9 admin admin] PATH_INFO: `/v3/projects/6861322f5c1f4dedbd165087c48a0936/users/8a02d5cec4f149a9977e04f115ff25cc/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:45.609004 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5b6bd-762d-4c41-b68f-ad2161086fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6861322f5c1f4dedbd165087c48a0936, user_id=8a02d5cec4f149a9977e04f115ff25cc, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:45.612148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5b6bd-762d-4c41-b68f-ad2161086fb9 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:45.659514 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9896b84-d3a0-4eab-8b47-b59ce5e19e65 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:45.661624 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e9896b84-d3a0-4eab-8b47-b59ce5e19e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:45.693590 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9896b84-d3a0-4eab-8b47-b59ce5e19e65 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:45.698424 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870319c8-7273-4683-b43e-9fa1db3feaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:45.699370 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870319c8-7273-4683-b43e-9fa1db3feaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:45.699714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870319c8-7273-4683-b43e-9fa1db3feaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:45.700030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870319c8-7273-4683-b43e-9fa1db3feaa6 admin admin] PATH_INFO: `/v3/projects/3c8d527577c64973bd68f60d1159430a` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:45.701369 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870319c8-7273-4683-b43e-9fa1db3feaa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8d527577c64973bd68f60d1159430a)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:45.703979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870319c8-7273-4683-b43e-9fa1db3feaa6 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:45.770967 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1402/2787] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:45 2022] PUT /identity/v3/projects/6861322f5c1f4dedbd165087c48a0936/users/8a02d5cec4f149a9977e04f115ff25cc/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:45.783622 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692074b-4ab9-4d3b-8c93-1cabfa3bb086 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:45.783910 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692074b-4ab9-4d3b-8c93-1cabfa3bb086 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:45.784200 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692074b-4ab9-4d3b-8c93-1cabfa3bb086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:45.798646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:45.820523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-8692074b-4ab9-4d3b-8c93-1cabfa3bb086 None None] MFA Rules not processed for user `8a02d5cec4f149a9977e04f115ff25cc`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:45.822417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8692074b-4ab9-4d3b-8c93-1cabfa3bb086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:45.898915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-870319c8-7273-4683-b43e-9fa1db3feaa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8d527577c64973bd68f60d1159430a', 'request_id': 'req-870319c8-7273-4683-b43e-9fa1db3feaa6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:45.900775 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:45.913820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1403/2788] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:45.948640 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692074b-4ab9-4d3b-8c93-1cabfa3bb086 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:45.950093 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-8692074b-4ab9-4d3b-8c93-1cabfa3bb086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:46.016712 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-870319c8-7273-4683-b43e-9fa1db3feaa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8d527577c64973bd68f60d1159430a', 'request_id': 'req-870319c8-7273-4683-b43e-9fa1db3feaa6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:46.020036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692074b-4ab9-4d3b-8c93-1cabfa3bb086 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:46.024133 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-870319c8-7273-4683-b43e-9fa1db3feaa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8d527577c64973bd68f60d1159430a', 'request_id': 'req-870319c8-7273-4683-b43e-9fa1db3feaa6'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:46.039334 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-870319c8-7273-4683-b43e-9fa1db3feaa6 admin admin] The token cache is being invalidate because project 3c8d527577c64973bd68f60d1159430a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:46.039696 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-870319c8-7273-4683-b43e-9fa1db3feaa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:46.040900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-870319c8-7273-4683-b43e-9fa1db3feaa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:46.047559 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1386/2789] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:45 2022] DELETE /identity/v3/projects/3c8d527577c64973bd68f60d1159430a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:46.049729 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26332d70-af00-4312-b23e-baa0b5f83101 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:46.051203 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26332d70-af00-4312-b23e-baa0b5f83101 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:46.051203 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26332d70-af00-4312-b23e-baa0b5f83101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:46.080077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-26332d70-af00-4312-b23e-baa0b5f83101 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:46.081291 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-26332d70-af00-4312-b23e-baa0b5f83101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:46.082468 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de619713-a03b-4bb2-b1d2-ee1de3b306f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:46.083210 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de619713-a03b-4bb2-b1d2-ee1de3b306f1 service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:46.083499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de619713-a03b-4bb2-b1d2-ee1de3b306f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:46.083770 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de619713-a03b-4bb2-b1d2-ee1de3b306f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:46.085745 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-de619713-a03b-4bb2-b1d2-ee1de3b306f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:46.154536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1387/2790] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:46.161689 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de619713-a03b-4bb2-b1d2-ee1de3b306f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:46.162233 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096d788-b5ec-47d7-a79c-d068390fe30f None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:46.162576 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096d788-b5ec-47d7-a79c-d068390fe30f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:46.162888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096d788-b5ec-47d7-a79c-d068390fe30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:46.163141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de619713-a03b-4bb2-b1d2-ee1de3b306f1 service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:46.174046 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1404/2791] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:45 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:46.182396 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2096d788-b5ec-47d7-a79c-d068390fe30f None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:46.183541 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2096d788-b5ec-47d7-a79c-d068390fe30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:46.190719 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de619713-a03b-4bb2-b1d2-ee1de3b306f1 service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:46.192226 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-de619713-a03b-4bb2-b1d2-ee1de3b306f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:46.193497 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1388/2792] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:46.198560 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096d788-b5ec-47d7-a79c-d068390fe30f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:46.207212 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de619713-a03b-4bb2-b1d2-ee1de3b306f1 service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:46.213794 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211c779-5a84-4cfd-a8a6-cce2636cd3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:46.214736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c779-5a84-4cfd-a8a6-cce2636cd3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:46.215025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c779-5a84-4cfd-a8a6-cce2636cd3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:46.215461 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c779-5a84-4cfd-a8a6-cce2636cd3bd admin admin] PATH_INFO: `/v3/users/8a02d5cec4f149a9977e04f115ff25cc` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:46.216874 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211c779-5a84-4cfd-a8a6-cce2636cd3bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a02d5cec4f149a9977e04f115ff25cc)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:46.218562 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096d788-b5ec-47d7-a79c-d068390fe30f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:46.218861 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211c779-5a84-4cfd-a8a6-cce2636cd3bd admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:46.225217 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ca538-20e3-47d8-83b1-090d5760b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:46.226086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ca538-20e3-47d8-83b1-090d5760b243 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:46.226490 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ca538-20e3-47d8-83b1-090d5760b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:46.226809 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ca538-20e3-47d8-83b1-090d5760b243 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:46.227554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ca538-20e3-47d8-83b1-090d5760b243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:46.228933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ca538-20e3-47d8-83b1-090d5760b243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:46.230719 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ca538-20e3-47d8-83b1-090d5760b243 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:46.248509 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1389/2793] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:07:46.253222 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ca538-20e3-47d8-83b1-090d5760b243 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:46.265538 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ca538-20e3-47d8-83b1-090d5760b243 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:46.270624 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a8331-91ad-485e-b2ae-472ffa21357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:46.271313 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a8331-91ad-485e-b2ae-472ffa21357b admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:46.271769 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a8331-91ad-485e-b2ae-472ffa21357b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:46.272008 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a8331-91ad-485e-b2ae-472ffa21357b admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:46.272878 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a8331-91ad-485e-b2ae-472ffa21357b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:46.275500 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a8331-91ad-485e-b2ae-472ffa21357b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:46.407596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1390/2794] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:46 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:46.412001 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a8331-91ad-485e-b2ae-472ffa21357b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:46.455572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7211c779-5a84-4cfd-a8a6-cce2636cd3bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a02d5cec4f149a9977e04f115ff25cc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:46.484829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a8331-91ad-485e-b2ae-472ffa21357b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:46.489891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad3d02-865f-43ce-80d7-8be66a9e7ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:46.490592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad3d02-865f-43ce-80d7-8be66a9e7ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:46.490870 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad3d02-865f-43ce-80d7-8be66a9e7ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:46.491145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad3d02-865f-43ce-80d7-8be66a9e7ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:46.491835 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad3d02-865f-43ce-80d7-8be66a9e7ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:46.493797 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad3d02-865f-43ce-80d7-8be66a9e7ad1 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:46.531283 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7211c779-5a84-4cfd-a8a6-cce2636cd3bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a02d5cec4f149a9977e04f115ff25cc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:46.540335 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7211c779-5a84-4cfd-a8a6-cce2636cd3bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a02d5cec4f149a9977e04f115ff25cc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:46.541114 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7211c779-5a84-4cfd-a8a6-cce2636cd3bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a02d5cec4f149a9977e04f115ff25cc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:46.541759 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-7211c779-5a84-4cfd-a8a6-cce2636cd3bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a02d5cec4f149a9977e04f115ff25cc'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:46.560903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1405/2795] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:46 2022] DELETE /identity/v3/users/8a02d5cec4f149a9977e04f115ff25cc => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:46.565675 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f24c39-e28c-4253-ae76-737acc90eadc None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:46.565983 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f24c39-e28c-4253-ae76-737acc90eadc None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:46.566235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f24c39-e28c-4253-ae76-737acc90eadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:46.586209 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-00f24c39-e28c-4253-ae76-737acc90eadc None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:46.588264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-00f24c39-e28c-4253-ae76-737acc90eadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:46.620123 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1391/2796] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:46 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:46.621627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad3d02-865f-43ce-80d7-8be66a9e7ad1 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:46.623536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-3fad3d02-865f-43ce-80d7-8be66a9e7ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:46.638191 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad3d02-865f-43ce-80d7-8be66a9e7ad1 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:46.687552 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1406/2797] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:46.701272 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f24c39-e28c-4253-ae76-737acc90eadc None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:46.703402 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-00f24c39-e28c-4253-ae76-737acc90eadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:46.716936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd09d68-cb5b-4f11-b9ab-c68b648e97bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:46.717906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd09d68-cb5b-4f11-b9ab-c68b648e97bc admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:46.718265 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd09d68-cb5b-4f11-b9ab-c68b648e97bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:46.718723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd09d68-cb5b-4f11-b9ab-c68b648e97bc admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:46.719614 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd09d68-cb5b-4f11-b9ab-c68b648e97bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:46.721632 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd09d68-cb5b-4f11-b9ab-c68b648e97bc admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:46.735529 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1392/2798] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:46.740891 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd09d68-cb5b-4f11-b9ab-c68b648e97bc admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:46.753108 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd09d68-cb5b-4f11-b9ab-c68b648e97bc admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:46.759834 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fd432-6ee7-48db-b9fd-e7dfe383fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:46.760909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd432-6ee7-48db-b9fd-e7dfe383fb9a admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:46.761416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd432-6ee7-48db-b9fd-e7dfe383fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:46.761935 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fd432-6ee7-48db-b9fd-e7dfe383fb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:46.763300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fd432-6ee7-48db-b9fd-e7dfe383fb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:46.766467 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fd432-6ee7-48db-b9fd-e7dfe383fb9a admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:46.778492 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f24c39-e28c-4253-ae76-737acc90eadc None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:46.785060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18455ef-5949-4e86-b036-66b6fd8ec0fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:46.790798 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18455ef-5949-4e86-b036-66b6fd8ec0fa service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:46.791029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1393/2799] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:46.791197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18455ef-5949-4e86-b036-66b6fd8ec0fa service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:46.791197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18455ef-5949-4e86-b036-66b6fd8ec0fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:46.793205 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fd432-6ee7-48db-b9fd-e7dfe383fb9a admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:46.802685 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18455ef-5949-4e86-b036-66b6fd8ec0fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:46.804921 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18455ef-5949-4e86-b036-66b6fd8ec0fa service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:46.810193 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fd432-6ee7-48db-b9fd-e7dfe383fb9a admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:46.817684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09c76b-8814-43f0-9c02-3af77b6bd938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:46.819162 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09c76b-8814-43f0-9c02-3af77b6bd938 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:46.819630 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09c76b-8814-43f0-9c02-3af77b6bd938 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:46.820091 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09c76b-8814-43f0-9c02-3af77b6bd938 admin admin] PATH_INFO: `/v3/projects/d05f0051f872466da63ebef494ca8ec3/users/909f765f1d0640678df7448a4f15fdaf/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:46.823749 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1407/2800] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:46.852168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09c76b-8814-43f0-9c02-3af77b6bd938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05f0051f872466da63ebef494ca8ec3, user_id=909f765f1d0640678df7448a4f15fdaf, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:46.852168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09c76b-8814-43f0-9c02-3af77b6bd938 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:46.905867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:46.943627 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1394/2801] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:46 2022] PUT /identity/v3/projects/d05f0051f872466da63ebef494ca8ec3/users/909f765f1d0640678df7448a4f15fdaf/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:46.954638 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb276e5-adf8-4a49-ab2b-dcf3c4c4b732 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:46.955565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb276e5-adf8-4a49-ab2b-dcf3c4c4b732 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:46.955565 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb276e5-adf8-4a49-ab2b-dcf3c4c4b732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:46.992417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-3fb276e5-adf8-4a49-ab2b-dcf3c4c4b732 None None] MFA Rules not processed for user `909f765f1d0640678df7448a4f15fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:46.995249 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3fb276e5-adf8-4a49-ab2b-dcf3c4c4b732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:47.041292 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:47.068354 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1408/2802] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:47.073156 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09c76b-8814-43f0-9c02-3af77b6bd938 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:47.143492 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09c76b-8814-43f0-9c02-3af77b6bd938 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:47.149562 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9362a6-1bd1-4f56-a2e0-a85a61779d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:47.150674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9362a6-1bd1-4f56-a2e0-a85a61779d34 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:47.151046 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9362a6-1bd1-4f56-a2e0-a85a61779d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:47.151442 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9362a6-1bd1-4f56-a2e0-a85a61779d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:47.152391 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9362a6-1bd1-4f56-a2e0-a85a61779d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:47.154682 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9362a6-1bd1-4f56-a2e0-a85a61779d34 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:47.262374 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1395/2803] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:47 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:47.266652 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb276e5-adf8-4a49-ab2b-dcf3c4c4b732 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:47.280219 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb276e5-adf8-4a49-ab2b-dcf3c4c4b732 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:47.351298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:47.358422 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb19ed-b3fc-4bba-a420-982e2472582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:47.359264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb19ed-b3fc-4bba-a420-982e2472582a admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:47.359692 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb19ed-b3fc-4bba-a420-982e2472582a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:47.360096 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb19ed-b3fc-4bba-a420-982e2472582a admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:47.361236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb19ed-b3fc-4bba-a420-982e2472582a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:47.363707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb19ed-b3fc-4bba-a420-982e2472582a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:47.412360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9362a6-1bd1-4f56-a2e0-a85a61779d34 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:47.415714 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cd9362a6-1bd1-4f56-a2e0-a85a61779d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:47.444813 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9362a6-1bd1-4f56-a2e0-a85a61779d34 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:47.454669 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:47.456211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:47.456684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:47.457127 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac admin admin] PATH_INFO: `/v3/projects/6861322f5c1f4dedbd165087c48a0936` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:47.459959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6861322f5c1f4dedbd165087c48a0936)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:47.464586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:47.506236 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1409/2804] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:47 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:47.511039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb19ed-b3fc-4bba-a420-982e2472582a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:47.522156 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb19ed-b3fc-4bba-a420-982e2472582a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:47.529309 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d949093-f672-451e-bff3-b2a5bf6406f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:47.529523 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:DELETE=11,keystone:SELECT=84,keystone:INSERT=5 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:47.530532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949093-f672-451e-bff3-b2a5bf6406f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:47.530962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949093-f672-451e-bff3-b2a5bf6406f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:47.531456 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949093-f672-451e-bff3-b2a5bf6406f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:47.532934 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d949093-f672-451e-bff3-b2a5bf6406f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:47.535769 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d949093-f672-451e-bff3-b2a5bf6406f6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:47.547251 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1410/2805] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:47.551699 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d949093-f672-451e-bff3-b2a5bf6406f6 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:47.562473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d949093-f672-451e-bff3-b2a5bf6406f6 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:47.568761 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cb644-0b6d-4690-ba97-3dbc3dfd18ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:47.569864 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cb644-0b6d-4690-ba97-3dbc3dfd18ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:47.570315 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cb644-0b6d-4690-ba97-3dbc3dfd18ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:47.570831 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cb644-0b6d-4690-ba97-3dbc3dfd18ce admin admin] PATH_INFO: `/v3/projects/ad40f7cbd58e4a5db915d151476ed1d7/users/56b5b076b2da485f9de841c51ccca3df/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:47.594502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cb644-0b6d-4690-ba97-3dbc3dfd18ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad40f7cbd58e4a5db915d151476ed1d7, user_id=56b5b076b2da485f9de841c51ccca3df, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:47.597621 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cb644-0b6d-4690-ba97-3dbc3dfd18ce admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:47.606788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6861322f5c1f4dedbd165087c48a0936', 'request_id': 'req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:47.687677 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1411/2806] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:47 2022] PUT /identity/v3/projects/ad40f7cbd58e4a5db915d151476ed1d7/users/56b5b076b2da485f9de841c51ccca3df/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:47.692413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cb644-0b6d-4690-ba97-3dbc3dfd18ce admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:47.705592 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6861322f5c1f4dedbd165087c48a0936', 'request_id': 'req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:47.719392 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6861322f5c1f4dedbd165087c48a0936', 'request_id': 'req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:47.742945 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac admin admin] The token cache is being invalidate because project 6861322f5c1f4dedbd165087c48a0936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:47.743411 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:47.752905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-b3d45a1d-abf2-45b9-85b5-30b1dab31dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:47.752905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1396/2807] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:47 2022] DELETE /identity/v3/projects/6861322f5c1f4dedbd165087c48a0936 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:47.756930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b272d4b-6971-41aa-95dd-2a9df7297c48 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:47.756930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b272d4b-6971-41aa-95dd-2a9df7297c48 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:47.758222 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b272d4b-6971-41aa-95dd-2a9df7297c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:47.791520 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cb644-0b6d-4690-ba97-3dbc3dfd18ce admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:47.792659 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2b272d4b-6971-41aa-95dd-2a9df7297c48 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:47.794300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2b272d4b-6971-41aa-95dd-2a9df7297c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:47.800361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428efde2-ac0a-401e-aa83-3381435e54ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:47.801557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428efde2-ac0a-401e-aa83-3381435e54ce admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:47.802074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428efde2-ac0a-401e-aa83-3381435e54ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:47.802567 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428efde2-ac0a-401e-aa83-3381435e54ce admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:47.804151 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428efde2-ac0a-401e-aa83-3381435e54ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:47.808667 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428efde2-ac0a-401e-aa83-3381435e54ce admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:47.812561 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1397/2808] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:47.836206 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1412/2809] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:47.838847 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b272d4b-6971-41aa-95dd-2a9df7297c48 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:47.841350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2b272d4b-6971-41aa-95dd-2a9df7297c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:47.866817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b272d4b-6971-41aa-95dd-2a9df7297c48 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:47.874130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcafe8-55c0-4a72-8751-d3e8453a31a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:47.875115 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcafe8-55c0-4a72-8751-d3e8453a31a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:47.879875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcafe8-55c0-4a72-8751-d3e8453a31a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:47.879875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcafe8-55c0-4a72-8751-d3e8453a31a6 admin admin] PATH_INFO: `/v3/projects/ad40f7cbd58e4a5db915d151476ed1d7/users/56b5b076b2da485f9de841c51ccca3df/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:47.879875 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcafe8-55c0-4a72-8751-d3e8453a31a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad40f7cbd58e4a5db915d151476ed1d7, user_id=56b5b076b2da485f9de841c51ccca3df, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:47.882286 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcafe8-55c0-4a72-8751-d3e8453a31a6 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:47.893803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5f150-e8cd-4668-bf22-88d2cdf8c0de None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:47.894237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5f150-e8cd-4668-bf22-88d2cdf8c0de None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:47.894629 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5f150-e8cd-4668-bf22-88d2cdf8c0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:47.901131 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1398/2810] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:47 2022] PUT /identity/v3/projects/ad40f7cbd58e4a5db915d151476ed1d7/users/56b5b076b2da485f9de841c51ccca3df/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:47.914519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90fbd3-0f43-4dc8-9866-919ab6771831 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:47.914845 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90fbd3-0f43-4dc8-9866-919ab6771831 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:47.915157 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90fbd3-0f43-4dc8-9866-919ab6771831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:47.921219 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-1ba5f150-e8cd-4668-bf22-88d2cdf8c0de None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:47.923059 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-1ba5f150-e8cd-4668-bf22-88d2cdf8c0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:47.947859 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7d90fbd3-0f43-4dc8-9866-919ab6771831 None None] MFA Rules not processed for user `56b5b076b2da485f9de841c51ccca3df`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:47.949112 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7d90fbd3-0f43-4dc8-9866-919ab6771831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:48.015630 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1413/2811] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:48.019973 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5f150-e8cd-4668-bf22-88d2cdf8c0de None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:48.030812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5f150-e8cd-4668-bf22-88d2cdf8c0de None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:48.035730 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1399/2812] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:48.037006 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97eaee6-6b5b-4d91-b7e5-76e0524e9a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:48.037904 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97eaee6-6b5b-4d91-b7e5-76e0524e9a10 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:48.038341 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97eaee6-6b5b-4d91-b7e5-76e0524e9a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:48.038810 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97eaee6-6b5b-4d91-b7e5-76e0524e9a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:48.040053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97eaee6-6b5b-4d91-b7e5-76e0524e9a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:48.041060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97eaee6-6b5b-4d91-b7e5-76e0524e9a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:48.043971 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97eaee6-6b5b-4d91-b7e5-76e0524e9a10 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:48.051882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90fbd3-0f43-4dc8-9866-919ab6771831 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:48.053445 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7d90fbd3-0f43-4dc8-9866-919ab6771831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:48.065490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1414/2813] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:07:48.073766 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97eaee6-6b5b-4d91-b7e5-76e0524e9a10 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:48.090430 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97eaee6-6b5b-4d91-b7e5-76e0524e9a10 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:48.097940 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7eb29-b965-4512-addb-e12f41a8eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:48.099035 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7eb29-b965-4512-addb-e12f41a8eb18 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:48.099514 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7eb29-b965-4512-addb-e12f41a8eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:48.099998 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7eb29-b965-4512-addb-e12f41a8eb18 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:48.101285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7eb29-b965-4512-addb-e12f41a8eb18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:48.105393 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7eb29-b965-4512-addb-e12f41a8eb18 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:48.138228 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90fbd3-0f43-4dc8-9866-919ab6771831 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:48.142491 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcba76-f3fd-4477-bc66-456c7ef1354d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:48.143275 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcba76-f3fd-4477-bc66-456c7ef1354d service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:48.143484 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcba76-f3fd-4477-bc66-456c7ef1354d service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:48.143765 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcba76-f3fd-4477-bc66-456c7ef1354d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:48.154058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcba76-f3fd-4477-bc66-456c7ef1354d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:48.156096 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcba76-f3fd-4477-bc66-456c7ef1354d service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:48.167528 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1400/2814] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:48.275563 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1415/2815] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:48 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:48.283905 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcba76-f3fd-4477-bc66-456c7ef1354d service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:48.302170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcba76-f3fd-4477-bc66-456c7ef1354d service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:48.320169 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7eb29-b965-4512-addb-e12f41a8eb18 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:48.410469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940d28e-47cb-482d-9da4-0105ae51c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:48.411791 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940d28e-47cb-482d-9da4-0105ae51c632 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:48.412280 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940d28e-47cb-482d-9da4-0105ae51c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:48.412927 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940d28e-47cb-482d-9da4-0105ae51c632 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:48.414226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940d28e-47cb-482d-9da4-0105ae51c632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:48.418380 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940d28e-47cb-482d-9da4-0105ae51c632 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:48.419669 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:48.429892 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7eb29-b965-4512-addb-e12f41a8eb18 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:48.434998 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cceeab-bd54-472b-a786-a42fd115fdba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:48.436430 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cceeab-bd54-472b-a786-a42fd115fdba service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:48.436884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cceeab-bd54-472b-a786-a42fd115fdba service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:48.437421 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cceeab-bd54-472b-a786-a42fd115fdba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:48.440297 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-22cceeab-bd54-472b-a786-a42fd115fdba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:48.459949 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:48.525640 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1401/2816] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:48 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:48.526054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cceeab-bd54-472b-a786-a42fd115fdba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:48.527366 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940d28e-47cb-482d-9da4-0105ae51c632 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:48.528765 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cceeab-bd54-472b-a786-a42fd115fdba service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:48.539944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940d28e-47cb-482d-9da4-0105ae51c632 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:48.544269 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1416/2817] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:48.547130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe2776-b8b8-4b22-903c-f88ab4a7efff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:48.548255 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe2776-b8b8-4b22-903c-f88ab4a7efff admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:48.548737 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe2776-b8b8-4b22-903c-f88ab4a7efff admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:48.549179 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe2776-b8b8-4b22-903c-f88ab4a7efff admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:48.550536 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe2776-b8b8-4b22-903c-f88ab4a7efff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:48.553350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe2776-b8b8-4b22-903c-f88ab4a7efff admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:48.572487 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1402/2818] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:48.581045 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cceeab-bd54-472b-a786-a42fd115fdba service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:48.594743 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cceeab-bd54-472b-a786-a42fd115fdba service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:48.600905 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879ca17-0423-46dd-85ad-8af2969b5740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:48.601814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879ca17-0423-46dd-85ad-8af2969b5740 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:48.602190 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879ca17-0423-46dd-85ad-8af2969b5740 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:48.602582 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879ca17-0423-46dd-85ad-8af2969b5740 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:48.603416 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879ca17-0423-46dd-85ad-8af2969b5740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:48.605201 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879ca17-0423-46dd-85ad-8af2969b5740 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:48.628290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1417/2819] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:48.628469 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe2776-b8b8-4b22-903c-f88ab4a7efff admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:48.642223 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe2776-b8b8-4b22-903c-f88ab4a7efff admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:48.650407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e0528-8451-4f34-8350-d6f4a695b5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:48.652004 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e0528-8451-4f34-8350-d6f4a695b5c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:48.652528 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e0528-8451-4f34-8350-d6f4a695b5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:48.652985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e0528-8451-4f34-8350-d6f4a695b5c2 admin admin] PATH_INFO: `/v3/projects/553f14dfbb2d45cd99e10aac059cb0a5/users/17c2b252e36847f8b5c935e2a3582041/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:48.682358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e0528-8451-4f34-8350-d6f4a695b5c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=553f14dfbb2d45cd99e10aac059cb0a5, user_id=17c2b252e36847f8b5c935e2a3582041, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:48.687968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e0528-8451-4f34-8350-d6f4a695b5c2 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:48.710438 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:48.776344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:48.783585 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1403/2820] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:48 2022] PUT /identity/v3/projects/553f14dfbb2d45cd99e10aac059cb0a5/users/17c2b252e36847f8b5c935e2a3582041/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:48.795074 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1034-1de8-4e30-b7c3-1d161ed9c1f5 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:48.795426 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1034-1de8-4e30-b7c3-1d161ed9c1f5 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:48.795814 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1034-1de8-4e30-b7c3-1d161ed9c1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:48.832679 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-b57e1034-1de8-4e30-b7c3-1d161ed9c1f5 None None] MFA Rules not processed for user `17c2b252e36847f8b5c935e2a3582041`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:48.834336 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-b57e1034-1de8-4e30-b7c3-1d161ed9c1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:48.918409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1418/2821] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:48.967030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e0528-8451-4f34-8350-d6f4a695b5c2 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:48.969533 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-bd2e0528-8451-4f34-8350-d6f4a695b5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:49.057506 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e0528-8451-4f34-8350-d6f4a695b5c2 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:49.061618 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a989c8-772e-4191-b024-d40f7e2e5aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:49.062298 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a989c8-772e-4191-b024-d40f7e2e5aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:49.062586 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a989c8-772e-4191-b024-d40f7e2e5aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:49.062866 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a989c8-772e-4191-b024-d40f7e2e5aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:49.075558 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a989c8-772e-4191-b024-d40f7e2e5aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:49.077021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a989c8-772e-4191-b024-d40f7e2e5aa5 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:49.088915 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1404/2822] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:49.120545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e1034-1de8-4e30-b7c3-1d161ed9c1f5 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:49.202707 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e1034-1de8-4e30-b7c3-1d161ed9c1f5 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:49.207920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:49.208823 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:49.209106 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:49.209413 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] PATH_INFO: `/v3/users/17c2b252e36847f8b5c935e2a3582041` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:49.210808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c2b252e36847f8b5c935e2a3582041)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:49.213333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:49.231835 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=100 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:49.470592 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c2b252e36847f8b5c935e2a3582041'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:49.494943 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:49.560583 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c2b252e36847f8b5c935e2a3582041'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:49.575716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c2b252e36847f8b5c935e2a3582041'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:49.576605 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c2b252e36847f8b5c935e2a3582041'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:49.577636 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c2b252e36847f8b5c935e2a3582041'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:49.606941 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1419/2823] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:49 2022] DELETE /identity/v3/users/17c2b252e36847f8b5c935e2a3582041 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:49.612880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a5efe-c853-4bf7-a67e-9546b38abab1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:49.613226 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a5efe-c853-4bf7-a67e-9546b38abab1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:49.613646 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a5efe-c853-4bf7-a67e-9546b38abab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:49.635603 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-038a5efe-c853-4bf7-a67e-9546b38abab1 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:49.640086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-038a5efe-c853-4bf7-a67e-9546b38abab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:49.729618 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1405/2824] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:49.741602 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:49.743774 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:49.827250 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24170565-f29f-4d40-9daf-a03fa962f858 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:49.831305 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d63bf-8d68-44e1-a6e2-0dacd641827c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:49.831979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d63bf-8d68-44e1-a6e2-0dacd641827c service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:49.832264 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d63bf-8d68-44e1-a6e2-0dacd641827c service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:49.832533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d63bf-8d68-44e1-a6e2-0dacd641827c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:49.844194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d63bf-8d68-44e1-a6e2-0dacd641827c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:49.846296 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d63bf-8d68-44e1-a6e2-0dacd641827c service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:49.858439 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1420/2825] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:50.004497 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a5efe-c853-4bf7-a67e-9546b38abab1 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:50.005970 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-038a5efe-c853-4bf7-a67e-9546b38abab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:50.018239 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a5efe-c853-4bf7-a67e-9546b38abab1 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:50.023936 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:50.025979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:50.025979 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:50.026235 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] PATH_INFO: `/v3/users/0ff2fbdb9c0f479497942aebf8989a20` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:50.027674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff2fbdb9c0f479497942aebf8989a20)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:50.029958 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:50.318448 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff2fbdb9c0f479497942aebf8989a20'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.394032 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff2fbdb9c0f479497942aebf8989a20'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.395077 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff2fbdb9c0f479497942aebf8989a20'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.405957 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff2fbdb9c0f479497942aebf8989a20'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.406740 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff2fbdb9c0f479497942aebf8989a20'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.439186 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1406/2826] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:50 2022] DELETE /identity/v3/users/0ff2fbdb9c0f479497942aebf8989a20 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:50.445088 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3b04-c486-4aad-b011-b63c68433e94 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:50.446343 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3b04-c486-4aad-b011-b63c68433e94 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:50.446840 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3b04-c486-4aad-b011-b63c68433e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:50.470284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-4bbe3b04-c486-4aad-b011-b63c68433e94 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:50.484573 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4bbe3b04-c486-4aad-b011-b63c68433e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:50.573060 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1421/2827] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:50.573546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:50.575246 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:50.586672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe3b04-c486-4aad-b011-b63c68433e94 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:50.599467 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-4bbe3b04-c486-4aad-b011-b63c68433e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:50.624030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320491a-12d4-43e6-bf47-f3861aba2cff admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:50.634269 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:50.638100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:50.638477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:50.638670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b admin admin] PATH_INFO: `/v3/projects/553f14dfbb2d45cd99e10aac059cb0a5` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:50.642299 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=553f14dfbb2d45cd99e10aac059cb0a5)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:50.646933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:50.656604 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:50.666817 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:50.694519 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe3b04-c486-4aad-b011-b63c68433e94 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:50.699753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97091b9e-cb23-4949-8edc-db09f516c930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:50.705820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97091b9e-cb23-4949-8edc-db09f516c930 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:50.705820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97091b9e-cb23-4949-8edc-db09f516c930 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:50.705820 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97091b9e-cb23-4949-8edc-db09f516c930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:50.713029 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97091b9e-cb23-4949-8edc-db09f516c930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:50.714927 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97091b9e-cb23-4949-8edc-db09f516c930 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:50.726560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1422/2828] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:50.820225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '553f14dfbb2d45cd99e10aac059cb0a5', 'request_id': 'req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.933258 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '553f14dfbb2d45cd99e10aac059cb0a5', 'request_id': 'req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.940394 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '553f14dfbb2d45cd99e10aac059cb0a5', 'request_id': 'req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.955858 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b admin admin] The token cache is being invalidate because project 553f14dfbb2d45cd99e10aac059cb0a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:50.956278 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.957502 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-38f46ad7-6e52-4be2-97e9-b08469ec5c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.960296 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1407/2829] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:50 2022] DELETE /identity/v3/projects/553f14dfbb2d45cd99e10aac059cb0a5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:51.391833 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97091b9e-cb23-4949-8edc-db09f516c930 service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:51.397224 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-97091b9e-cb23-4949-8edc-db09f516c930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:51.410217 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97091b9e-cb23-4949-8edc-db09f516c930 service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:51.492662 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1583a-eb80-4c32-89a8-5edba211f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:51.493675 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1583a-eb80-4c32-89a8-5edba211f14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:51.494037 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1583a-eb80-4c32-89a8-5edba211f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:51.494400 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1583a-eb80-4c32-89a8-5edba211f14b admin admin] PATH_INFO: `/v3/projects/e284a0e80e454de29363977940f7187a` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:51.495940 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1583a-eb80-4c32-89a8-5edba211f14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e284a0e80e454de29363977940f7187a)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:51.498275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1583a-eb80-4c32-89a8-5edba211f14b admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:51.640031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-daa1583a-eb80-4c32-89a8-5edba211f14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e284a0e80e454de29363977940f7187a', 'request_id': 'req-daa1583a-eb80-4c32-89a8-5edba211f14b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:51.738686 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-daa1583a-eb80-4c32-89a8-5edba211f14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e284a0e80e454de29363977940f7187a', 'request_id': 'req-daa1583a-eb80-4c32-89a8-5edba211f14b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:51.745923 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-daa1583a-eb80-4c32-89a8-5edba211f14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e284a0e80e454de29363977940f7187a', 'request_id': 'req-daa1583a-eb80-4c32-89a8-5edba211f14b'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:51.760119 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-daa1583a-eb80-4c32-89a8-5edba211f14b admin admin] The token cache is being invalidate because project e284a0e80e454de29363977940f7187a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:51.760463 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-daa1583a-eb80-4c32-89a8-5edba211f14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:51.763715 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-daa1583a-eb80-4c32-89a8-5edba211f14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:51.763715 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1423/2830] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:51 2022] DELETE /identity/v3/projects/e284a0e80e454de29363977940f7187a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:51.768464 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aa920-5e2c-444d-901d-8c2341b9f42c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:51.769080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aa920-5e2c-444d-901d-8c2341b9f42c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:51.769080 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aa920-5e2c-444d-901d-8c2341b9f42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:51.789784 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-476aa920-5e2c-444d-901d-8c2341b9f42c None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:51.801618 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-476aa920-5e2c-444d-901d-8c2341b9f42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:51.870906 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1408/2831] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:51.883548 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290297a-db91-42a9-8a9f-826ff446b474 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:51.884531 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290297a-db91-42a9-8a9f-826ff446b474 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:51.884920 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290297a-db91-42a9-8a9f-826ff446b474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:51.913867 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-3290297a-db91-42a9-8a9f-826ff446b474 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:51.917025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-3290297a-db91-42a9-8a9f-826ff446b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:51.929184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1424/2832] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:51.940246 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476aa920-5e2c-444d-901d-8c2341b9f42c None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:51.947452 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476aa920-5e2c-444d-901d-8c2341b9f42c None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:51.953141 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7febe-5c94-4580-86ef-770efc94d1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:51.953970 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7febe-5c94-4580-86ef-770efc94d1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:51.954253 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7febe-5c94-4580-86ef-770efc94d1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:51.954530 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7febe-5c94-4580-86ef-770efc94d1f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:51.955317 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7febe-5c94-4580-86ef-770efc94d1f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:51.960114 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7febe-5c94-4580-86ef-770efc94d1f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:51.963985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7febe-5c94-4580-86ef-770efc94d1f7 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:51.987281 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1409/2833] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:07:51.994239 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290297a-db91-42a9-8a9f-826ff446b474 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:52.006819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290297a-db91-42a9-8a9f-826ff446b474 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:52.012979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf4c4d-29f9-4c6f-9684-a3f9fff73de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:52.013731 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf4c4d-29f9-4c6f-9684-a3f9fff73de4 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:52.014078 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf4c4d-29f9-4c6f-9684-a3f9fff73de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:52.014367 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf4c4d-29f9-4c6f-9684-a3f9fff73de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:52.015160 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf4c4d-29f9-4c6f-9684-a3f9fff73de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:52.017228 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf4c4d-29f9-4c6f-9684-a3f9fff73de4 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:52.132622 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7febe-5c94-4580-86ef-770efc94d1f7 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:52.135048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-31f7febe-5c94-4580-86ef-770efc94d1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:52.152095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7febe-5c94-4580-86ef-770efc94d1f7 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:52.160093 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f7eeb-e784-4cc4-a5dc-5cb339878d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:52.161798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f7eeb-e784-4cc4-a5dc-5cb339878d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:52.162300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f7eeb-e784-4cc4-a5dc-5cb339878d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:52.162780 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f7eeb-e784-4cc4-a5dc-5cb339878d46 admin admin] PATH_INFO: `/v3/users/909f765f1d0640678df7448a4f15fdaf` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:52.165303 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f7eeb-e784-4cc4-a5dc-5cb339878d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=909f765f1d0640678df7448a4f15fdaf)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:52.168966 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f7eeb-e784-4cc4-a5dc-5cb339878d46 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:52.201342 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1425/2834] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:51 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:52.202508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf4c4d-29f9-4c6f-9684-a3f9fff73de4 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:52.255448 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:52.312110 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf4c4d-29f9-4c6f-9684-a3f9fff73de4 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:52.321100 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579a465-ae60-4d4e-9288-7ff7c182e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:52.322260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579a465-ae60-4d4e-9288-7ff7c182e42a admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:52.322939 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579a465-ae60-4d4e-9288-7ff7c182e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:52.323430 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579a465-ae60-4d4e-9288-7ff7c182e42a admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:52.324735 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579a465-ae60-4d4e-9288-7ff7c182e42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:52.327934 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579a465-ae60-4d4e-9288-7ff7c182e42a admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:52.459842 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8a2f7eeb-e784-4cc4-a5dc-5cb339878d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909f765f1d0640678df7448a4f15fdaf'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:52.490392 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1426/2835] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:52 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:52.498646 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579a465-ae60-4d4e-9288-7ff7c182e42a admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:52.517739 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579a465-ae60-4d4e-9288-7ff7c182e42a admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:52.526490 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d099fa3-b959-4da5-ba75-01f4168dbb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:52.534601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d099fa3-b959-4da5-ba75-01f4168dbb80 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:52.534601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d099fa3-b959-4da5-ba75-01f4168dbb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:52.534601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d099fa3-b959-4da5-ba75-01f4168dbb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:52.534601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d099fa3-b959-4da5-ba75-01f4168dbb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:52.534601 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d099fa3-b959-4da5-ba75-01f4168dbb80 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:52.555412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1427/2836] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:52.560578 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d099fa3-b959-4da5-ba75-01f4168dbb80 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:52.567566 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8a2f7eeb-e784-4cc4-a5dc-5cb339878d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909f765f1d0640678df7448a4f15fdaf'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:52.572014 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8a2f7eeb-e784-4cc4-a5dc-5cb339878d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909f765f1d0640678df7448a4f15fdaf'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:52.578928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d099fa3-b959-4da5-ba75-01f4168dbb80 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:52.581448 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8a2f7eeb-e784-4cc4-a5dc-5cb339878d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909f765f1d0640678df7448a4f15fdaf'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:52.582748 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8a2f7eeb-e784-4cc4-a5dc-5cb339878d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909f765f1d0640678df7448a4f15fdaf'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:52.590013 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c653b5-2db5-4470-bf0d-5819e3a92884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:52.591139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c653b5-2db5-4470-bf0d-5819e3a92884 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:52.591575 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c653b5-2db5-4470-bf0d-5819e3a92884 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:52.591887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c653b5-2db5-4470-bf0d-5819e3a92884 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:52.592651 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c653b5-2db5-4470-bf0d-5819e3a92884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:52.594370 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c653b5-2db5-4470-bf0d-5819e3a92884 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:52.606196 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1428/2837] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:52.611025 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c653b5-2db5-4470-bf0d-5819e3a92884 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:52.613589 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-04c653b5-2db5-4470-bf0d-5819e3a92884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:52.620600 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:52.628167 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c653b5-2db5-4470-bf0d-5819e3a92884 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:52.629977 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1410/2838] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:52 2022] DELETE /identity/v3/users/909f765f1d0640678df7448a4f15fdaf => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:52.636768 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca16908-6ad0-44e2-b798-99882e71fb41 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:52.638092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca16908-6ad0-44e2-b798-99882e71fb41 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:52.638708 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca16908-6ad0-44e2-b798-99882e71fb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:52.669206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-5ca16908-6ad0-44e2-b798-99882e71fb41 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:52.674074 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5ca16908-6ad0-44e2-b798-99882e71fb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:52.710863 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114e133-be07-451d-91e8-59fd483ddf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:52.711791 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114e133-be07-451d-91e8-59fd483ddf4d admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:52.712681 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114e133-be07-451d-91e8-59fd483ddf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:52.712958 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114e133-be07-451d-91e8-59fd483ddf4d admin admin] PATH_INFO: `/v3/projects/0b6800f92e7a44a38fc784007e17dae0/users/005bdfeb986945cdbe7851a7a508cdee/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:52.733124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114e133-be07-451d-91e8-59fd483ddf4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6800f92e7a44a38fc784007e17dae0, user_id=005bdfeb986945cdbe7851a7a508cdee, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:52.738139 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114e133-be07-451d-91e8-59fd483ddf4d admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:52.762267 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1411/2839] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:52.773400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca16908-6ad0-44e2-b798-99882e71fb41 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:52.775650 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5ca16908-6ad0-44e2-b798-99882e71fb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:52.815302 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1429/2840] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:52 2022] PUT /identity/v3/projects/0b6800f92e7a44a38fc784007e17dae0/users/005bdfeb986945cdbe7851a7a508cdee/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:52.826695 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa84a8-f5d2-4c76-b92b-d471b649fd4b None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:52.827115 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa84a8-f5d2-4c76-b92b-d471b649fd4b None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:52.827500 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa84a8-f5d2-4c76-b92b-d471b649fd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:52.859472 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-86fa84a8-f5d2-4c76-b92b-d471b649fd4b None None] MFA Rules not processed for user `005bdfeb986945cdbe7851a7a508cdee`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:52.860713 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-86fa84a8-f5d2-4c76-b92b-d471b649fd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:52.864710 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca16908-6ad0-44e2-b798-99882e71fb41 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:52.939359 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1430/2841] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:52.944545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa84a8-f5d2-4c76-b92b-d471b649fd4b None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:52.946409 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edc996-bbfc-4241-a2fb-16ef6a15bd73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:52.947767 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edc996-bbfc-4241-a2fb-16ef6a15bd73 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:52.948058 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edc996-bbfc-4241-a2fb-16ef6a15bd73 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:52.948340 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edc996-bbfc-4241-a2fb-16ef6a15bd73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:52.962805 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:53.031316 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edc996-bbfc-4241-a2fb-16ef6a15bd73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:53.035354 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa84a8-f5d2-4c76-b92b-d471b649fd4b None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:53.035888 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edc996-bbfc-4241-a2fb-16ef6a15bd73 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:53.041063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119728c-35f1-47ed-b763-ede9db010eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:53.041822 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119728c-35f1-47ed-b763-ede9db010eaf admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:53.042103 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119728c-35f1-47ed-b763-ede9db010eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:53.042378 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119728c-35f1-47ed-b763-ede9db010eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:53.043081 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119728c-35f1-47ed-b763-ede9db010eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:53.045052 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119728c-35f1-47ed-b763-ede9db010eaf admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:53.055211 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1412/2842] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:53.178148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1431/2843] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:52 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:53.184760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edc996-bbfc-4241-a2fb-16ef6a15bd73 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:53.195773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edc996-bbfc-4241-a2fb-16ef6a15bd73 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:53.244912 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:53.266916 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea827437-0c37-4a81-b8d4-6d3bc578b527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:53.267662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea827437-0c37-4a81-b8d4-6d3bc578b527 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:53.267919 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea827437-0c37-4a81-b8d4-6d3bc578b527 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:53.268201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea827437-0c37-4a81-b8d4-6d3bc578b527 admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:53.268922 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea827437-0c37-4a81-b8d4-6d3bc578b527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:53.271079 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea827437-0c37-4a81-b8d4-6d3bc578b527 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:53.375039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1413/2844] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:53 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:53.379708 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119728c-35f1-47ed-b763-ede9db010eaf admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:53.406194 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119728c-35f1-47ed-b763-ede9db010eaf admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:53.414448 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb98fa-5713-4001-a493-b8bff9ff7ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:53.416324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb98fa-5713-4001-a493-b8bff9ff7ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:53.416324 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb98fa-5713-4001-a493-b8bff9ff7ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:53.416754 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb98fa-5713-4001-a493-b8bff9ff7ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:53.418234 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb98fa-5713-4001-a493-b8bff9ff7ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:53.421414 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb98fa-5713-4001-a493-b8bff9ff7ae6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:53.449674 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1432/2845] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:53.455033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea827437-0c37-4a81-b8d4-6d3bc578b527 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:53.469147 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea827437-0c37-4a81-b8d4-6d3bc578b527 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:53.475213 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce9670-e896-4ab1-9ae4-06e268bceb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:53.475908 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce9670-e896-4ab1-9ae4-06e268bceb94 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:53.476210 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce9670-e896-4ab1-9ae4-06e268bceb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:53.476465 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce9670-e896-4ab1-9ae4-06e268bceb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:53.477271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce9670-e896-4ab1-9ae4-06e268bceb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:53.479667 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce9670-e896-4ab1-9ae4-06e268bceb94 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:53.492776 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1414/2846] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:53.498720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb98fa-5713-4001-a493-b8bff9ff7ae6 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:53.510237 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb98fa-5713-4001-a493-b8bff9ff7ae6 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:53.515620 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a85e0e-53f0-4987-9efe-08b67a32a0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:53.516634 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a85e0e-53f0-4987-9efe-08b67a32a0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:53.516963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a85e0e-53f0-4987-9efe-08b67a32a0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:53.517370 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a85e0e-53f0-4987-9efe-08b67a32a0d6 admin admin] PATH_INFO: `/v3/projects/4ce5e7e7aa4846f7a2c75e556d53aa27/users/d3da46f91e8748da8f6f15d9e0e67ecd/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:53.536723 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a85e0e-53f0-4987-9efe-08b67a32a0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce5e7e7aa4846f7a2c75e556d53aa27, user_id=d3da46f91e8748da8f6f15d9e0e67ecd, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:53.542289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a85e0e-53f0-4987-9efe-08b67a32a0d6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:53.577827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce9670-e896-4ab1-9ae4-06e268bceb94 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:53.580865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-54ce9670-e896-4ab1-9ae4-06e268bceb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:53.599639 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce9670-e896-4ab1-9ae4-06e268bceb94 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:53.606097 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:53.607200 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:53.607573 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:53.608030 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] PATH_INFO: `/v3/projects/d05f0051f872466da63ebef494ca8ec3` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:53.609788 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05f0051f872466da63ebef494ca8ec3)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:53.612480 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:53.689716 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1433/2847] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:53 2022] PUT /identity/v3/projects/4ce5e7e7aa4846f7a2c75e556d53aa27/users/d3da46f91e8748da8f6f15d9e0e67ecd/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:53.702532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cf955-2b2b-4a31-a590-36028d368449 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:53.702819 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cf955-2b2b-4a31-a590-36028d368449 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:53.703282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cf955-2b2b-4a31-a590-36028d368449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:53.734464 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-5b5cf955-2b2b-4a31-a590-36028d368449 None None] MFA Rules not processed for user `d3da46f91e8748da8f6f15d9e0e67ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:53.735742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-5b5cf955-2b2b-4a31-a590-36028d368449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:53.779391 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05f0051f872466da63ebef494ca8ec3', 'request_id': 'req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:53.813532 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1434/2848] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:53.818627 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cf955-2b2b-4a31-a590-36028d368449 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:53.890986 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05f0051f872466da63ebef494ca8ec3', 'request_id': 'req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:53.901959 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05f0051f872466da63ebef494ca8ec3', 'request_id': 'req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:53.920829 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] The token cache is being invalidate because project d05f0051f872466da63ebef494ca8ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:53.921782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:53.923275 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:53.924704 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1415/2849] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:53 2022] DELETE /identity/v3/projects/d05f0051f872466da63ebef494ca8ec3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:53.929144 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:53.930735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:53.934269 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:53.952865 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cf955-2b2b-4a31-a590-36028d368449 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:54.034718 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8e339-8dc5-460c-ac2c-67ec3f498b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:54.035634 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465b298-5e9b-4dc4-983b-3f9b7a742b4e admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:54.035946 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8e339-8dc5-460c-ac2c-67ec3f498b42 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:54.036412 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8e339-8dc5-460c-ac2c-67ec3f498b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:54.036872 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8e339-8dc5-460c-ac2c-67ec3f498b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:54.038158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8e339-8dc5-460c-ac2c-67ec3f498b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:54.040843 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8e339-8dc5-460c-ac2c-67ec3f498b42 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:54.044569 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410b658-9cdf-48ea-82cb-a5960b6acc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:54.046271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b658-9cdf-48ea-82cb-a5960b6acc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:54.046793 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b658-9cdf-48ea-82cb-a5960b6acc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:54.047295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b658-9cdf-48ea-82cb-a5960b6acc03 admin admin] PATH_INFO: `/v3/users/56b5b076b2da485f9de841c51ccca3df` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:54.049643 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410b658-9cdf-48ea-82cb-a5960b6acc03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b5b076b2da485f9de841c51ccca3df)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:54.053783 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410b658-9cdf-48ea-82cb-a5960b6acc03 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:54.084438 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:54.148064 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1435/2850] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:53 2022] POST /identity/v3/projects => generated 377 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:54.155252 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8e339-8dc5-460c-ac2c-67ec3f498b42 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:54.157587 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-91c8e339-8dc5-460c-ac2c-67ec3f498b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:54.239703 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8e339-8dc5-460c-ac2c-67ec3f498b42 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:54.247959 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec190c2f-e2f9-472f-9363-91202bac73bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:54.249184 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec190c2f-e2f9-472f-9363-91202bac73bf admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:54.249754 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec190c2f-e2f9-472f-9363-91202bac73bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:54.250398 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec190c2f-e2f9-472f-9363-91202bac73bf admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:54.251926 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec190c2f-e2f9-472f-9363-91202bac73bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:54.255812 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec190c2f-e2f9-472f-9363-91202bac73bf admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:54.319175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8410b658-9cdf-48ea-82cb-a5960b6acc03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b5b076b2da485f9de841c51ccca3df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:54.404458 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1436/2851] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:54 2022] POST /identity/v3/users => generated 295 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:54.409756 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec190c2f-e2f9-472f-9363-91202bac73bf admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:54.422702 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec190c2f-e2f9-472f-9363-91202bac73bf admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:54.426581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8410b658-9cdf-48ea-82cb-a5960b6acc03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b5b076b2da485f9de841c51ccca3df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:54.426581 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8410b658-9cdf-48ea-82cb-a5960b6acc03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b5b076b2da485f9de841c51ccca3df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:54.429208 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57900a8f-9566-4a48-b9f2-9050b42af278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:54.430113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57900a8f-9566-4a48-b9f2-9050b42af278 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:54.430572 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57900a8f-9566-4a48-b9f2-9050b42af278 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:54.431515 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57900a8f-9566-4a48-b9f2-9050b42af278 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:54.432805 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57900a8f-9566-4a48-b9f2-9050b42af278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:54.435021 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57900a8f-9566-4a48-b9f2-9050b42af278 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:54.436970 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8410b658-9cdf-48ea-82cb-a5960b6acc03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b5b076b2da485f9de841c51ccca3df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:54.437861 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8410b658-9cdf-48ea-82cb-a5960b6acc03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b5b076b2da485f9de841c51ccca3df'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:54.451326 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1437/2852] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:54.457934 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57900a8f-9566-4a48-b9f2-9050b42af278 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:54.460129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-57900a8f-9566-4a48-b9f2-9050b42af278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:54.469047 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1416/2853] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:07:53 2022] DELETE /identity/v3/users/56b5b076b2da485f9de841c51ccca3df => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:54.479962 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57900a8f-9566-4a48-b9f2-9050b42af278 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:54.569280 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c42ac9-928d-4c4f-9d9e-7a1920a86ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:54.571128 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42ac9-928d-4c4f-9d9e-7a1920a86ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:54.571737 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42ac9-928d-4c4f-9d9e-7a1920a86ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:54.572517 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42ac9-928d-4c4f-9d9e-7a1920a86ecd admin admin] PATH_INFO: `/v3/projects/3b7d38c03fe641d5a30143d97696f755/users/4e53c401a0c44541841bd63993624584/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:54.589488 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:54.599149 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c42ac9-928d-4c4f-9d9e-7a1920a86ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7d38c03fe641d5a30143d97696f755, user_id=4e53c401a0c44541841bd63993624584, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:54.602141 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c42ac9-928d-4c4f-9d9e-7a1920a86ecd admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:54.698616 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1438/2854] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:54 2022] PUT /identity/v3/projects/3b7d38c03fe641d5a30143d97696f755/users/4e53c401a0c44541841bd63993624584/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:54.704446 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410b658-9cdf-48ea-82cb-a5960b6acc03 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:54.718968 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410b658-9cdf-48ea-82cb-a5960b6acc03 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:54.802855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d13666-6eea-42a6-86a3-0e3d7f977d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:54.804012 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d13666-6eea-42a6-86a3-0e3d7f977d68 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:54.804707 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d13666-6eea-42a6-86a3-0e3d7f977d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:54.805750 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d13666-6eea-42a6-86a3-0e3d7f977d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:54.807244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d13666-6eea-42a6-86a3-0e3d7f977d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:54.810425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d13666-6eea-42a6-86a3-0e3d7f977d68 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:54.826446 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1417/2855] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:54.831030 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c42ac9-928d-4c4f-9d9e-7a1920a86ecd admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:54.843167 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c42ac9-928d-4c4f-9d9e-7a1920a86ecd admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:54.848113 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02039176-68b7-48cd-b295-01f6d4b74ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:54.849129 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02039176-68b7-48cd-b295-01f6d4b74ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:54.849518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02039176-68b7-48cd-b295-01f6d4b74ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:54.849859 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02039176-68b7-48cd-b295-01f6d4b74ea4 admin admin] PATH_INFO: `/v3/projects/3b7d38c03fe641d5a30143d97696f755/users/4e53c401a0c44541841bd63993624584/roles/d6267bb2c2ba44d59374878eafd62b49` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:54.852152 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02039176-68b7-48cd-b295-01f6d4b74ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7d38c03fe641d5a30143d97696f755, user_id=4e53c401a0c44541841bd63993624584, role_id=d6267bb2c2ba44d59374878eafd62b49)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:54.855550 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02039176-68b7-48cd-b295-01f6d4b74ea4 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:54.871853 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1439/2856] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:54 2022] PUT /identity/v3/projects/3b7d38c03fe641d5a30143d97696f755/users/4e53c401a0c44541841bd63993624584/roles/d6267bb2c2ba44d59374878eafd62b49 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:54.885773 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d14be-3201-4237-a8f7-5516ed00da19 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:54.886244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d14be-3201-4237-a8f7-5516ed00da19 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:54.886440 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d14be-3201-4237-a8f7-5516ed00da19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:54.936250 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-5b5d14be-3201-4237-a8f7-5516ed00da19 None None] MFA Rules not processed for user `4e53c401a0c44541841bd63993624584`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:54.938661 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5b5d14be-3201-4237-a8f7-5516ed00da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:55.026430 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02039176-68b7-48cd-b295-01f6d4b74ea4 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:55.053290 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-02039176-68b7-48cd-b295-01f6d4b74ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:55.061530 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1418/2857] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:55.080271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d14be-3201-4237-a8f7-5516ed00da19 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:55.082295 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5b5d14be-3201-4237-a8f7-5516ed00da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:55.100616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:55.152397 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02039176-68b7-48cd-b295-01f6d4b74ea4 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:55.158105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6753076-b927-4fd2-8eea-14967a956fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:55.158976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6753076-b927-4fd2-8eea-14967a956fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:55.159274 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6753076-b927-4fd2-8eea-14967a956fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:55.159708 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6753076-b927-4fd2-8eea-14967a956fa6 admin admin] PATH_INFO: `/v3/projects/ad40f7cbd58e4a5db915d151476ed1d7` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:55.161222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6753076-b927-4fd2-8eea-14967a956fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad40f7cbd58e4a5db915d151476ed1d7)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:55.163246 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6753076-b927-4fd2-8eea-14967a956fa6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:55.191135 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d14be-3201-4237-a8f7-5516ed00da19 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:55.197243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9832d8-20ec-4f4c-b772-8065b80331e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:55.198277 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9832d8-20ec-4f4c-b772-8065b80331e5 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:55.198684 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9832d8-20ec-4f4c-b772-8065b80331e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:55.199086 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9832d8-20ec-4f4c-b772-8065b80331e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:55.202236 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6f9832d8-20ec-4f4c-b772-8065b80331e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:55.278882 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9832d8-20ec-4f4c-b772-8065b80331e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:55.280507 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9832d8-20ec-4f4c-b772-8065b80331e5 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:55.291840 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1419/2858] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:55.293038 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9832d8-20ec-4f4c-b772-8065b80331e5 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:55.304283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6f9832d8-20ec-4f4c-b772-8065b80331e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:55.304823 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f6753076-b927-4fd2-8eea-14967a956fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad40f7cbd58e4a5db915d151476ed1d7', 'request_id': 'req-f6753076-b927-4fd2-8eea-14967a956fa6'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:55.408271 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9832d8-20ec-4f4c-b772-8065b80331e5 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:55.459855 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f6753076-b927-4fd2-8eea-14967a956fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad40f7cbd58e4a5db915d151476ed1d7', 'request_id': 'req-f6753076-b927-4fd2-8eea-14967a956fa6'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:55.470117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f6753076-b927-4fd2-8eea-14967a956fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad40f7cbd58e4a5db915d151476ed1d7', 'request_id': 'req-f6753076-b927-4fd2-8eea-14967a956fa6'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:55.478237 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052903d-b3d4-43f9-b170-a342f07b1d04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619d0b5afa094289808516486a5e3c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:55.479559 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052903d-b3d4-43f9-b170-a342f07b1d04 service placement] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:55.479944 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052903d-b3d4-43f9-b170-a342f07b1d04 service placement] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:55.480321 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052903d-b3d4-43f9-b170-a342f07b1d04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:55.482451 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f052903d-b3d4-43f9-b170-a342f07b1d04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:55.488158 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f6753076-b927-4fd2-8eea-14967a956fa6 admin admin] The token cache is being invalidate because project ad40f7cbd58e4a5db915d151476ed1d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:55.488593 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f6753076-b927-4fd2-8eea-14967a956fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:55.489582 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-f6753076-b927-4fd2-8eea-14967a956fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:55.491659 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1440/2859] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:07:55 2022] DELETE /identity/v3/projects/ad40f7cbd58e4a5db915d151476ed1d7 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:55.497747 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:55.500519 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052903d-b3d4-43f9-b170-a342f07b1d04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:55.536435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcdd23-30dd-4590-9f7b-b331e28c46ba None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:55.536435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcdd23-30dd-4590-9f7b-b331e28c46ba None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:55.536435 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcdd23-30dd-4590-9f7b-b331e28c46ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:55.536810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052903d-b3d4-43f9-b170-a342f07b1d04 service placement] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:55.536810 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1420/2860] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:55.537012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-6cfcdd23-30dd-4590-9f7b-b331e28c46ba None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:55.537012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-6cfcdd23-30dd-4590-9f7b-b331e28c46ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:55.593720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1441/2861] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:55.602194 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df5c74-362e-4c35-a469-140b398ed719 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:55.603011 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df5c74-362e-4c35-a469-140b398ed719 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:55.603309 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df5c74-362e-4c35-a469-140b398ed719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:55.625414 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a8df5c74-362e-4c35-a469-140b398ed719 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:55.628054 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a8df5c74-362e-4c35-a469-140b398ed719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:55.635608 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1421/2862] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:55.640199 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcdd23-30dd-4590-9f7b-b331e28c46ba None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:55.646493 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:55.651223 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcdd23-30dd-4590-9f7b-b331e28c46ba None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:55.656107 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdda75-ae1f-4ba6-9d57-376178ffe3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:55.656807 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdda75-ae1f-4ba6-9d57-376178ffe3be admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:55.657086 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdda75-ae1f-4ba6-9d57-376178ffe3be admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:55.657518 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdda75-ae1f-4ba6-9d57-376178ffe3be admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:55.658144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdda75-ae1f-4ba6-9d57-376178ffe3be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:55.658455 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdda75-ae1f-4ba6-9d57-376178ffe3be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:55.660102 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdda75-ae1f-4ba6-9d57-376178ffe3be admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:55.673039 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1442/2863] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:07:55.677805 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df5c74-362e-4c35-a469-140b398ed719 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:55.688580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df5c74-362e-4c35-a469-140b398ed719 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:55.696078 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9566af3-ad1d-4c46-8d4a-ccfac60fbc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:55.697797 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566af3-ad1d-4c46-8d4a-ccfac60fbc7d admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:55.698293 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566af3-ad1d-4c46-8d4a-ccfac60fbc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:55.698800 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566af3-ad1d-4c46-8d4a-ccfac60fbc7d admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:55.700118 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9566af3-ad1d-4c46-8d4a-ccfac60fbc7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:55.703553 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9566af3-ad1d-4c46-8d4a-ccfac60fbc7d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:55.812679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1422/2864] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:07:55 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:55.817607 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdda75-ae1f-4ba6-9d57-376178ffe3be admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:55.828950 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdda75-ae1f-4ba6-9d57-376178ffe3be admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:55.910614 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6789a7-e96c-4ee0-9028-5037ddb7d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:55.911509 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6789a7-e96c-4ee0-9028-5037ddb7d1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:55.911912 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6789a7-e96c-4ee0-9028-5037ddb7d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:55.912313 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6789a7-e96c-4ee0-9028-5037ddb7d1d6 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:55.913124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6789a7-e96c-4ee0-9028-5037ddb7d1d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:55.915956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6789a7-e96c-4ee0-9028-5037ddb7d1d6 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:56.060803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1443/2865] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:07:55 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:56.065098 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9566af3-ad1d-4c46-8d4a-ccfac60fbc7d admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:56.077505 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9566af3-ad1d-4c46-8d4a-ccfac60fbc7d admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:56.082602 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860eaf9-a0dd-4ae0-8648-fcaff8a23462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:56.083732 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860eaf9-a0dd-4ae0-8648-fcaff8a23462 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:56.084021 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860eaf9-a0dd-4ae0-8648-fcaff8a23462 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:56.084304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860eaf9-a0dd-4ae0-8648-fcaff8a23462 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:56.085055 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860eaf9-a0dd-4ae0-8648-fcaff8a23462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:56.086758 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860eaf9-a0dd-4ae0-8648-fcaff8a23462 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:56.101175 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1423/2866] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:56.104877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6789a7-e96c-4ee0-9028-5037ddb7d1d6 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:56.122582 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6789a7-e96c-4ee0-9028-5037ddb7d1d6 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:56.130117 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a20f5-1ffb-442b-8a2d-1657666efff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:56.131875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a20f5-1ffb-442b-8a2d-1657666efff9 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:56.131875 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a20f5-1ffb-442b-8a2d-1657666efff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:56.132231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a20f5-1ffb-442b-8a2d-1657666efff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:56.133561 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a20f5-1ffb-442b-8a2d-1657666efff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:56.137105 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a20f5-1ffb-442b-8a2d-1657666efff9 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:56.158333 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1444/2867] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:56.161601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860eaf9-a0dd-4ae0-8648-fcaff8a23462 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:56.175798 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860eaf9-a0dd-4ae0-8648-fcaff8a23462 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:56.183585 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b7f01-d6ea-43e1-9983-a1d3e7b7afd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:56.185102 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b7f01-d6ea-43e1-9983-a1d3e7b7afd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:56.185623 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b7f01-d6ea-43e1-9983-a1d3e7b7afd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:56.186092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b7f01-d6ea-43e1-9983-a1d3e7b7afd6 admin admin] PATH_INFO: `/v3/projects/50ec2ea8cf604fadb48b8be54eb62c5f/users/217919f7d98646a2928681bd92618aa7/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:56.213577 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b7f01-d6ea-43e1-9983-a1d3e7b7afd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ec2ea8cf604fadb48b8be54eb62c5f, user_id=217919f7d98646a2928681bd92618aa7, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:56.219151 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b7f01-d6ea-43e1-9983-a1d3e7b7afd6 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:56.325942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1424/2868] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:07:56 2022] PUT /identity/v3/projects/50ec2ea8cf604fadb48b8be54eb62c5f/users/217919f7d98646a2928681bd92618aa7/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:56.334591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c83db-cf1e-46e2-84ef-349210cf23f3 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:56.335084 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c83db-cf1e-46e2-84ef-349210cf23f3 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:56.335516 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c83db-cf1e-46e2-84ef-349210cf23f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:56.359847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-227c83db-cf1e-46e2-84ef-349210cf23f3 None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:56.361765 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-227c83db-cf1e-46e2-84ef-349210cf23f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:56.434952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1445/2869] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:56.445575 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b7f01-d6ea-43e1-9983-a1d3e7b7afd6 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:56.448761 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f62b7f01-d6ea-43e1-9983-a1d3e7b7afd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:56.534783 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b7f01-d6ea-43e1-9983-a1d3e7b7afd6 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:56.539017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e585a-0c46-4b9c-8727-200f7fea7f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:56.539855 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e585a-0c46-4b9c-8727-200f7fea7f65 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:56.540716 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e585a-0c46-4b9c-8727-200f7fea7f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:56.541125 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e585a-0c46-4b9c-8727-200f7fea7f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:56.551985 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e585a-0c46-4b9c-8727-200f7fea7f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:56.553543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e585a-0c46-4b9c-8727-200f7fea7f65 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:56.565522 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1425/2870] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:57.657473 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c83db-cf1e-46e2-84ef-349210cf23f3 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:57.659738 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-227c83db-cf1e-46e2-84ef-349210cf23f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:57.770053 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c83db-cf1e-46e2-84ef-349210cf23f3 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:57.776912 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c8397-5d0a-463a-8dba-87f8d15ba0ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:57.778091 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c8397-5d0a-463a-8dba-87f8d15ba0ec service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:57.778612 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c8397-5d0a-463a-8dba-87f8d15ba0ec service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:57.779244 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c8397-5d0a-463a-8dba-87f8d15ba0ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:57.782348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d46c8397-5d0a-463a-8dba-87f8d15ba0ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:57.831591 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:57.896623 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c8397-5d0a-463a-8dba-87f8d15ba0ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:57.900261 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c8397-5d0a-463a-8dba-87f8d15ba0ec service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:57.918976 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1446/2871] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:58.059260 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d32cf-704e-436a-9b4c-8014419a3302 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:58.060104 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d32cf-704e-436a-9b4c-8014419a3302 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:58.060275 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d32cf-704e-436a-9b4c-8014419a3302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:58.097515 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-dc6d32cf-704e-436a-9b4c-8014419a3302 None None] MFA Rules not processed for user `217919f7d98646a2928681bd92618aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:58.099134 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-dc6d32cf-704e-436a-9b4c-8014419a3302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:58.220621 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1426/2872] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:58.237834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c8397-5d0a-463a-8dba-87f8d15ba0ec service cinder] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:58.240417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-d46c8397-5d0a-463a-8dba-87f8d15ba0ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:58.261856 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c8397-5d0a-463a-8dba-87f8d15ba0ec service cinder] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:58.267877 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ae084-bf1a-4b41-a64b-199620d71ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:58.269291 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ae084-bf1a-4b41-a64b-199620d71ffc service cinder] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:58.269832 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ae084-bf1a-4b41-a64b-199620d71ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:58.270340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ae084-bf1a-4b41-a64b-199620d71ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:58.285348 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ae084-bf1a-4b41-a64b-199620d71ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:58.287041 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ae084-bf1a-4b41-a64b-199620d71ffc service cinder] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:58.297866 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1447/2873] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:07:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:08:00.192743 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d32cf-704e-436a-9b4c-8014419a3302 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:00.204332 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d32cf-704e-436a-9b4c-8014419a3302 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:00.208670 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1d895-f10f-4728-b260-53378a6e8f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:00.210562 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1d895-f10f-4728-b260-53378a6e8f10 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:00.210562 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1d895-f10f-4728-b260-53378a6e8f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:00.210562 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1d895-f10f-4728-b260-53378a6e8f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:00.213797 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2bc1d895-f10f-4728-b260-53378a6e8f10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:00.242620 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:00.286193 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5a2c0-ebf9-407a-8461-664a959745b7 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:00.287001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5a2c0-ebf9-407a-8461-664a959745b7 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:00.287001 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5a2c0-ebf9-407a-8461-664a959745b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:00.305848 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-bff5a2c0-ebf9-407a-8461-664a959745b7 None None] MFA Rules not processed for user `217919f7d98646a2928681bd92618aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:00.312958 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-bff5a2c0-ebf9-407a-8461-664a959745b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:00.316676 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1d895-f10f-4728-b260-53378a6e8f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:00.319426 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1d895-f10f-4728-b260-53378a6e8f10 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:00.319956 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1448/2874] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:08:00.345567 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1427/2875] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:08:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:08:05.784051 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5a2c0-ebf9-407a-8461-664a959745b7 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:05.785560 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-bff5a2c0-ebf9-407a-8461-664a959745b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:05.800935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5a2c0-ebf9-407a-8461-664a959745b7 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:05.808222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:05.809112 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:05.809417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:05.809697 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] PATH_INFO: `/v3/users/005bdfeb986945cdbe7851a7a508cdee` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:05.810918 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=005bdfeb986945cdbe7851a7a508cdee)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:05.812847 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:06.039710 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '005bdfeb986945cdbe7851a7a508cdee'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:06.143886 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '005bdfeb986945cdbe7851a7a508cdee'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:06.151536 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '005bdfeb986945cdbe7851a7a508cdee'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:06.152183 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '005bdfeb986945cdbe7851a7a508cdee'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:06.152821 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '005bdfeb986945cdbe7851a7a508cdee'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:06.182590 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1449/2876] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:08:05 2022] DELETE /identity/v3/users/005bdfeb986945cdbe7851a7a508cdee => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:08:06.187787 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595307ad-d6a8-4db5-9033-92234e48ba0d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:06.188462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595307ad-d6a8-4db5-9033-92234e48ba0d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:06.188462 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595307ad-d6a8-4db5-9033-92234e48ba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:06.208561 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-595307ad-d6a8-4db5-9033-92234e48ba0d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:06.209831 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-595307ad-d6a8-4db5-9033-92234e48ba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:06.272132 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1428/2877] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:08:06.283728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:06.285285 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:06.353306 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae9934-e7a9-42dd-a0fd-150e09f86533 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:06.357186 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6664fc8-64b0-481e-9090-5c5d5ecc4548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:06.357903 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664fc8-64b0-481e-9090-5c5d5ecc4548 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:06.358189 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664fc8-64b0-481e-9090-5c5d5ecc4548 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:06.358487 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664fc8-64b0-481e-9090-5c5d5ecc4548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:06.368704 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6664fc8-64b0-481e-9090-5c5d5ecc4548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:06.370177 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6664fc8-64b0-481e-9090-5c5d5ecc4548 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:06.380568 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1450/2878] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:08:06.844432 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595307ad-d6a8-4db5-9033-92234e48ba0d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:06.845111 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-595307ad-d6a8-4db5-9033-92234e48ba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:06.857588 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595307ad-d6a8-4db5-9033-92234e48ba0d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:06.864601 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:06.867416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:06.867416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:06.867416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] PATH_INFO: `/v3/projects/0b6800f92e7a44a38fc784007e17dae0` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:06.867416 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6800f92e7a44a38fc784007e17dae0)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:06.870161 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:06.990487 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6800f92e7a44a38fc784007e17dae0', 'request_id': 'req-a418fadc-3654-4735-bef6-8c8d03d39e3b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:07.052799 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6800f92e7a44a38fc784007e17dae0', 'request_id': 'req-a418fadc-3654-4735-bef6-8c8d03d39e3b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:07.059903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6800f92e7a44a38fc784007e17dae0', 'request_id': 'req-a418fadc-3654-4735-bef6-8c8d03d39e3b'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:07.071129 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] The token cache is being invalidate because project 0b6800f92e7a44a38fc784007e17dae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:08:07.071411 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:07.072076 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:07.073675 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1429/2879] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:08:06 2022] DELETE /identity/v3/projects/0b6800f92e7a44a38fc784007e17dae0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:08:07.079417 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6664fc8-64b0-481e-9090-5c5d5ecc4548 service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:07.090304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6664fc8-64b0-481e-9090-5c5d5ecc4548 service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:07.108364 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:07.156722 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:07.157736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:07.161087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:07.161087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] PATH_INFO: `/v3/users/d3da46f91e8748da8f6f15d9e0e67ecd` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:07.161087 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3da46f91e8748da8f6f15d9e0e67ecd)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:07.161409 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:07.330255 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3da46f91e8748da8f6f15d9e0e67ecd'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:07.407075 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3da46f91e8748da8f6f15d9e0e67ecd'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:07.414845 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3da46f91e8748da8f6f15d9e0e67ecd'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:07.416133 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3da46f91e8748da8f6f15d9e0e67ecd'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:07.417083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3da46f91e8748da8f6f15d9e0e67ecd'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:07.434908 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1451/2880] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:08:07 2022] DELETE /identity/v3/users/d3da46f91e8748da8f6f15d9e0e67ecd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:08:07.854440 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:07.859903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:07.874780 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418fadc-3654-4735-bef6-8c8d03d39e3b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:07.920903 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:07.943065 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:07.943961 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:07.944244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:07.944521 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] PATH_INFO: `/v3/projects/4ce5e7e7aa4846f7a2c75e556d53aa27` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:07.946206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce5e7e7aa4846f7a2c75e556d53aa27)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:07.948951 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:08.161185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce5e7e7aa4846f7a2c75e556d53aa27', 'request_id': 'req-50fceeb4-a376-4889-8157-7914fbe5bf58'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:08.285358 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce5e7e7aa4846f7a2c75e556d53aa27', 'request_id': 'req-50fceeb4-a376-4889-8157-7914fbe5bf58'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:08.293984 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce5e7e7aa4846f7a2c75e556d53aa27', 'request_id': 'req-50fceeb4-a376-4889-8157-7914fbe5bf58'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:08.308273 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] The token cache is being invalidate because project 4ce5e7e7aa4846f7a2c75e556d53aa27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:08:08.308702 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:08.309662 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:08.311723 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1430/2881] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:08:07 2022] DELETE /identity/v3/projects/4ce5e7e7aa4846f7a2c75e556d53aa27 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:08:08.317062 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:08.318735 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:08.332304 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8dd0f-b5ff-46b4-bef5-ab5198e377f4 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:08.395571 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef23548-263e-4402-a38b-180b62734778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:08.396467 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef23548-263e-4402-a38b-180b62734778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:08.396755 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef23548-263e-4402-a38b-180b62734778 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:08.397034 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef23548-263e-4402-a38b-180b62734778 admin admin] PATH_INFO: `/v3/users/4e53c401a0c44541841bd63993624584` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:08.398278 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef23548-263e-4402-a38b-180b62734778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e53c401a0c44541841bd63993624584)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:08.400884 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef23548-263e-4402-a38b-180b62734778 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:08.599898 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:08.607024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-aef23548-263e-4402-a38b-180b62734778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e53c401a0c44541841bd63993624584'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:08.692700 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-aef23548-263e-4402-a38b-180b62734778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e53c401a0c44541841bd63993624584'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:08.701179 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-aef23548-263e-4402-a38b-180b62734778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e53c401a0c44541841bd63993624584'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:08.708205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-aef23548-263e-4402-a38b-180b62734778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e53c401a0c44541841bd63993624584'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:08.708205 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-aef23548-263e-4402-a38b-180b62734778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e53c401a0c44541841bd63993624584'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:08.722192 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1452/2882] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:08:08 2022] DELETE /identity/v3/users/4e53c401a0c44541841bd63993624584 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:08:09.308735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:09.311508 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:09.332148 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fceeb4-a376-4889-8157-7914fbe5bf58 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:09.419133 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35ec4b-0eb6-4440-932f-548728ba9d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:09.423930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35ec4b-0eb6-4440-932f-548728ba9d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:09.423930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35ec4b-0eb6-4440-932f-548728ba9d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:09.423930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35ec4b-0eb6-4440-932f-548728ba9d36 admin admin] PATH_INFO: `/v3/projects/3b7d38c03fe641d5a30143d97696f755` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:09.423930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35ec4b-0eb6-4440-932f-548728ba9d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7d38c03fe641d5a30143d97696f755)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:09.423930 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35ec4b-0eb6-4440-932f-548728ba9d36 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:09.527242 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8c35ec4b-0eb6-4440-932f-548728ba9d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7d38c03fe641d5a30143d97696f755', 'request_id': 'req-8c35ec4b-0eb6-4440-932f-548728ba9d36'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:09.599251 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8c35ec4b-0eb6-4440-932f-548728ba9d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7d38c03fe641d5a30143d97696f755', 'request_id': 'req-8c35ec4b-0eb6-4440-932f-548728ba9d36'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:09.606782 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8c35ec4b-0eb6-4440-932f-548728ba9d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7d38c03fe641d5a30143d97696f755', 'request_id': 'req-8c35ec4b-0eb6-4440-932f-548728ba9d36'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:09.619262 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8c35ec4b-0eb6-4440-932f-548728ba9d36 admin admin] The token cache is being invalidate because project 3b7d38c03fe641d5a30143d97696f755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:08:09.619546 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8c35ec4b-0eb6-4440-932f-548728ba9d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:09.620218 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-8c35ec4b-0eb6-4440-932f-548728ba9d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:09.622036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1431/2883] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:08:09 2022] DELETE /identity/v3/projects/3b7d38c03fe641d5a30143d97696f755 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:08:09.627799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60f96f-562c-4a17-8347-bca68e951eac None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:09.627799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60f96f-562c-4a17-8347-bca68e951eac None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:09.627799 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60f96f-562c-4a17-8347-bca68e951eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:09.646600 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-ab60f96f-562c-4a17-8347-bca68e951eac None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:09.647792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ab60f96f-562c-4a17-8347-bca68e951eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:09.715788 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1453/2884] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:08:09.723596 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232cc8-c8b4-47b3-81e9-25166504ba6d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:09.723885 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232cc8-c8b4-47b3-81e9-25166504ba6d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:09.724172 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232cc8-c8b4-47b3-81e9-25166504ba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:09.731142 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:09.744207 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-31232cc8-c8b4-47b3-81e9-25166504ba6d None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:09.745733 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-31232cc8-c8b4-47b3-81e9-25166504ba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:09.754064 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1432/2885] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:08:09.758598 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60f96f-562c-4a17-8347-bca68e951eac None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:09.769275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60f96f-562c-4a17-8347-bca68e951eac None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:09.773988 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806a9e4-abdf-4333-aaef-5c946c091f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:09.775197 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806a9e4-abdf-4333-aaef-5c946c091f32 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:09.778018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806a9e4-abdf-4333-aaef-5c946c091f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:09.778018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806a9e4-abdf-4333-aaef-5c946c091f32 admin admin] PATH_INFO: `/v3/domains` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:09.778018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806a9e4-abdf-4333-aaef-5c946c091f32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:08:09.778018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806a9e4-abdf-4333-aaef-5c946c091f32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:09.779020 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806a9e4-abdf-4333-aaef-5c946c091f32 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:09.792946 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1454/2886] 10.222.0.39 () {58 vars in 1152 bytes} [Tue May 31 21:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:08:09.800168 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31232cc8-c8b4-47b3-81e9-25166504ba6d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:09.811471 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31232cc8-c8b4-47b3-81e9-25166504ba6d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:09.817444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc1940-fbd3-48bb-a96f-029c74548abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:09.817444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc1940-fbd3-48bb-a96f-029c74548abc admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:09.817444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc1940-fbd3-48bb-a96f-029c74548abc admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:09.817444 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc1940-fbd3-48bb-a96f-029c74548abc admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:09.818101 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc1940-fbd3-48bb-a96f-029c74548abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:09.820034 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc1940-fbd3-48bb-a96f-029c74548abc admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:09.921942 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1433/2887] 10.222.0.39 () {60 vars in 1152 bytes} [Tue May 31 21:08:09 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:08:09.926024 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806a9e4-abdf-4333-aaef-5c946c091f32 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:09.936694 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806a9e4-abdf-4333-aaef-5c946c091f32 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:10.003460 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552c423-e41f-4029-8626-b6596234a8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:10.004148 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552c423-e41f-4029-8626-b6596234a8d8 admin admin] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:10.004429 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552c423-e41f-4029-8626-b6596234a8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:10.004763 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552c423-e41f-4029-8626-b6596234a8d8 admin admin] PATH_INFO: `/v3/users` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:10.005495 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552c423-e41f-4029-8626-b6596234a8d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:10.007618 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552c423-e41f-4029-8626-b6596234a8d8 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:10.165406 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1455/2888] 10.222.0.39 () {60 vars in 1143 bytes} [Tue May 31 21:08:09 2022] POST /identity/v3/users => generated 283 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:08:10.169455 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc1940-fbd3-48bb-a96f-029c74548abc admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:10.180266 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc1940-fbd3-48bb-a96f-029c74548abc admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:10.185320 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f012c66-b259-4238-9441-559f7b81b048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:10.186017 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f012c66-b259-4238-9441-559f7b81b048 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:10.186300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f012c66-b259-4238-9441-559f7b81b048 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:10.186580 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f012c66-b259-4238-9441-559f7b81b048 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:10.187305 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f012c66-b259-4238-9441-559f7b81b048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:10.188921 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f012c66-b259-4238-9441-559f7b81b048 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:10.200196 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1434/2889] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:08:10.203979 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552c423-e41f-4029-8626-b6596234a8d8 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:10.215083 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552c423-e41f-4029-8626-b6596234a8d8 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:10.219742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da0418-eade-4cde-a1c8-999cb4231e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:10.220406 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da0418-eade-4cde-a1c8-999cb4231e31 admin admin] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:10.220952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da0418-eade-4cde-a1c8-999cb4231e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:10.220952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da0418-eade-4cde-a1c8-999cb4231e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:10.221690 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da0418-eade-4cde-a1c8-999cb4231e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:10.223288 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da0418-eade-4cde-a1c8-999cb4231e31 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:10.234746 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1456/2890] 10.222.0.39 () {58 vars in 1121 bytes} [Tue May 31 21:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:08:10.238884 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f012c66-b259-4238-9441-559f7b81b048 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:10.250877 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f012c66-b259-4238-9441-559f7b81b048 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:10.255913 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046885fe-8086-4ebc-9993-01e9432d8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:10.256811 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046885fe-8086-4ebc-9993-01e9432d8ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:10.257090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046885fe-8086-4ebc-9993-01e9432d8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:10.257360 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046885fe-8086-4ebc-9993-01e9432d8ad5 admin admin] PATH_INFO: `/v3/projects/b78bc19ca06e414e9023ca4b72336e2e/users/e0ccb7d917644a5492c59874614f3801/roles/32086f06b98341f09220be9a203efcb7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:10.275436 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046885fe-8086-4ebc-9993-01e9432d8ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78bc19ca06e414e9023ca4b72336e2e, user_id=e0ccb7d917644a5492c59874614f3801, role_id=32086f06b98341f09220be9a203efcb7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:10.278201 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046885fe-8086-4ebc-9993-01e9432d8ad5 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:10.383207 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1435/2891] 10.222.0.39 () {60 vars in 1482 bytes} [Tue May 31 21:08:10 2022] PUT /identity/v3/projects/b78bc19ca06e414e9023ca4b72336e2e/users/e0ccb7d917644a5492c59874614f3801/roles/32086f06b98341f09220be9a203efcb7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:08:10.393952 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7553e4-c7b8-4fe2-9075-9933a219c514 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:10.394385 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7553e4-c7b8-4fe2-9075-9933a219c514 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:10.394672 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7553e4-c7b8-4fe2-9075-9933a219c514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:10.426927 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-ca7553e4-c7b8-4fe2-9075-9933a219c514 None None] MFA Rules not processed for user `e0ccb7d917644a5492c59874614f3801`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:10.428298 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-ca7553e4-c7b8-4fe2-9075-9933a219c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:10.441012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:10.503736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1457/2892] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:08:10.517344 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046885fe-8086-4ebc-9993-01e9432d8ad5 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:10.519612 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-046885fe-8086-4ebc-9993-01e9432d8ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:10.583681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046885fe-8086-4ebc-9993-01e9432d8ad5 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:10.588263 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdcfb6-4925-466e-940b-6ddf082c8729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfcecd035214e2181622eb6b30ddf62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:10.589304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdcfb6-4925-466e-940b-6ddf082c8729 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:10.589304 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdcfb6-4925-466e-940b-6ddf082c8729 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:10.589543 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdcfb6-4925-466e-940b-6ddf082c8729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:10.598900 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdcfb6-4925-466e-940b-6ddf082c8729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:10.600399 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdcfb6-4925-466e-940b-6ddf082c8729 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:10.610401 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1436/2893] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:08:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:08:20.595757 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=21 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:20.605774 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=52,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:24.193566 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c9c1e-18ed-4e7a-a300-3f8817b88294 None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:24.194179 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c9c1e-18ed-4e7a-a300-3f8817b88294 None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:24.194310 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c9c1e-18ed-4e7a-a300-3f8817b88294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:24.224042 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-c98c9c1e-18ed-4e7a-a300-3f8817b88294 None None] MFA Rules not processed for user `217919f7d98646a2928681bd92618aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:24.225499 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c98c9c1e-18ed-4e7a-a300-3f8817b88294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:24.332368 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1458/2894] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:08:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:08:34.320754 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=25 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:44.588528 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72364cc9-e89e-43c6-945f-6ef006466343 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:44.589020 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72364cc9-e89e-43c6-945f-6ef006466343 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:44.589130 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72364cc9-e89e-43c6-945f-6ef006466343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:44.608802 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-72364cc9-e89e-43c6-945f-6ef006466343 None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:44.610036 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-72364cc9-e89e-43c6-945f-6ef006466343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:44.672206 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1437/2895] 10.222.0.39 () {58 vars in 1009 bytes} [Tue May 31 21:08:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:08:44.875241 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c9c1e-18ed-4e7a-a300-3f8817b88294 None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:44.877018 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-c98c9c1e-18ed-4e7a-a300-3f8817b88294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:44.957260 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c9c1e-18ed-4e7a-a300-3f8817b88294 None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:44.962854 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf80071-5f7e-421d-9184-f5c84c51c916 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:44.963508 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf80071-5f7e-421d-9184-f5c84c51c916 service swift] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:44.963787 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf80071-5f7e-421d-9184-f5c84c51c916 service swift] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:44.964063 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf80071-5f7e-421d-9184-f5c84c51c916 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:44.972643 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf80071-5f7e-421d-9184-f5c84c51c916 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:44.974268 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf80071-5f7e-421d-9184-f5c84c51c916 service swift] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:44.983870 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1459/2896] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:08:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:08:45.359893 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72364cc9-e89e-43c6-945f-6ef006466343 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:45.448616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72364cc9-e89e-43c6-945f-6ef006466343 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:45.456995 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:45.459159 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:45.459679 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:45.460203 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] PATH_INFO: `/v3/users/e0ccb7d917644a5492c59874614f3801` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:45.462681 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ccb7d917644a5492c59874614f3801)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:45.464827 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:45.693359 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ccb7d917644a5492c59874614f3801'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:45.813326 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ccb7d917644a5492c59874614f3801'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:45.814070 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ccb7d917644a5492c59874614f3801'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:45.830887 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ccb7d917644a5492c59874614f3801'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:45.834113 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ccb7d917644a5492c59874614f3801'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:45.862407 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1438/2897] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:08:45 2022] DELETE /identity/v3/users/e0ccb7d917644a5492c59874614f3801 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:08:45.868127 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1b235-4452-49bf-a09c-db13f1f7b2cb None None] REQUEST_METHOD: `POST` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:45.869696 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1b235-4452-49bf-a09c-db13f1f7b2cb None None] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:45.870284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1b235-4452-49bf-a09c-db13f1f7b2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:45.903730 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.auth.core [None req-2dc1b235-4452-49bf-a09c-db13f1f7b2cb None None] MFA Rules not processed for user `d4d342095f994d388541563ef9df90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:45.905963 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2dc1b235-4452-49bf-a09c-db13f1f7b2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:46.006231 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1460/2898] 10.222.0.39 () {58 vars in 957 bytes} [Tue May 31 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:08:46.016771 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:46.018578 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:46.076027 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:46.139170 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12afe6-ff0a-48d7-a0a7-4ced8fe88b41 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:46.143092 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167242a-e584-4564-a041-e86b1134c574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:46.143965 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167242a-e584-4564-a041-e86b1134c574 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:46.144185 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167242a-e584-4564-a041-e86b1134c574 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:46.144296 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167242a-e584-4564-a041-e86b1134c574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:46.158400 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167242a-e584-4564-a041-e86b1134c574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:46.161933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167242a-e584-4564-a041-e86b1134c574 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:46.182658 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1439/2899] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:08:46.802907 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1b235-4452-49bf-a09c-db13f1f7b2cb None None] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:46.804472 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-2dc1b235-4452-49bf-a09c-db13f1f7b2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:46.821073 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1b235-4452-49bf-a09c-db13f1f7b2cb None None] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:46.828546 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:46.829948 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:46.830240 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:46.830803 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] PATH_INFO: `/v3/projects/b78bc19ca06e414e9023ca4b72336e2e` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:46.833068 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78bc19ca06e414e9023ca4b72336e2e)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:46.835502 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:47.057693 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78bc19ca06e414e9023ca4b72336e2e', 'request_id': 'req-a72bb5d3-94b0-4e19-b174-d931f804a1b9'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:47.172946 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78bc19ca06e414e9023ca4b72336e2e', 'request_id': 'req-a72bb5d3-94b0-4e19-b174-d931f804a1b9'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:47.186433 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78bc19ca06e414e9023ca4b72336e2e', 'request_id': 'req-a72bb5d3-94b0-4e19-b174-d931f804a1b9'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:47.201481 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] The token cache is being invalidate because project b78bc19ca06e414e9023ca4b72336e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:08:47.201829 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:47.202441 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:47.205447 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1461/2900] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:08:46 2022] DELETE /identity/v3/projects/b78bc19ca06e414e9023ca4b72336e2e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:08:56.218379 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=15 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:57.196665 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:09:02.416283 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de0fda-fa40-4285-ac4d-523af74b6fa9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:09:02.417518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de0fda-fa40-4285-ac4d-523af74b6fa9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:09:02.417518 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de0fda-fa40-4285-ac4d-523af74b6fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:09:02.436554 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-47de0fda-fa40-4285-ac4d-523af74b6fa9 None None] MFA Rules not processed for user `9ba18c72dcba4cc4aa863783f325e780`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:09:02.438023 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-47de0fda-fa40-4285-ac4d-523af74b6fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:09:02.496966 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1440/2901] 10.222.0.39 () {58 vars in 967 bytes} [Tue May 31 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:09:02.510523 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:09:02.511936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:09:02.583301 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bb5d3-94b0-4e19-b174-d931f804a1b9 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:09:02.588346 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dbbb4-4869-42da-b64d-96e9e7d94e70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90867ac821dd4adb8d52075fbd85caba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:09:02.589054 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dbbb4-4869-42da-b64d-96e9e7d94e70 service swift] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:09:02.589340 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dbbb4-4869-42da-b64d-96e9e7d94e70 service swift] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:09:02.589652 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dbbb4-4869-42da-b64d-96e9e7d94e70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:09:02.598557 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dbbb4-4869-42da-b64d-96e9e7d94e70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:09:02.600177 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dbbb4-4869-42da-b64d-96e9e7d94e70 service swift] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:09:02.609166 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1462/2902] 10.222.0.39 () {60 vars in 1384 bytes} [Tue May 31 21:09:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:09:05.614865 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de0fda-fa40-4285-ac4d-523af74b6fa9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:09:05.625029 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-47de0fda-fa40-4285-ac4d-523af74b6fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:09:05.691688 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de0fda-fa40-4285-ac4d-523af74b6fa9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:09:05.696094 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:09:05.696967 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:09:05.697244 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:09:05.698100 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] PATH_INFO: `/v3/users/217919f7d98646a2928681bd92618aa7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:09:05.699300 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=217919f7d98646a2928681bd92618aa7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:09:05.701207 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:09:05.889039 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217919f7d98646a2928681bd92618aa7'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:09:05.950016 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217919f7d98646a2928681bd92618aa7'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:09:05.950652 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217919f7d98646a2928681bd92618aa7'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:09:05.959425 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217919f7d98646a2928681bd92618aa7'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:09:05.968335 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217919f7d98646a2928681bd92618aa7'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:09:05.979521 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1441/2903] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:09:05 2022] DELETE /identity/v3/users/217919f7d98646a2928681bd92618aa7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:09:06.269631 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dbbb4-4869-42da-b64d-96e9e7d94e70 service swift] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:09:06.282222 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dbbb4-4869-42da-b64d-96e9e7d94e70 service swift] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:09:06.346935 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:09:06.347728 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:09:06.348006 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:09:06.348271 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] PATH_INFO: `/v3/projects/50ec2ea8cf604fadb48b8be54eb62c5f` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:09:06.349837 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ec2ea8cf604fadb48b8be54eb62c5f)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:09:06.351742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:09:06.480167 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ec2ea8cf604fadb48b8be54eb62c5f', 'request_id': 'req-004ea308-f82f-4241-8f24-4294c8f241d1'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:09:06.590650 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ec2ea8cf604fadb48b8be54eb62c5f', 'request_id': 'req-004ea308-f82f-4241-8f24-4294c8f241d1'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:09:06.597415 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ec2ea8cf604fadb48b8be54eb62c5f', 'request_id': 'req-004ea308-f82f-4241-8f24-4294c8f241d1'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:09:06.609533 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] The token cache is being invalidate because project 50ec2ea8cf604fadb48b8be54eb62c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:09:06.609871 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:09:06.610467 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:09:06.612320 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1463/2904] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:09:06 2022] DELETE /identity/v3/projects/50ec2ea8cf604fadb48b8be54eb62c5f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:09:15.975583 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:09:16.606414 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:46.827746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:46.831557 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:46.897609 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4408dc-2bb3-4e31-ae8f-0f2d8afbed56 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:46.952754 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457dda6-004a-4227-9c91-604f42af1dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:46.953445 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457dda6-004a-4227-9c91-604f42af1dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:46.953736 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457dda6-004a-4227-9c91-604f42af1dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:46.954019 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457dda6-004a-4227-9c91-604f42af1dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:46.956493 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2457dda6-004a-4227-9c91-604f42af1dd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:46.967177 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457dda6-004a-4227-9c91-604f42af1dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:46.968616 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457dda6-004a-4227-9c91-604f42af1dd2 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:46.977789 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1442/2905] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:10:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:10:47.206235 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:47.207936 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:47.221684 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ea308-f82f-4241-8f24-4294c8f241d1 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:47.226002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26e786-3e21-4040-9303-99f60ff81fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:47.226002 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26e786-3e21-4040-9303-99f60ff81fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:47.226275 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26e786-3e21-4040-9303-99f60ff81fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:47.226373 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26e786-3e21-4040-9303-99f60ff81fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:47.228124 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0a26e786-3e21-4040-9303-99f60ff81fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:47.312844 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26e786-3e21-4040-9303-99f60ff81fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:47.315379 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26e786-3e21-4040-9303-99f60ff81fc4 service neutron] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:47.327688 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1464/2906] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:10:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:10:48.525156 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457dda6-004a-4227-9c91-604f42af1dd2 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:48.526754 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2457dda6-004a-4227-9c91-604f42af1dd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:48.537933 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457dda6-004a-4227-9c91-604f42af1dd2 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:48.541890 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c16c01-dc56-412c-9d8b-974017077e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a77c08d2844e7cb81ac1370c527cdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:48.542535 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c16c01-dc56-412c-9d8b-974017077e25 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:48.542821 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c16c01-dc56-412c-9d8b-974017077e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:48.543095 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c16c01-dc56-412c-9d8b-974017077e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:48.544883 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-87c16c01-dc56-412c-9d8b-974017077e25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:48.558932 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c16c01-dc56-412c-9d8b-974017077e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:48.560411 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c16c01-dc56-412c-9d8b-974017077e25 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:48.571994 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1443/2907] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:10:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:10:49.121795 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26e786-3e21-4040-9303-99f60ff81fc4 service neutron] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:49.123390 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-0a26e786-3e21-4040-9303-99f60ff81fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:49.138289 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26e786-3e21-4040-9303-99f60ff81fc4 service neutron] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:49.147507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54901b8a-8a80-4330-92c2-694d5c434fbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c86c12743bd4ee8843dba4a7af5d7a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:49.147507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54901b8a-8a80-4330-92c2-694d5c434fbb service nova] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:49.147507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54901b8a-8a80-4330-92c2-694d5c434fbb service nova] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:49.147507 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54901b8a-8a80-4330-92c2-694d5c434fbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:49.147970 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-54901b8a-8a80-4330-92c2-694d5c434fbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:49.160873 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54901b8a-8a80-4330-92c2-694d5c434fbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:49.162512 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54901b8a-8a80-4330-92c2-694d5c434fbb service nova] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:49.174808 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1465/2908] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:10:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:10:54.771357 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c16c01-dc56-412c-9d8b-974017077e25 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:54.779678 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-87c16c01-dc56-412c-9d8b-974017077e25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:54.850247 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c16c01-dc56-412c-9d8b-974017077e25 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:54.855090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba1711-d43c-4867-8e52-a1e65ff865b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619d0b5afa094289808516486a5e3c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:54.855746 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba1711-d43c-4867-8e52-a1e65ff865b3 service placement] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:54.856033 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba1711-d43c-4867-8e52-a1e65ff865b3 service placement] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:54.856314 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba1711-d43c-4867-8e52-a1e65ff865b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:54.858218 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6bba1711-d43c-4867-8e52-a1e65ff865b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:54.870713 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba1711-d43c-4867-8e52-a1e65ff865b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:54.872383 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba1711-d43c-4867-8e52-a1e65ff865b3 service placement] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:54.883230 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1444/2909] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:10:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:10:58.985991 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54901b8a-8a80-4330-92c2-694d5c434fbb service nova] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:58.987758 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-54901b8a-8a80-4330-92c2-694d5c434fbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:59.066928 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54901b8a-8a80-4330-92c2-694d5c434fbb service nova] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:59.075174 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:59.076817 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:59.077338 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:59.077887 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] PATH_INFO: `/v3/users/e77aa0d243c04083819ad5fcd855af78` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:59.080036 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77aa0d243c04083819ad5fcd855af78)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:59.084852 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:59.350917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77aa0d243c04083819ad5fcd855af78'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:59.451678 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77aa0d243c04083819ad5fcd855af78'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:59.466293 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77aa0d243c04083819ad5fcd855af78'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:59.467061 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77aa0d243c04083819ad5fcd855af78'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:59.467753 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77aa0d243c04083819ad5fcd855af78'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:59.478545 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:59.490361 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1466/2910] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:10:58 2022] DELETE /identity/v3/users/e77aa0d243c04083819ad5fcd855af78 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:10:59.795770 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba1711-d43c-4867-8e52-a1e65ff865b3 service placement] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:59.808338 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba1711-d43c-4867-8e52-a1e65ff865b3 service placement] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:59.851841 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:59.877045 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:59.877955 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:59.878243 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:59.878760 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] PATH_INFO: `/v3/projects/37510ecaee1949ba9c7e4d3109ceb10b` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:59.880635 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37510ecaee1949ba9c7e4d3109ceb10b)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:59.882735 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:59.985833 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37510ecaee1949ba9c7e4d3109ceb10b', 'request_id': 'req-6cfba7d8-6606-48e2-9446-6ec96fb6d948'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:00.097815 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37510ecaee1949ba9c7e4d3109ceb10b', 'request_id': 'req-6cfba7d8-6606-48e2-9446-6ec96fb6d948'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:00.104025 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37510ecaee1949ba9c7e4d3109ceb10b', 'request_id': 'req-6cfba7d8-6606-48e2-9446-6ec96fb6d948'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:00.115909 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] The token cache is being invalidate because project 37510ecaee1949ba9c7e4d3109ceb10b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:11:00.116225 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:00.116872 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:00.118477 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1445/2911] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:10:59 2022] DELETE /identity/v3/projects/37510ecaee1949ba9c7e4d3109ceb10b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:11:00.122597 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:00.124031 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:00.137792 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cf783-628f-458d-9982-346bcbe13fce admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:00.196553 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:00.197450 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:00.197736 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:00.198012 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] PATH_INFO: `/v3/users/4a846f83b7be4a6bb2c6d942c0b3bf94` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:00.199195 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a846f83b7be4a6bb2c6d942c0b3bf94)` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:00.201104 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:00.439121 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a846f83b7be4a6bb2c6d942c0b3bf94'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:00.501125 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a846f83b7be4a6bb2c6d942c0b3bf94'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:00.509225 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a846f83b7be4a6bb2c6d942c0b3bf94'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:00.509958 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a846f83b7be4a6bb2c6d942c0b3bf94'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:00.510709 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.notifications [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a846f83b7be4a6bb2c6d942c0b3bf94'} {{(pid=87215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:00.539529 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1467/2912] 10.222.0.39 () {58 vars in 1223 bytes} [Tue May 31 21:11:00 2022] DELETE /identity/v3/users/4a846f83b7be4a6bb2c6d942c0b3bf94 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:11:00.802769 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:00.805668 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:00.818867 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba7d8-6606-48e2-9446-6ec96fb6d948 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:00.884486 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7803f7-ea99-4652-adef-2c4dd37eb02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d342095f994d388541563ef9df90e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f897b27191b44a4b4a76e83f6d0aaaa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:00.885364 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7803f7-ea99-4652-adef-2c4dd37eb02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:00.885674 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7803f7-ea99-4652-adef-2c4dd37eb02e admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:00.885948 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7803f7-ea99-4652-adef-2c4dd37eb02e admin admin] PATH_INFO: `/v3/projects/b60f9e6bea2f4cd4911b8bb40427123a` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:00.887145 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7803f7-ea99-4652-adef-2c4dd37eb02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60f9e6bea2f4cd4911b8bb40427123a)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:00.889048 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7803f7-ea99-4652-adef-2c4dd37eb02e admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:00.996700 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-eb7803f7-ea99-4652-adef-2c4dd37eb02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60f9e6bea2f4cd4911b8bb40427123a', 'request_id': 'req-eb7803f7-ea99-4652-adef-2c4dd37eb02e'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:01.086570 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-eb7803f7-ea99-4652-adef-2c4dd37eb02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60f9e6bea2f4cd4911b8bb40427123a', 'request_id': 'req-eb7803f7-ea99-4652-adef-2c4dd37eb02e'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:01.092705 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-eb7803f7-ea99-4652-adef-2c4dd37eb02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60f9e6bea2f4cd4911b8bb40427123a', 'request_id': 'req-eb7803f7-ea99-4652-adef-2c4dd37eb02e'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:01.094694 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:01.105090 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-eb7803f7-ea99-4652-adef-2c4dd37eb02e admin admin] The token cache is being invalidate because project b60f9e6bea2f4cd4911b8bb40427123a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:11:01.105386 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-eb7803f7-ea99-4652-adef-2c4dd37eb02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:01.106184 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-eb7803f7-ea99-4652-adef-2c4dd37eb02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:01.107880 dv-cinder-839793-16-smb devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1446/2913] 10.222.0.39 () {58 vars in 1232 bytes} [Tue May 31 21:11:00 2022] DELETE /identity/v3/projects/b60f9e6bea2f4cd4911b8bb40427123a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:11:10.535724 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=56,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:11.217350 dv-cinder-839793-16-smb devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:02.057834 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] Authenticating user token {{(pid=87215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:02.059282 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:02.196144 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219182f-a7e2-4eef-ba3c-e0bdaa7ee114 admin admin] Validating token access rules against request {{(pid=87215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:02.255050 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff5fbd-eb99-4230-b21a-64dcc66a6d96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '619d0b5afa094289808516486a5e3c4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d14229f6554a34bf9084d36cffe8ac', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:02.255720 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff5fbd-eb99-4230-b21a-64dcc66a6d96 service placement] REQUEST_METHOD: `GET` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:02.256005 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff5fbd-eb99-4230-b21a-64dcc66a6d96 service placement] SCRIPT_NAME: `/identity` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:02.256284 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff5fbd-eb99-4230-b21a-64dcc66a6d96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:02.258077 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.fernet_utils [None req-64ff5fbd-eb99-4230-b21a-64dcc66a6d96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:02.269305 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff5fbd-eb99-4230-b21a-64dcc66a6d96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:02.270917 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff5fbd-eb99-4230-b21a-64dcc66a6d96 service placement] RBAC: Authorization granted {{(pid=87215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:02.280881 dv-cinder-839793-16-smb devstack@keystone.service[87215]: [pid: 87215|app: 0|req: 1468/2914] 10.222.0.39 () {60 vars in 1365 bytes} [Tue May 31 21:13:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:13:12.276742 dv-cinder-839793-16-smb devstack@keystone.service[87215]: DEBUG dbcounter [-] [87215] Writing DB stats keystone:SELECT=89 {{(pid=87215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}